Started working on galaxy PGC1004410 at Wed Aug  5 19:04:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.802256 -8.385017699999999 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:05:00.078453
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '142.802256', '-8.385017699999999', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.802256 -8.385017699999999 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 142.802256 -8.385017699999999
Starting process 46882 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 46883 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 46884 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 46885 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 46886 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB
Starting process 46887 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB
Starting process 46888 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB
Starting process 46889 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 46890 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 46891 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 46892 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46893 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46895 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46896 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 46894 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 46897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:05:00.543735
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_180220_061505_ooi_g_ls9-N16 g expnum 723432 exptime 139.0 propid 2014B-0404 seeing 0.99 MJD 58169.260 object DECaLS_31572_g 
    decam/CP/V4.8.2a/CP20180219/c4d_180220_061505_ooi_g_ls9.fits.fz
  c4d_180221_051036_ooi_r_ls9-N16 r expnum 723749 exptime 40.0 propid 2014B-0404 seeing 0.86 MJD 58170.216 object DECaLS_31572_r 
    decam/CP/V4.8.2a/CP20180220/c4d_180221_051036_ooi_r_ls9.fits.fz
  c4d_160226_045953_ooi_z_ls9-N16 z expnum 520179 exptime 80.0 propid 2014B-0404 seeing 1.20 MJD 57444.207 object DECaLS_31572_z 
    decam/CP/V4.8.2a/CP20160225/c4d_160226_045953_ooi_z_ls9.fits.fz
  c4d_161013_084158_ooi_r_ls9-N16 r expnum 583180 exptime 125.0 propid 2014B-0404 seeing 0.97 MJD 57674.360 object DECaLS_15700_r 
    decam/CP/V4.8.2a/CP20161012/c4d_161013_084158_ooi_r_ls9.fits.fz
  c4d_161013_085438_ooi_g_ls9-N16 g expnum 583184 exptime 175.0 propid 2014B-0404 seeing 1.15 MJD 57674.369 object DECaLS_15700_g 
    decam/CP/V4.8.2a/CP20161012/c4d_161013_085438_ooi_g_ls9.fits.fz
  c4d_151128_073405_ooi_z_ls9-N16 z expnum 497260 exptime 108.0 propid 2014B-0404 seeing 0.84 MJD 57354.314 object DECaLS_15700_z 
    decam/CP/V4.8.2a/CP20151127/c4d_151128_073405_ooi_z_ls9.fits.fz
  c4d_181110_073833_ooi_g_ls9-N9 g expnum 792876 exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58432.318 object DECaLS_47444_g 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_073833_ooi_g_ls9.fits.fz
  c4d_181110_074221_ooi_r_ls9-N9 r expnum 792877 exptime 111.0 propid 2014B-0404 seeing 1.66 MJD 58432.321 object DECaLS_47444_r 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_074221_ooi_r_ls9.fits.fz
  c4d_180225_014135_ooi_z_ls9-N9 z expnum 725094 exptime 97.0 propid 2014B-0404 seeing 0.80 MJD 58174.071 object DECaLS_47444_z 
    decam/CP/V4.8.2a/CP20180224/c4d_180225_014135_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T045745_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T074221_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180220T061505_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T051036_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95285f9-z-20180225T014135_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T073833_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955872b-g-20161013T085052_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955577e-z-20151128T073127_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95622f9-r-20161013T083903_oi[N16,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 62.87 s, CPU: 0.91 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.17892 MB
Stage tims finished: 2020-08-05T19:06:03.409701
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T074221_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95285f9-z-20180225T014135_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955872b-g-20161013T085052_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T045745_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95622f9-r-20161013T083903_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955577e-z-20151128T073127_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T073833_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180220T061505_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.261 s worker CPU, 215.411 s worker Wall, Wall: 62.868 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T051036_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:06:03.501545
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06898.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07154.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07027.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/reference-custom-142802m08385.fits
Stage refs : Wall: 31.50 s, CPU: 3.03 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.204656 MB
Stage refs finished: 2020-08-05T19:06:34.999591
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 31.500 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:06:35.107561
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outlier-mask-custom-142802m08385.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-pre-custom-142802m08385.jpg
Image c4d_180220_061505_ooi_g_ls9-N16 g : masking 190 positive outlier pixels and 0 negative outlier pixels
Image c4d_181110_073833_ooi_g_ls9-N9 g : masking 206 positive outlier pixels and 0 negative outlier pixels
Image c4d_181110_074221_ooi_r_ls9-N9 r : masking 255 positive outlier pixels and 0 negative outlier pixels
Image c4d_160226_045953_ooi_z_ls9-N16 z : masking 0 positive outlier pixels and 280 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outlier-mask-custom-142802m08385.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-post-custom-142802m08385.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-masked-pos-custom-142802m08385.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-masked-neg-custom-142802m08385.jpg
Stage outliers : Wall: 1.50 s, CPU: 1.18 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.216108 MB
Stage outliers finished: 2020-08-05T19:06:36.607538
Resources for stage outliers : 0.539 s worker CPU, 0.590 s worker Wall, Wall: 1.501 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:06:36.663307
Stage halos : Wall: 0.76 s, CPU: 0.57 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.21626 MB
Stage halos finished: 2020-08-05T19:06:37.421365
Resources for stage halos : 0.390 s worker CPU, 1.025 s worker Wall, Wall: 0.760 s, Cores in use: 1.26, Total efficiency (on 16 cores): 7.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:06:37.504369
PSF sigmas in coadd pixels: ['1.61', '1.86', '2.60']
Using average PSF sigma 2.024241580934269
Gaussian PSF norm 0.1393582635742914 vs pixelized 0.1124839
average tim pixel scale / coadd scale: 1.0012687878853832
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.39', '1.57', '2.70']
Using average PSF sigma 1.8865412374352044
Gaussian PSF norm 0.14953014870610112 vs pixelized 0.120349616
average tim pixel scale / coadd scale: 1.0013005132822477
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.37', '1.30']
Using average PSF sigma 1.5403281981742687
Gaussian PSF norm 0.18313940633446918 vs pixelized 0.1547865
average tim pixel scale / coadd scale: 1.0010852671285224
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.10 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.217856 MB
Stage fit_on_coadds finished: 2020-08-05T19:06:37.652604
Resources for stage fit_on_coadds : 0.104 s worker CPU, 0.104 s worker Wall, Wall: 0.150 s, Cores in use: 1.40, Total efficiency (on 16 cores): 8.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:06:37.664806
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 31 potential peaks
Of 31 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept
SED z : 14 new peaks
Found 48 potential peaks
Of 48 potential peaks: 42 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 33 potential peaks
Of 33 potential peaks: 28 in veto map, 4 cut by saddle test, 1 cut by aper test, 0 kept
SED g : 0 new peaks
Found 59 potential peaks
Of 59 potential peaks: 51 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 78 potential peaks
Of 78 potential peaks: 72 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 21 new sources
Median coadd sky for g : 0.00027025113
Median coadd sky for r : 0.0006500259
Median coadd sky for z : 0.0014154145
Stage srcs : Wall: 2.08 s, CPU: 1.99 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.218392 MB
Stage srcs finished: 2020-08-05T19:06:39.740987
Resources for stage srcs : 0.059 s worker CPU, 0.059 s worker Wall, Wall: 2.077 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:06:39.829524
Blob 1 of 6, id: 1, sources: 17, size: 233x197, npix 21404, brick X: 0,233, Y: 3,200, one pixel: 198 3
Blob 2 of 6, id: 4, sources: 4, size: 71x57, npix 1889, brick X: 146,217, Y: 166,223, one pixel: 200 166
Blob 3 of 6, id: 0, sources: 1, size: 37x35, npix 903, brick X: 82,119, Y: 0,35, one pixel: 88 0
Blob 4 of 6, id: 2, sources: 1, size: 21x20, npix 248, brick X: 20,41, Y: 12,32, one pixel: 29 12
Blob 5 of 6, id: 3, sources: 1, size: 20x20, npix 228, brick X: 169,189, Y: 25,45, one pixel: 178 25
Blob 6 of 6, id: 5, sources: 1, size: 20x19, npix 209, brick X: 46,66, Y: 209,228, one pixel: 55 209
Blob 5 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 106 MB, VmData: 165 MB, maxrss: 0.108408 MB
Blob 6 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 938 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15096 MB
Blob 4 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093164 MB
Blob 3 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115368 MB
Blob 2 finished, total: Wall: 2.82 s, CPU: 2.81 s, VmPeak: 669 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.095712 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.47925, ee1=-0.181224, ee2=0.179843
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 16.54 s, CPU: 16.54 s, VmPeak: 945 MB, VmSize: 741 MB, VmRSS: 162 MB, VmData: 190 MB, maxrss: 0.16586 MB
Old catalog: 32
New catalog: 25
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/blobs-custom-142802m08385.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/all-models-custom-142802m08385.fits
Stage fitblobs : Wall: 17.91 s, CPU: 1.29 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.21898 MB
Stage fitblobs finished: 2020-08-05T19:06:57.739095
Resources for stage fitblobs : 21.737 s worker CPU, 21.791 s worker Wall, Wall: 17.911 s, Cores in use: 1.29, Total efficiency (on 16 cores): 8.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:06:57.750516
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-resid.jpg
Stage coadds : Wall: 7.75 s, CPU: 0.62 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.219636 MB
Stage coadds finished: 2020-08-05T19:07:05.501051
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 11.052 s worker CPU, 16.367 s worker Wall, Wall: 7.752 s, Cores in use: 1.51, Total efficiency (on 16 cores): 9.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:07:05.518416
Cut to 1 unWISE tiles
Reading WISE tile 1424m091 band 2
Reading WISE tile 1424m091 band 1
Reading WISE tile 1424m091 band 3
Reading WISE tile 1424m091 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 939 MB, VmSize: 807 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.188088 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.198256 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 938 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 171 MB, maxrss: 0.210404 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.207028 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.52 s, CPU: 0.61 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.220344 MB
Stage wise_forced finished: 2020-08-05T19:07:08.040412
Resources for stage wise_forced : 3.139 s worker CPU, 6.075 s worker Wall, Wall: 2.524 s, Cores in use: 1.49, Total efficiency (on 16 cores): 9.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:07:08.055169
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/tractor-i/cus/tractor-custom-142802m08385.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/tractor/cus/tractor-custom-142802m08385.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/tractor/cus/brick-custom-142802m08385.sha256sum
Stage writecat : Wall: 1.08 s, CPU: 0.62 s, VmPeak: 1177 MB, VmSize: 1049 MB, VmRSS: 217 MB, VmData: 240 MB, maxrss: 0.35322 MB
Stage writecat finished: 2020-08-05T19:07:09.138160
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.085 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-writecat.p
All done: 42.284 s worker CPU, 261.425 s worker Wall, Wall: 128.619 s, Cores in use: 0.41, Total efficiency (on 16 cores): 2.6 %
Finished galaxy PGC1004410 in 2.178 minutes.
Started working on galaxy PGC1004410 at Wed Aug  5 19:12:12 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.802256 -8.385017699999999 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:12:17.641956
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '142.802256', '-8.385017699999999', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.802256 -8.385017699999999 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 142.802256 -8.385017699999999
Starting process 48700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 48701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 48702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 48703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 48704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB
Starting process 48705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB
Starting process 48706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB
Starting process 48707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 48708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 48709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 48710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 48711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 48712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 48713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 48714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 48715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 48716 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 48717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 48718 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 48719 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 48720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 48721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 48722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 48723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 48724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 48725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 48726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 48727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 48728 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 48729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 48730 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 48731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:12:21.558936
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_180220_061505_ooi_g_ls9-N16 g expnum 723432 exptime 139.0 propid 2014B-0404 seeing 0.99 MJD 58169.260 object DECaLS_31572_g 
    decam/CP/V4.8.2a/CP20180219/c4d_180220_061505_ooi_g_ls9.fits.fz
  c4d_180221_051036_ooi_r_ls9-N16 r expnum 723749 exptime 40.0 propid 2014B-0404 seeing 0.86 MJD 58170.216 object DECaLS_31572_r 
    decam/CP/V4.8.2a/CP20180220/c4d_180221_051036_ooi_r_ls9.fits.fz
  c4d_160226_045953_ooi_z_ls9-N16 z expnum 520179 exptime 80.0 propid 2014B-0404 seeing 1.20 MJD 57444.207 object DECaLS_31572_z 
    decam/CP/V4.8.2a/CP20160225/c4d_160226_045953_ooi_z_ls9.fits.fz
  c4d_161013_084158_ooi_r_ls9-N16 r expnum 583180 exptime 125.0 propid 2014B-0404 seeing 0.97 MJD 57674.360 object DECaLS_15700_r 
    decam/CP/V4.8.2a/CP20161012/c4d_161013_084158_ooi_r_ls9.fits.fz
  c4d_161013_085438_ooi_g_ls9-N16 g expnum 583184 exptime 175.0 propid 2014B-0404 seeing 1.15 MJD 57674.369 object DECaLS_15700_g 
    decam/CP/V4.8.2a/CP20161012/c4d_161013_085438_ooi_g_ls9.fits.fz
  c4d_151128_073405_ooi_z_ls9-N16 z expnum 497260 exptime 108.0 propid 2014B-0404 seeing 0.84 MJD 57354.314 object DECaLS_15700_z 
    decam/CP/V4.8.2a/CP20151127/c4d_151128_073405_ooi_z_ls9.fits.fz
  c4d_181110_073833_ooi_g_ls9-N9 g expnum 792876 exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58432.318 object DECaLS_47444_g 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_073833_ooi_g_ls9.fits.fz
  c4d_181110_074221_ooi_r_ls9-N9 r expnum 792877 exptime 111.0 propid 2014B-0404 seeing 1.66 MJD 58432.321 object DECaLS_47444_r 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_074221_ooi_r_ls9.fits.fz
  c4d_180225_014135_ooi_z_ls9-N9 z expnum 725094 exptime 97.0 propid 2014B-0404 seeing 0.80 MJD 58174.071 object DECaLS_47444_z 
    decam/CP/V4.8.2a/CP20180224/c4d_180225_014135_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T073833_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95622f9-r-20161013T083903_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T045745_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T051036_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95285f9-z-20180225T014135_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T074221_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180220T061505_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955577e-z-20151128T073127_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955872b-g-20161013T085052_oi[N16,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 26.40 s, CPU: 2.66 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179212 MB
Stage tims finished: 2020-08-05T19:12:47.957527
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T073833_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95622f9-r-20161013T083903_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T051036_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95285f9-z-20180225T014135_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955577e-z-20151128T073127_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955872b-g-20161013T085052_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180220T061505_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.272 s worker CPU, 120.727 s worker Wall, Wall: 26.401 s, Cores in use: 0.30, Total efficiency (on 32 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T045745_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:12:48.051736
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06898.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07154.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07027.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/reference-custom-142802m08385.fits
Stage refs : Wall: 5.43 s, CPU: 3.27 s, VmPeak: 1042 MB, VmSize: 1035 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.204672 MB
Stage refs finished: 2020-08-05T19:12:53.486563
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T074221_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 5.437 s, Cores in use: 0.60, Total efficiency (on 32 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:12:53.626265
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outlier-mask-custom-142802m08385.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-pre-custom-142802m08385.jpg
Image c4d_180220_061505_ooi_g_ls9-N16 g : masking 190 positive outlier pixels and 0 negative outlier pixels
Image c4d_181110_073833_ooi_g_ls9-N9 g : masking 206 positive outlier pixels and 0 negative outlier pixels
Image c4d_181110_074221_ooi_r_ls9-N9 r : masking 255 positive outlier pixels and 0 negative outlier pixels
Image c4d_160226_045953_ooi_z_ls9-N16 z : masking 0 positive outlier pixels and 280 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outlier-mask-custom-142802m08385.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-post-custom-142802m08385.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-masked-pos-custom-142802m08385.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/outliers-masked-neg-custom-142802m08385.jpg
Stage outliers : Wall: 1.57 s, CPU: 1.14 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.21612 MB
Stage outliers finished: 2020-08-05T19:12:55.195421
Resources for stage outliers : 0.624 s worker CPU, 0.776 s worker Wall, Wall: 1.571 s, Cores in use: 1.12, Total efficiency (on 32 cores): 3.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:12:55.292106
Stage halos : Wall: 1.07 s, CPU: 0.90 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.216252 MB
Stage halos finished: 2020-08-05T19:12:56.366458
Resources for stage halos : 0.470 s worker CPU, 1.148 s worker Wall, Wall: 1.077 s, Cores in use: 1.27, Total efficiency (on 32 cores): 4.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:12:56.390457
PSF sigmas in coadd pixels: ['1.61', '1.86', '2.60']
Using average PSF sigma 2.024241580934269
Gaussian PSF norm 0.1393582635742914 vs pixelized 0.1124839
average tim pixel scale / coadd scale: 1.0012687878853832
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.39', '1.57', '2.70']
Using average PSF sigma 1.8865412374352044
Gaussian PSF norm 0.14953014870610112 vs pixelized 0.120349616
average tim pixel scale / coadd scale: 1.0013005132822477
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.37', '1.30']
Using average PSF sigma 1.5403281981742687
Gaussian PSF norm 0.18313940633446918 vs pixelized 0.1547865
average tim pixel scale / coadd scale: 1.0010852671285224
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.11 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.217852 MB
Stage fit_on_coadds finished: 2020-08-05T19:12:56.514689
Resources for stage fit_on_coadds : 0.114 s worker CPU, 0.163 s worker Wall, Wall: 0.126 s, Cores in use: 1.78, Total efficiency (on 32 cores): 5.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:12:56.527208
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 31 potential peaks
Of 31 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 14 kept
SED z : 14 new peaks
Found 48 potential peaks
Of 48 potential peaks: 42 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 33 potential peaks
Of 33 potential peaks: 28 in veto map, 4 cut by saddle test, 1 cut by aper test, 0 kept
SED g : 0 new peaks
Found 59 potential peaks
Of 59 potential peaks: 51 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 78 potential peaks
Of 78 potential peaks: 72 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 21 new sources
Median coadd sky for g : 0.00027025113
Median coadd sky for r : 0.0006500259
Median coadd sky for z : 0.0014154145
Stage srcs : Wall: 0.84 s, CPU: 0.81 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.218388 MB
Stage srcs finished: 2020-08-05T19:12:57.363712
Resources for stage srcs : 0.067 s worker CPU, 0.067 s worker Wall, Wall: 0.839 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:13:00.416225
Blob 1 of 6, id: 1, sources: 17, size: 233x197, npix 21404, brick X: 0,233, Y: 3,200, one pixel: 198 3
Blob 2 of 6, id: 4, sources: 4, size: 71x57, npix 1889, brick X: 146,217, Y: 166,223, one pixel: 200 166
Blob 3 of 6, id: 0, sources: 1, size: 37x35, npix 903, brick X: 82,119, Y: 0,35, one pixel: 88 0
Blob 4 of 6, id: 2, sources: 1, size: 21x20, npix 248, brick X: 20,41, Y: 12,32, one pixel: 29 12
Blob 5 of 6, id: 3, sources: 1, size: 20x20, npix 228, brick X: 169,189, Y: 25,45, one pixel: 178 25
Blob 6 of 6, id: 5, sources: 1, size: 20x19, npix 209, brick X: 46,66, Y: 209,228, one pixel: 55 209
Blob 5 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 107 MB, VmData: 166 MB, maxrss: 0.110056 MB
Blob 6 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092536 MB
Blob 4 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092268 MB
Blob 3 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 938 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149168 MB
Blob 2 finished, total: Wall: 2.95 s, CPU: 2.89 s, VmPeak: 670 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.095008 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.47925, ee1=-0.181224, ee2=0.179843
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 18.24 s, CPU: 18.22 s, VmPeak: 704 MB, VmSize: 689 MB, VmRSS: 121 MB, VmData: 160 MB, maxrss: 0.138548 MB
Old catalog: 32
New catalog: 25
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/blobs-custom-142802m08385.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/metrics/cus/all-models-custom-142802m08385.fits
Stage fitblobs : Wall: 18.73 s, CPU: 0.44 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.219 MB
Stage fitblobs finished: 2020-08-05T19:13:19.142186
Resources for stage fitblobs : 23.645 s worker CPU, 23.777 s worker Wall, Wall: 18.728 s, Cores in use: 1.29, Total efficiency (on 32 cores): 4.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:13:19.162236
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-resid.jpg
Stage coadds : Wall: 11.50 s, CPU: 1.62 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 214 MB, VmData: 240 MB, maxrss: 0.219636 MB
Stage coadds finished: 2020-08-05T19:13:30.662881
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 30.754 s worker CPU, 57.784 s worker Wall, Wall: 11.503 s, Cores in use: 2.81, Total efficiency (on 32 cores): 8.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:13:30.724182
Cut to 1 unWISE tiles
Reading WISE tile 1424m091 band 3
Reading WISE tile 1424m091 band 4
Reading WISE tile 1424m091 band 1
Reading WISE tile 1424m091 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 945 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203216 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.202812 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 941 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.187096 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 941 MB, VmSize: 802 MB, VmRSS: 141 MB, VmData: 172 MB, maxrss: 0.2038 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/tmp-legacysurvey-custom-142802m08385-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.00 s, CPU: 1.47 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.22034 MB
Stage wise_forced finished: 2020-08-05T19:13:34.719191
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.311 s worker CPU, 6.988 s worker Wall, Wall: 3.998 s, Cores in use: 1.20, Total efficiency (on 32 cores): 3.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T19:13:34.735903
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/coadd/cus/custom-142802m08385/legacysurvey-custom-142802m08385-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/tractor-i/cus/tractor-custom-142802m08385.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/tractor/cus/tractor-custom-142802m08385.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/tractor/cus/brick-custom-142802m08385.sha256sum
Stage writecat : Wall: 1.80 s, CPU: 0.76 s, VmPeak: 1177 MB, VmSize: 1049 MB, VmRSS: 217 MB, VmData: 240 MB, maxrss: 0.353216 MB
Stage writecat finished: 2020-08-05T19:13:36.533476
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.800 s, Cores in use: 0.42, Total efficiency (on 32 cores): 1.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/142/PGC1004410/PGC1004410-largegalaxy-writecat.p
All done: 64.262 s worker CPU, 211.437 s worker Wall, Wall: 75.017 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 %
Finished galaxy PGC1004410 in 1.405 minutes.
Started working on galaxy PGC1004410 at Mon Aug 10 07:48:14 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.80293003901906 -8.384720215096154 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T07:48:15.734588
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '142.80293003901906', '-8.384720215096154', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.80293003901906 -8.384720215096154 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 142.80293003901906 -8.384720215096154
Starting process 8323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 8324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 8325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 8326 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 8327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 8328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 8329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 8330 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T07:48:16.677098
Keeping 9 CCDs:
  c4d_180220_061505_ooi_g_ls9-N16 g expnum 723432 exptime 139.0 propid 2014B-0404 seeing 0.99 MJD 58169.260 object DECaLS_31572_g 
    decam/CP/V4.8.2a/CP20180219/c4d_180220_061505_ooi_g_ls9.fits.fz
  c4d_180221_051036_ooi_r_ls9-N16 r expnum 723749 exptime 40.0 propid 2014B-0404 seeing 0.86 MJD 58170.216 object DECaLS_31572_r 
    decam/CP/V4.8.2a/CP20180220/c4d_180221_051036_ooi_r_ls9.fits.fz
  c4d_160226_045953_ooi_z_ls9-N16 z expnum 520179 exptime 80.0 propid 2014B-0404 seeing 1.20 MJD 57444.207 object DECaLS_31572_z 
    decam/CP/V4.8.2a/CP20160225/c4d_160226_045953_ooi_z_ls9.fits.fz
  c4d_161013_084158_ooi_r_ls9-N16 r expnum 583180 exptime 125.0 propid 2014B-0404 seeing 0.97 MJD 57674.360 object DECaLS_15700_r 
    decam/CP/V4.8.2a/CP20161012/c4d_161013_084158_ooi_r_ls9.fits.fz
  c4d_161013_085438_ooi_g_ls9-N16 g expnum 583184 exptime 175.0 propid 2014B-0404 seeing 1.15 MJD 57674.369 object DECaLS_15700_g 
    decam/CP/V4.8.2a/CP20161012/c4d_161013_085438_ooi_g_ls9.fits.fz
  c4d_151128_073405_ooi_z_ls9-N16 z expnum 497260 exptime 108.0 propid 2014B-0404 seeing 0.84 MJD 57354.314 object DECaLS_15700_z 
    decam/CP/V4.8.2a/CP20151127/c4d_151128_073405_ooi_z_ls9.fits.fz
  c4d_181110_073833_ooi_g_ls9-N9 g expnum 792876 exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58432.318 object DECaLS_47444_g 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_073833_ooi_g_ls9.fits.fz
  c4d_181110_074221_ooi_r_ls9-N9 r expnum 792877 exptime 111.0 propid 2014B-0404 seeing 1.66 MJD 58432.321 object DECaLS_47444_r 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_074221_ooi_r_ls9.fits.fz
  c4d_180225_014135_ooi_z_ls9-N9 z expnum 725094 exptime 97.0 propid 2014B-0404 seeing 0.80 MJD 58174.071 object DECaLS_47444_z 
    decam/CP/V4.8.2a/CP20180224/c4d_180225_014135_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T045745_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95622f9-r-20161013T083903_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T074221_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180220T061505_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T051036_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T073833_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955872b-g-20161013T085052_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955577e-z-20151128T073127_oi[N16,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95285f9-z-20180225T014135_oi[N9,noinherit][2046,4094][real]: DECaLS_4
Stage tims : Wall: 62.70 s, CPU: 1.24 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.176952 MB
Stage tims finished: 2020-08-10T07:49:19.374187
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95622f9-r-20161013T083903_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T073833_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955872b-g-20161013T085052_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T051036_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T074221_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955577e-z-20151128T073127_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180220T061505_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T045745_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95285f9-z-20180225T014135_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
Resources for stage tims : 5.677 s worker CPU, 207.681 s worker Wall, Wall: 62.698 s, Cores in use: 0.11, Total efficiency (on 8 cores): 1.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-10T07:49:19.391724
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06898.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07154.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07027.fits
Matched 5 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/reference-custom-142802m08384.fits
Stage refs : Wall: 10.52 s, CPU: 2.14 s, VmPeak: 1035 MB, VmSize: 1029 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202584 MB
Stage refs finished: 2020-08-10T07:49:29.908759
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.518 s, Cores in use: 0.20, Total efficiency (on 8 cores): 2.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T07:49:29.939963
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/outlier-mask-custom-142802m08384.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/outliers-pre-custom-142802m08384.jpg
Image c4d_180220_061505_ooi_g_ls9-N16 g : masking 133 positive outlier pixels and 0 negative outlier pixels
Image c4d_161013_084158_ooi_r_ls9-N16 r : masking 63 positive outlier pixels and 0 negative outlier pixels
Image c4d_181110_074221_ooi_r_ls9-N9 r : masking 259 positive outlier pixels and 63 negative outlier pixels
Image c4d_160226_045953_ooi_z_ls9-N16 z : masking 0 positive outlier pixels and 300 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/outlier-mask-custom-142802m08384.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/outliers-post-custom-142802m08384.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/outliers-masked-pos-custom-142802m08384.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/outliers-masked-neg-custom-142802m08384.jpg
Stage outliers : Wall: 0.71 s, CPU: 0.55 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.212696 MB
Stage outliers finished: 2020-08-10T07:49:30.648285
Resources for stage outliers : 0.509 s worker CPU, 0.509 s worker Wall, Wall: 0.709 s, Cores in use: 1.49, Total efficiency (on 8 cores): 18.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T07:49:30.666694
Stage halos : Wall: 0.31 s, CPU: 0.20 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.21308 MB
Stage halos finished: 2020-08-10T07:49:30.975207
Resources for stage halos : 0.360 s worker CPU, 0.595 s worker Wall, Wall: 0.309 s, Cores in use: 1.82, Total efficiency (on 8 cores): 22.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T07:49:31.041987
PSF sigmas in coadd pixels: ['1.61', '1.86', '2.60']
Using average PSF sigma 2.024241580934269
Gaussian PSF norm 0.1393582635742914 vs pixelized 0.11248524
average tim pixel scale / coadd scale: 1.0012687878853832
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.39', '1.57', '2.70']
Using average PSF sigma 1.8865412374352044
Gaussian PSF norm 0.14953014870610112 vs pixelized 0.120354034
average tim pixel scale / coadd scale: 1.0013005132822477
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.37', '1.30']
Using average PSF sigma 1.5403281981742687
Gaussian PSF norm 0.18313940633446918 vs pixelized 0.15480265
average tim pixel scale / coadd scale: 1.0010852671285224
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.11 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.215976 MB
Stage fit_on_coadds finished: 2020-08-10T07:49:31.187609
Resources for stage fit_on_coadds : 0.109 s worker CPU, 0.109 s worker Wall, Wall: 0.147 s, Cores in use: 1.49, Total efficiency (on 8 cores): 18.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T07:49:31.196796
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 30 potential peaks
Of 30 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 47 potential peaks
Of 47 potential peaks: 42 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 32 potential peaks
Of 32 potential peaks: 27 in veto map, 4 cut by saddle test, 1 cut by aper test, 0 kept
SED g : 0 new peaks
Found 60 potential peaks
Of 60 potential peaks: 50 in veto map, 6 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 80 potential peaks
Of 80 potential peaks: 72 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 21 new sources
Median coadd sky for g : 0.00020728429
Median coadd sky for r : 0.000620897
Median coadd sky for z : 0.0014549398
Stage srcs : Wall: 0.53 s, CPU: 0.51 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.216564 MB
Stage srcs finished: 2020-08-10T07:49:31.728602
Resources for stage srcs : 0.061 s worker CPU, 0.061 s worker Wall, Wall: 0.533 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T07:49:31.738903
Blob 1 of 9, id: 1, sources: 14, size: 228x196, npix 20703, brick X: 5,233, Y: 0,196, one pixel: 204 0
Blob 2 of 9, id: 6, sources: 4, size: 71x58, npix 1903, brick X: 155,226, Y: 161,219, one pixel: 210 161
Blob 3 of 9, id: 0, sources: 1, size: 36x31, npix 797, brick X: 92,128, Y: 0,31, one pixel: 96 0
Blob 4 of 9, id: 5, sources: 1, size: 34x41, npix 681, brick X: 4,38, Y: 80,121, one pixel: 25 80
Blob 5 of 9, id: 2, sources: 1, size: 21x21, npix 249, brick X: 29,50, Y: 7,28, one pixel: 39 7
Blob 6 of 9, id: 3, sources: 1, size: 20x20, npix 228, brick X: 178,198, Y: 21,41, one pixel: 187 21
Blob 7 of 9, id: 8, sources: 1, size: 22x15, npix 214, brick X: 136,158, Y: 218,233, one pixel: 146 218
Blob 8 of 9, id: 7, sources: 1, size: 19x19, npix 208, brick X: 56,75, Y: 205,224, one pixel: 64 205
Blob 9 of 9, id: 4, sources: 1, size: 18x18, npix 180, brick X: 0,18, Y: 34,52, one pixel: 8 34
Blob 6 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 942 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14532 MB
Blob 9 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 942 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14532 MB
Blob 8 finished, total: Wall: 0.67 s, CPU: 0.66 s, VmPeak: 938 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14576 MB
Blob 5 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 969 MB, VmSize: 728 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146836 MB
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146612 MB
Blob 3 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147708 MB
Blob 4 finished, total: Wall: 1.47 s, CPU: 1.47 s, VmPeak: 939 MB, VmSize: 723 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142876 MB
Blob 2 finished, total: Wall: 2.97 s, CPU: 2.97 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147264 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.45985, ee1=-0.19032, ee2=0.179199
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 14.51 s, CPU: 14.51 s, VmPeak: 956 MB, VmSize: 729 MB, VmRSS: 153 MB, VmData: 184 MB, maxrss: 0.15708 MB
Old catalog: 31
New catalog: 26
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/blobs-custom-142802m08384.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/metrics/cus/all-models-custom-142802m08384.fits
Stage fitblobs : Wall: 14.94 s, CPU: 0.39 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.217192 MB
Stage fitblobs finished: 2020-08-10T07:49:46.681780
Resources for stage fitblobs : 22.980 s worker CPU, 23.055 s worker Wall, Wall: 14.944 s, Cores in use: 1.56, Total efficiency (on 8 cores): 19.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T07:49:46.692502
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/tmp-legacysurvey-custom-142802m08384-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/tmp-legacysurvey-custom-142802m08384-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/tmp-legacysurvey-custom-142802m08384-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/tmp-legacysurvey-custom-142802m08384-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-resid.jpg
Stage coadds : Wall: 1.42 s, CPU: 0.64 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.217708 MB
Stage coadds finished: 2020-08-10T07:49:48.116753
Resources for stage coadds : 3.823 s worker CPU, 4.318 s worker Wall, Wall: 1.425 s, Cores in use: 3.13, Total efficiency (on 8 cores): 39.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T07:49:48.128102
Cut to 1 unWISE tiles
Reading WISE tile 1424m091 band 2
Reading WISE tile 1424m091 band 4
Reading WISE tile 1424m091 band 1
Reading WISE tile 1424m091 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 941 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.206324 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.205936 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 807 MB, VmRSS: 155 MB, VmData: 178 MB, maxrss: 0.219024 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1424m091/unwise-1424m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 939 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.194168 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/tmp-legacysurvey-custom-142802m08384-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/tmp-legacysurvey-custom-142802m08384-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.33 s, CPU: 0.87 s, VmPeak: 1038 MB, VmSize: 1038 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.218412 MB
Stage wise_forced finished: 2020-08-10T07:49:51.460438
Resources for stage wise_forced : 3.139 s worker CPU, 6.104 s worker Wall, Wall: 3.333 s, Cores in use: 1.20, Total efficiency (on 8 cores): 15.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T07:49:51.545033
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/coadd/cus/custom-142802m08384/legacysurvey-custom-142802m08384-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/tractor-i/cus/tractor-custom-142802m08384.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/tractor/cus/tractor-custom-142802m08384.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/tractor/cus/brick-custom-142802m08384.sha256sum
Stage writecat : Wall: 0.70 s, CPU: 0.52 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.351272 MB
Stage writecat finished: 2020-08-10T07:49:52.243831
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.700 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1004410/PGC1004410-largegalaxy-writecat.p
All done: 36.659 s worker CPU, 242.434 s worker Wall, Wall: 95.584 s, Cores in use: 0.46, Total efficiency (on 8 cores): 5.7 %
Finished galaxy PGC1004410 in 1.631 minutes.