Started working on galaxy PGC1015891 at Wed Aug  5 19:08:02 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.02977250000004 -7.619122099999999 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:08:08.014710
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.02977250000004', '-7.619122099999999', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.02977250000004 -7.619122099999999 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 343.02977250000004 -7.619122099999999
Starting process 21630 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 21631 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21632 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 21634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB
Starting process 21635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB
Starting process 21636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB
Starting process 21637 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21638 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 21639 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 21640 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21641 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 21643 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21644 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21642 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 21645 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:08:08.647241
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 10 CCDs:
  c4d_180903_031332_ooi_r_ls9-N9 r expnum 768310 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58364.134 object DECaLS_13990_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_031332_ooi_r_ls9.fits.fz
  c4d_180903_031440_ooi_g_ls9-N9 g expnum 768311 exptime 78.0 propid 2014B-0404 seeing 1.11 MJD 58364.135 object DECaLS_13990_g 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_031440_ooi_g_ls9.fits.fz
  c4d_180808_045435_ooi_g_ls9-N13 g expnum 762878 exptime 200.0 propid 2014B-0404 seeing 1.96 MJD 58338.205 object DECaLS_45748_g 
    decam/CP/V4.8.2a/CP20180807/c4d_180808_045435_ooi_g_ls9.fits.fz
  c4d_170916_023220_ooi_r_ls9-N13 r expnum 677978 exptime 175.0 propid 2014B-0404 seeing 1.64 MJD 58012.106 object DECaLS_45748_r 
    decam/CP/V4.8.2a/CP20170915/c4d_170916_023220_ooi_r_ls9.fits.fz
  c4d_170718_103035_ooi_z_ls9-N13 z expnum 659732 exptime 250.0 propid 2014B-0404 seeing 1.51 MJD 57952.434 object DECaLS_45748_z 
    decam/CP/V4.8.2/CP20170717/c4d_170718_103035_ooi_z_ls9.fits.fz
  c4d_180909_035902_ooi_g_ls9-N8 g expnum 771068 exptime 77.0 propid 2014B-0404 seeing 1.12 MJD 58370.166 object DECaLS_29862_g 
    decam/CP/V4.8.2a/CP20180908/c4d_180909_035902_ooi_g_ls9.fits.fz
  c4d_180903_015128_ooi_r_ls9-N8 r expnum 768272 exptime 58.0 propid 2014B-0404 seeing 1.16 MJD 58364.077 object DECaLS_29862_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_015128_ooi_r_ls9.fits.fz
  c4d_160811_044937_ooi_z_ls9-N8 z expnum 562795 exptime 80.0 propid 2014B-0404 seeing 1.26 MJD 57611.200 object DECaLS_29862_z 
    decam/CP/V4.8.2a/CP20160810/c4d_160811_044937_ooi_z_ls9.fits.fz
  c4d_180905_041214_ooi_g_ls9-S17 g expnum 769079 exptime 56.0 propid 2014B-0404 seeing 1.09 MJD 58366.175 object DECaLS_56572_g 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_041214_ooi_g_ls9.fits.fz
  c4d_180905_070701_ooi_r_ls9-S17 r expnum 769187 exptime 40.0 propid 2014B-0404 seeing 1.04 MJD 58366.297 object DECaLS_56572_r 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_070701_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e95c-r-20180905T070701_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T015128_oi[N8,noinherit][2046,4094][real]: DECaLS_29862
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953495f-g-20180905T041214_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T045435_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T031332_oi[N9,noinherit][2046,4094][real]: DECaLS_13990
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160811T044727_oi[N8,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T023220_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170718T102533_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T031440_oi[N9,noinherit][2046,4094][real]: DECaLS_13990
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
WARNING: image median 0.016905285 is more than 1 sigma away from zero!
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95362bd-g-20180909T035902_oi[N8,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
WARNING: image median 0.00682933 is more than 1 sigma away from zero!
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 55.96 s, CPU: 1.07 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 210 MB, maxrss: 0.1816 MB
Stage tims finished: 2020-08-05T19:09:04.605449
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T031332_oi[N9,noinherit][2046,4094][real]: DECaLS_13990 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953495f-g-20180905T041214_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T045435_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170718T102533_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95362bd-g-20180909T035902_oi[N8,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.996 s worker CPU, 316.768 s worker Wall, Wall: 55.960 s, Cores in use: 0.13, Total efficiency (on 16 cores): 0.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T015128_oi[N8,noinherit][2046,4094][real]: DECaLS_29862 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e95c-r-20180905T070701_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160811T044727_oi[N8,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T023220_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:09:04.774985
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06842.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06969.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07098.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06970.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/reference-custom-343029m07619.fits
Stage refs : Wall: 7.97 s, CPU: 1.76 s, VmPeak: 1042 MB, VmSize: 1027 MB, VmRSS: 194 MB, VmData: 226 MB, maxrss: 0.199048 MB
Stage refs finished: 2020-08-05T19:09:12.746748
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T031440_oi[N9,noinherit][2046,4094][real]: DECaLS_13990 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.973 s, Cores in use: 0.22, Total efficiency (on 16 cores): 1.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:09:12.767295
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outlier-mask-custom-343029m07619.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-pre-custom-343029m07619.jpg
Image c4d_180903_031440_ooi_g_ls9-N9 g : masking 0 positive outlier pixels and 10253 negative outlier pixels
Image c4d_180909_035902_ooi_g_ls9-N8 g : masking 54792 positive outlier pixels and 0 negative outlier pixels
Image c4d_180905_041214_ooi_g_ls9-S17 g : masking 0 positive outlier pixels and 43118 negative outlier pixels
Image c4d_170916_023220_ooi_r_ls9-N13 r : masking 498 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_031332_ooi_r_ls9-N9 r : masking 0 positive outlier pixels and 630 negative outlier pixels
Image c4d_180905_070701_ooi_r_ls9-S17 r : masking 0 positive outlier pixels and 12361 negative outlier pixels
Image c4d_180903_015128_ooi_r_ls9-N8 r : masking 53107 positive outlier pixels and 0 negative outlier pixels
Image c4d_160811_044937_ooi_z_ls9-N8 z : masking 695 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outlier-mask-custom-343029m07619.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-post-custom-343029m07619.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-masked-pos-custom-343029m07619.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-masked-neg-custom-343029m07619.jpg
Stage outliers : Wall: 1.41 s, CPU: 0.58 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.211836 MB
Stage outliers finished: 2020-08-05T19:09:14.178656
Resources for stage outliers : 2.517 s worker CPU, 2.655 s worker Wall, Wall: 1.413 s, Cores in use: 2.19, Total efficiency (on 16 cores): 13.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:09:14.276345
Stage halos : Wall: 1.72 s, CPU: 1.47 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.2123 MB
Stage halos finished: 2020-08-05T19:09:15.999853
Resources for stage halos : 0.182 s worker CPU, 1.448 s worker Wall, Wall: 1.725 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:09:16.124128
PSF sigmas in coadd pixels: ['1.80', '3.18', '1.81', '1.78']
Using average PSF sigma 2.1407018291365527
Gaussian PSF norm 0.1317767789676998 vs pixelized 0.09997316
average tim pixel scale / coadd scale: 1.0010803933477541
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.65', '2.66', '1.88', '1.69']
Using average PSF sigma 1.9704775142059394
Gaussian PSF norm 0.1431606246405488 vs pixelized 0.111851655
average tim pixel scale / coadd scale: 1.001136779242181
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.45', '2.05']
Using average PSF sigma 2.247539086128704
Gaussian PSF norm 0.12551274125326786 vs pixelized 0.09704996
average tim pixel scale / coadd scale: 1.001124507312144
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.80 s, CPU: 0.14 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.213896 MB
Stage fit_on_coadds finished: 2020-08-05T19:09:16.925085
Resources for stage fit_on_coadds : 1.753 s worker CPU, 1.753 s worker Wall, Wall: 0.802 s, Cores in use: 2.37, Total efficiency (on 16 cores): 14.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:09:16.945295
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 49 potential peaks
Of 49 potential peaks: 27 in veto map, 4 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 54 potential peaks
Of 54 potential peaks: 46 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 39 potential peaks
Of 39 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 59 potential peaks
Of 59 potential peaks: 51 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 74 potential peaks
Of 74 potential peaks: 68 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 23 new sources
Median coadd sky for g : 0.00027897063
Median coadd sky for r : 0.0007294211
Median coadd sky for z : 0.0021358537
Stage srcs : Wall: 1.34 s, CPU: 1.30 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.214244 MB
Stage srcs finished: 2020-08-05T19:09:18.286825
Resources for stage srcs : 0.077 s worker CPU, 0.077 s worker Wall, Wall: 1.343 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:09:18.301166
Blob 1 of 9, id: 1, sources: 15, size: 152x239, npix 25821, brick X: 37,189, Y: 0,239, one pixel: 129 0
Blob 2 of 9, id: 5, sources: 2, size: 60x58, npix 2038, brick X: 179,239, Y: 159,217, one pixel: 213 159
Blob 3 of 9, id: 0, sources: 1, size: 52x40, npix 1410, brick X: 0,52, Y: 0,40, one pixel: 17 0
Blob 4 of 9, id: 3, sources: 1, size: 43x38, npix 879, brick X: 9,52, Y: 95,133, one pixel: 25 95
Blob 5 of 9, id: 4, sources: 1, size: 31x29, npix 564, brick X: 202,233, Y: 119,148, one pixel: 217 119
Blob 6 of 9, id: 2, sources: 1, size: 19x30, npix 415, brick X: 220,239, Y: 56,86, one pixel: 231 56
Blob 7 of 9, id: 7, sources: 1, size: 28x21, npix 391, brick X: 168,196, Y: 218,239, one pixel: 183 218
Blob 8 of 9, id: 6, sources: 1, size: 20x24, npix 305, brick X: 0,20, Y: 197,221, one pixel: 6 197
Blob 9 of 9, id: 8, sources: 1, size: 22x18, npix 250, brick X: 214,236, Y: 221,239, one pixel: 223 221
Blob 9 finished, total: Wall: 0.08 s, CPU: 0.06 s, VmPeak: 921 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 8 finished, total: Wall: 0.28 s, CPU: 0.27 s, VmPeak: 955 MB, VmSize: 737 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.155496 MB
Blob 4 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149352 MB
Blob 5 finished, total: Wall: 0.76 s, CPU: 0.75 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147328 MB
Blob 3 finished, total: Wall: 0.88 s, CPU: 0.87 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.115804 MB
Blob 7 finished, total: Wall: 0.95 s, CPU: 0.93 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148412 MB
Blob 6 finished, total: Wall: 1.17 s, CPU: 1.15 s, VmPeak: 906 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150448 MB
Blob 2 finished, total: Wall: 2.53 s, CPU: 2.52 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112516 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.51393, ee1=0.162596, ee2=0.0334424
Blob 1 finished, total: Wall: 13.74 s, CPU: 13.73 s, VmPeak: 958 MB, VmSize: 733 MB, VmRSS: 154 MB, VmData: 182 MB, maxrss: 0.158 MB
Old catalog: 26
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/blobs-custom-343029m07619.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/all-models-custom-343029m07619.fits
Stage fitblobs : Wall: 14.71 s, CPU: 0.83 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.21516 MB
Stage fitblobs finished: 2020-08-05T19:09:33.011015
Resources for stage fitblobs : 20.716 s worker CPU, 21.010 s worker Wall, Wall: 14.711 s, Cores in use: 1.46, Total efficiency (on 16 cores): 9.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:09:33.026339
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-resid.jpg
Stage coadds : Wall: 3.73 s, CPU: 0.89 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215676 MB
Stage coadds finished: 2020-08-05T19:09:36.757059
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 10.354 s worker CPU, 14.719 s worker Wall, Wall: 3.732 s, Cores in use: 3.01, Total efficiency (on 16 cores): 18.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:09:36.767523
Cut to 1 unWISE tiles
Reading WISE tile 3432m076 band 1
Reading WISE tile 3432m076 band 3
Reading WISE tile 3432m076 band 2
Reading WISE tile 3432m076 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 921 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.195632 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 138 MB, VmData: 170 MB, maxrss: 0.197932 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 953 MB, VmSize: 805 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.206996 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 953 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206892 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.53 s, CPU: 0.46 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.21638 MB
Stage wise_forced finished: 2020-08-05T19:09:39.301855
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 2.977 s worker CPU, 5.714 s worker Wall, Wall: 2.536 s, Cores in use: 1.36, Total efficiency (on 16 cores): 8.5 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:09:39.318978
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/tractor-i/cus/tractor-custom-343029m07619.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/tractor/cus/tractor-custom-343029m07619.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/tractor/cus/brick-custom-343029m07619.sha256sum
Stage writecat : Wall: 2.28 s, CPU: 1.08 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 213 MB, VmData: 237 MB, maxrss: 0.349352 MB
Stage writecat finished: 2020-08-05T19:09:41.596668
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.279 s, Cores in use: 0.48, Total efficiency (on 16 cores): 3.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-writecat.p
All done: 44.575 s worker CPU, 364.148 s worker Wall, Wall: 92.973 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.7 %
Finished galaxy PGC1015891 in 1.657 minutes.
Started working on galaxy PGC1015891 at Wed Aug  5 19:28:53 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.02977250000004 -7.619122099999999 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:28:55.093900
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.02977250000004', '-7.619122099999999', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.02977250000004 -7.619122099999999 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 343.02977250000004 -7.619122099999999
Starting process 26418 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 26419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 26420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 26421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 26422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB
Starting process 26423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 26424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 26425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 26426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 26427 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 26428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 26429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 26430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 26431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 26432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 26433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 26434 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 26435 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 26436 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 26437 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 26438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 26439 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 26440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 26441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 26442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 26443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 26444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 26445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 26446 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 26447 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 26448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 26449 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:28:56.654765
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 10 CCDs:
  c4d_180903_031332_ooi_r_ls9-N9 r expnum 768310 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58364.134 object DECaLS_13990_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_031332_ooi_r_ls9.fits.fz
  c4d_180903_031440_ooi_g_ls9-N9 g expnum 768311 exptime 78.0 propid 2014B-0404 seeing 1.11 MJD 58364.135 object DECaLS_13990_g 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_031440_ooi_g_ls9.fits.fz
  c4d_180808_045435_ooi_g_ls9-N13 g expnum 762878 exptime 200.0 propid 2014B-0404 seeing 1.96 MJD 58338.205 object DECaLS_45748_g 
    decam/CP/V4.8.2a/CP20180807/c4d_180808_045435_ooi_g_ls9.fits.fz
  c4d_170916_023220_ooi_r_ls9-N13 r expnum 677978 exptime 175.0 propid 2014B-0404 seeing 1.64 MJD 58012.106 object DECaLS_45748_r 
    decam/CP/V4.8.2a/CP20170915/c4d_170916_023220_ooi_r_ls9.fits.fz
  c4d_170718_103035_ooi_z_ls9-N13 z expnum 659732 exptime 250.0 propid 2014B-0404 seeing 1.51 MJD 57952.434 object DECaLS_45748_z 
    decam/CP/V4.8.2/CP20170717/c4d_170718_103035_ooi_z_ls9.fits.fz
  c4d_180909_035902_ooi_g_ls9-N8 g expnum 771068 exptime 77.0 propid 2014B-0404 seeing 1.12 MJD 58370.166 object DECaLS_29862_g 
    decam/CP/V4.8.2a/CP20180908/c4d_180909_035902_ooi_g_ls9.fits.fz
  c4d_180903_015128_ooi_r_ls9-N8 r expnum 768272 exptime 58.0 propid 2014B-0404 seeing 1.16 MJD 58364.077 object DECaLS_29862_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_015128_ooi_r_ls9.fits.fz
  c4d_160811_044937_ooi_z_ls9-N8 z expnum 562795 exptime 80.0 propid 2014B-0404 seeing 1.26 MJD 57611.200 object DECaLS_29862_z 
    decam/CP/V4.8.2a/CP20160810/c4d_160811_044937_ooi_z_ls9.fits.fz
  c4d_180905_041214_ooi_g_ls9-S17 g expnum 769079 exptime 56.0 propid 2014B-0404 seeing 1.09 MJD 58366.175 object DECaLS_56572_g 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_041214_ooi_g_ls9.fits.fz
  c4d_180905_070701_ooi_r_ls9-S17 r expnum 769187 exptime 40.0 propid 2014B-0404 seeing 1.04 MJD 58366.297 object DECaLS_56572_r 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_070701_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e95c-r-20180905T070701_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T015128_oi[N8,noinherit][2046,4094][real]: DECaLS_29862
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953495f-g-20180905T041214_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T045435_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170718T102533_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T023220_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T031332_oi[N9,noinherit][2046,4094][real]: DECaLS_13990
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160811T044727_oi[N8,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T031440_oi[N9,noinherit][2046,4094][real]: DECaLS_13990
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
WARNING: image median 0.016905285 is more than 1 sigma away from zero!
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95362bd-g-20180909T035902_oi[N8,noinherit][2046,4094][real]: DECaLS_2
Warning: splinesky does not have sky-template version/run/scale values
WARNING: image median 0.00682933 is more than 1 sigma away from zero!
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 75.37 s, CPU: 2.00 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181464 MB
Stage tims finished: 2020-08-05T19:30:12.024121
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953495f-g-20180905T041214_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170718T102533_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e95c-r-20180905T070701_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T045435_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T015128_oi[N8,noinherit][2046,4094][real]: DECaLS_29862 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T031332_oi[N9,noinherit][2046,4094][real]: DECaLS_13990 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160811T044727_oi[N8,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T031440_oi[N9,noinherit][2046,4094][real]: DECaLS_13990 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95362bd-g-20180909T035902_oi[N8,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.816 s worker CPU, 265.891 s worker Wall, Wall: 75.372 s, Cores in use: 0.10, Total efficiency (on 32 cores): 0.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T023220_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:30:12.108054
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06842.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06969.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07098.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06970.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/reference-custom-343029m07619.fits
Stage refs : Wall: 8.79 s, CPU: 3.45 s, VmPeak: 1042 MB, VmSize: 1027 MB, VmRSS: 194 MB, VmData: 225 MB, maxrss: 0.19884 MB
Stage refs finished: 2020-08-05T19:30:20.902601
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.797 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:30:21.063433
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outlier-mask-custom-343029m07619.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-pre-custom-343029m07619.jpg
Image c4d_180905_041214_ooi_g_ls9-S17 g : masking 0 positive outlier pixels and 43118 negative outlier pixels
Image c4d_180903_031440_ooi_g_ls9-N9 g : masking 0 positive outlier pixels and 10253 negative outlier pixels
Image c4d_180909_035902_ooi_g_ls9-N8 g : masking 54792 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_031332_ooi_r_ls9-N9 r : masking 0 positive outlier pixels and 630 negative outlier pixels
Image c4d_170916_023220_ooi_r_ls9-N13 r : masking 498 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_015128_ooi_r_ls9-N8 r : masking 53107 positive outlier pixels and 0 negative outlier pixels
Image c4d_180905_070701_ooi_r_ls9-S17 r : masking 0 positive outlier pixels and 12361 negative outlier pixels
Image c4d_160811_044937_ooi_z_ls9-N8 z : masking 695 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outlier-mask-custom-343029m07619.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-post-custom-343029m07619.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-masked-pos-custom-343029m07619.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/outliers-masked-neg-custom-343029m07619.jpg
Stage outliers : Wall: 1.70 s, CPU: 0.64 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.21346 MB
Stage outliers finished: 2020-08-05T19:30:22.768191
Resources for stage outliers : 2.670 s worker CPU, 3.345 s worker Wall, Wall: 1.707 s, Cores in use: 1.94, Total efficiency (on 32 cores): 6.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:30:22.795393
Stage halos : Wall: 0.75 s, CPU: 0.48 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.213868 MB
Stage halos finished: 2020-08-05T19:30:23.549955
Resources for stage halos : 0.274 s worker CPU, 1.046 s worker Wall, Wall: 0.757 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:30:23.576363
PSF sigmas in coadd pixels: ['1.80', '3.18', '1.81', '1.78']
Using average PSF sigma 2.1407018291365527
Gaussian PSF norm 0.1317767789676998 vs pixelized 0.09997316
average tim pixel scale / coadd scale: 1.0010803933477541
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.65', '2.66', '1.88', '1.69']
Using average PSF sigma 1.9704775142059394
Gaussian PSF norm 0.1431606246405488 vs pixelized 0.111851655
average tim pixel scale / coadd scale: 1.001136779242181
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.45', '2.05']
Using average PSF sigma 2.247539086128704
Gaussian PSF norm 0.12551274125326786 vs pixelized 0.09704996
average tim pixel scale / coadd scale: 1.001124507312144
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.70 s, CPU: 0.15 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.215468 MB
Stage fit_on_coadds finished: 2020-08-05T19:30:24.279582
Resources for stage fit_on_coadds : 1.695 s worker CPU, 1.695 s worker Wall, Wall: 0.705 s, Cores in use: 2.62, Total efficiency (on 32 cores): 8.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:30:24.295019
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 49 potential peaks
Of 49 potential peaks: 27 in veto map, 4 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 54 potential peaks
Of 54 potential peaks: 46 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 39 potential peaks
Of 39 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 59 potential peaks
Of 59 potential peaks: 51 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 74 potential peaks
Of 74 potential peaks: 68 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 23 new sources
Median coadd sky for g : 0.00027897063
Median coadd sky for r : 0.0007294211
Median coadd sky for z : 0.0021358537
Stage srcs : Wall: 0.96 s, CPU: 0.92 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.215816 MB
Stage srcs finished: 2020-08-05T19:30:25.259336
Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.966 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:30:25.272473
Blob 1 of 9, id: 1, sources: 15, size: 152x239, npix 25821, brick X: 37,189, Y: 0,239, one pixel: 129 0
Blob 2 of 9, id: 5, sources: 2, size: 60x58, npix 2038, brick X: 179,239, Y: 159,217, one pixel: 213 159
Blob 3 of 9, id: 0, sources: 1, size: 52x40, npix 1410, brick X: 0,52, Y: 0,40, one pixel: 17 0
Blob 4 of 9, id: 3, sources: 1, size: 43x38, npix 879, brick X: 9,52, Y: 95,133, one pixel: 25 95
Blob 5 of 9, id: 4, sources: 1, size: 31x29, npix 564, brick X: 202,233, Y: 119,148, one pixel: 217 119
Blob 6 of 9, id: 2, sources: 1, size: 19x30, npix 415, brick X: 220,239, Y: 56,86, one pixel: 231 56
Blob 7 of 9, id: 7, sources: 1, size: 28x21, npix 391, brick X: 168,196, Y: 218,239, one pixel: 183 218
Blob 8 of 9, id: 6, sources: 1, size: 20x24, npix 305, brick X: 0,20, Y: 197,221, one pixel: 6 197
Blob 9 of 9, id: 8, sources: 1, size: 22x18, npix 250, brick X: 214,236, Y: 221,239, one pixel: 223 221
Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 88 MB, VmData: 140 MB, maxrss: 0.090508 MB
Blob 4 finished, total: Wall: 0.38 s, CPU: 0.37 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097372 MB
Blob 8 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 109 MB, VmData: 165 MB, maxrss: 0.1114 MB
Blob 3 finished, total: Wall: 0.87 s, CPU: 0.86 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.114132 MB
Blob 5 finished, total: Wall: 0.89 s, CPU: 0.88 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114356 MB
Blob 7 finished, total: Wall: 1.07 s, CPU: 1.06 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09344 MB
Blob 6 finished, total: Wall: 1.57 s, CPU: 1.56 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148912 MB
Blob 2 finished, total: Wall: 2.60 s, CPU: 2.59 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148964 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.51393, ee1=0.162596, ee2=0.0334424
Blob 1 finished, total: Wall: 15.03 s, CPU: 15.03 s, VmPeak: 696 MB, VmSize: 687 MB, VmRSS: 119 MB, VmData: 158 MB, maxrss: 0.129676 MB
Old catalog: 26
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/blobs-custom-343029m07619.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/metrics/cus/all-models-custom-343029m07619.fits
Stage fitblobs : Wall: 16.00 s, CPU: 0.90 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.216732 MB
Stage fitblobs finished: 2020-08-05T19:30:41.270232
Resources for stage fitblobs : 22.926 s worker CPU, 23.118 s worker Wall, Wall: 16.000 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:30:41.298183
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-resid.jpg
Stage coadds : Wall: 4.44 s, CPU: 1.19 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.217248 MB
Stage coadds finished: 2020-08-05T19:30:45.738501
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 27.831 s worker CPU, 52.571 s worker Wall, Wall: 4.442 s, Cores in use: 6.53, Total efficiency (on 32 cores): 20.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:30:45.764292
Cut to 1 unWISE tiles
Reading WISE tile 3432m076 band 4
Reading WISE tile 3432m076 band 1
Reading WISE tile 3432m076 band 3
Reading WISE tile 3432m076 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20668 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 906 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.20326 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 175 MB, maxrss: 0.182492 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 140 MB, VmData: 172 MB, maxrss: 0.200768 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.01 s, CPU: 2.40 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.217888 MB
Stage wise_forced finished: 2020-08-05T19:30:51.770405
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.166 s worker CPU, 7.268 s worker Wall, Wall: 6.009 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T19:30:51.843814
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/tractor-i/cus/tractor-custom-343029m07619.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/tractor/cus/tractor-custom-343029m07619.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/tractor/cus/brick-custom-343029m07619.sha256sum
Stage writecat : Wall: 4.02 s, CPU: 2.67 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 215 MB, VmData: 238 MB, maxrss: 0.350924 MB
Stage writecat finished: 2020-08-05T19:30:55.867984
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.026 s, Cores in use: 0.66, Total efficiency (on 32 cores): 2.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/343/PGC1015891/PGC1015891-largegalaxy-writecat.p
All done: 64.464 s worker CPU, 355.022 s worker Wall, Wall: 119.296 s, Cores in use: 0.67, Total efficiency (on 32 cores): 2.1 %
Finished galaxy PGC1015891 in 2.060 minutes.
Started working on galaxy PGC1015891 at Mon Aug 10 07:44:12 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.02973979422177 -7.619524606162177 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T07:44:13.212617
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.02973979422177', '-7.619524606162177', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.02973979422177 -7.619524606162177 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 343.02973979422177 -7.619524606162177
Starting process 1270 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 1271 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 1272 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 1273 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 1274 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 1275 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 1276 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 1277 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T07:44:13.632633
Keeping 10 CCDs:
  c4d_180903_031332_ooi_r_ls9-N9 r expnum 768310 exptime 40.0 propid 2014B-0404 seeing 1.01 MJD 58364.134 object DECaLS_13990_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_031332_ooi_r_ls9.fits.fz
  c4d_180903_031440_ooi_g_ls9-N9 g expnum 768311 exptime 78.0 propid 2014B-0404 seeing 1.11 MJD 58364.135 object DECaLS_13990_g 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_031440_ooi_g_ls9.fits.fz
  c4d_180808_045435_ooi_g_ls9-N13 g expnum 762878 exptime 200.0 propid 2014B-0404 seeing 1.96 MJD 58338.205 object DECaLS_45748_g 
    decam/CP/V4.8.2a/CP20180807/c4d_180808_045435_ooi_g_ls9.fits.fz
  c4d_170916_023220_ooi_r_ls9-N13 r expnum 677978 exptime 175.0 propid 2014B-0404 seeing 1.64 MJD 58012.106 object DECaLS_45748_r 
    decam/CP/V4.8.2a/CP20170915/c4d_170916_023220_ooi_r_ls9.fits.fz
  c4d_170718_103035_ooi_z_ls9-N13 z expnum 659732 exptime 250.0 propid 2014B-0404 seeing 1.51 MJD 57952.434 object DECaLS_45748_z 
    decam/CP/V4.8.2/CP20170717/c4d_170718_103035_ooi_z_ls9.fits.fz
  c4d_180909_035902_ooi_g_ls9-N8 g expnum 771068 exptime 77.0 propid 2014B-0404 seeing 1.12 MJD 58370.166 object DECaLS_29862_g 
    decam/CP/V4.8.2a/CP20180908/c4d_180909_035902_ooi_g_ls9.fits.fz
  c4d_180903_015128_ooi_r_ls9-N8 r expnum 768272 exptime 58.0 propid 2014B-0404 seeing 1.16 MJD 58364.077 object DECaLS_29862_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_015128_ooi_r_ls9.fits.fz
  c4d_160811_044937_ooi_z_ls9-N8 z expnum 562795 exptime 80.0 propid 2014B-0404 seeing 1.26 MJD 57611.200 object DECaLS_29862_z 
    decam/CP/V4.8.2a/CP20160810/c4d_160811_044937_ooi_z_ls9.fits.fz
  c4d_180905_041214_ooi_g_ls9-S17 g expnum 769079 exptime 56.0 propid 2014B-0404 seeing 1.09 MJD 58366.175 object DECaLS_56572_g 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_041214_ooi_g_ls9.fits.fz
  c4d_180905_070701_ooi_r_ls9-S17 r expnum 769187 exptime 40.0 propid 2014B-0404 seeing 1.04 MJD 58366.297 object DECaLS_56572_r 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_070701_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170718T102533_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T031332_oi[N9,noinherit][2046,4094][real]: DECaLS_13990
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160811T044727_oi[N8,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T045435_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T015128_oi[N8,noinherit][2046,4094][real]: DECaLS_29862
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T023220_oi[N13,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T031440_oi[N9,noinherit][2046,4094][real]: DECaLS_13990
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953495f-g-20180905T041214_oi[S17,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e95c-r-20180905T070701_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95362bd-g-20180909T035902_oi[N8,noinherit][2046,4094][real]: DECaLS_2
Stage tims : Wall: 107.58 s, CPU: 0.85 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.17966 MB
Stage tims finished: 2020-08-10T07:46:01.209634
Warning: splinesky does not have sky-template version/run/scale values
WARNING: image median 0.016896758 is more than 1 sigma away from zero!
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T015128_oi[N8,noinherit][2046,4094][real]: DECaLS_29862 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T031332_oi[N9,noinherit][2046,4094][real]: DECaLS_13990 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T023220_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b0ee-z-20160811T044727_oi[N8,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953138d-g-20180808T045435_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: image median 0.0068151057 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9518ea9-z-20170718T102533_oi[N13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953495f-g-20180905T041214_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95362bd-g-20180909T035902_oi[N8,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Resources for stage tims : 5.549 s worker CPU, 440.277 s worker Wall, Wall: 107.578 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-10T07:46:01.343282
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06842.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06969.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07098.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06970.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/reference-custom-343029m07619.fits
Stage refs : Wall: 12.63 s, CPU: 1.90 s, VmPeak: 1035 MB, VmSize: 1021 MB, VmRSS: 192 MB, VmData: 225 MB, maxrss: 0.19694 MB
Stage refs finished: 2020-08-10T07:46:13.978292
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T031440_oi[N9,noinherit][2046,4094][real]: DECaLS_13990 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e95c-r-20180905T070701_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.636 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T07:46:14.001676
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/outlier-mask-custom-343029m07619.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/outliers-pre-custom-343029m07619.jpg
Image c4d_180909_035902_ooi_g_ls9-N8 g : masking 54655 positive outlier pixels and 0 negative outlier pixels
Image c4d_180905_041214_ooi_g_ls9-S17 g : masking 0 positive outlier pixels and 42551 negative outlier pixels
Image c4d_180903_031440_ooi_g_ls9-N9 g : masking 0 positive outlier pixels and 10594 negative outlier pixels
Image c4d_180903_031332_ooi_r_ls9-N9 r : masking 0 positive outlier pixels and 874 negative outlier pixels
Image c4d_170916_023220_ooi_r_ls9-N13 r : masking 569 positive outlier pixels and 0 negative outlier pixels
Image c4d_180905_070701_ooi_r_ls9-S17 r : masking 78 positive outlier pixels and 11795 negative outlier pixels
Image c4d_180903_015128_ooi_r_ls9-N8 r : masking 53131 positive outlier pixels and 0 negative outlier pixels
Image c4d_170718_103035_ooi_z_ls9-N13 z : masking 87 positive outlier pixels and 0 negative outlier pixels
Image c4d_160811_044937_ooi_z_ls9-N8 z : masking 814 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/outlier-mask-custom-343029m07619.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/outliers-post-custom-343029m07619.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/outliers-masked-pos-custom-343029m07619.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/outliers-masked-neg-custom-343029m07619.jpg
Stage outliers : Wall: 1.70 s, CPU: 0.83 s, VmPeak: 1035 MB, VmSize: 1030 MB, VmRSS: 206 MB, VmData: 235 MB, maxrss: 0.210672 MB
Stage outliers finished: 2020-08-10T07:46:15.702106
Resources for stage outliers : 2.385 s worker CPU, 2.387 s worker Wall, Wall: 1.701 s, Cores in use: 1.89, Total efficiency (on 8 cores): 23.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T07:46:15.848219
Stage halos : Wall: 0.88 s, CPU: 0.37 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.211124 MB
Stage halos finished: 2020-08-10T07:46:16.731736
Resources for stage halos : 0.115 s worker CPU, 0.963 s worker Wall, Wall: 0.885 s, Cores in use: 0.55, Total efficiency (on 8 cores): 6.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T07:46:16.887657
PSF sigmas in coadd pixels: ['1.80', '3.18', '1.81', '1.78']
Using average PSF sigma 2.1407018291365527
Gaussian PSF norm 0.1317767789676998 vs pixelized 0.09997027
average tim pixel scale / coadd scale: 1.0010803933477541
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.65', '2.66', '1.88', '1.69']
Using average PSF sigma 1.9704775142059394
Gaussian PSF norm 0.1431606246405488 vs pixelized 0.11185086
average tim pixel scale / coadd scale: 1.001136779242181
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.45', '2.05']
Using average PSF sigma 2.247539086128704
Gaussian PSF norm 0.12551274125326786 vs pixelized 0.09704892
average tim pixel scale / coadd scale: 1.001124507312144
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 1.09 s, CPU: 0.17 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.21272 MB
Stage fit_on_coadds finished: 2020-08-10T07:46:17.973723
Resources for stage fit_on_coadds : 1.992 s worker CPU, 1.997 s worker Wall, Wall: 1.087 s, Cores in use: 1.98, Total efficiency (on 8 cores): 24.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T07:46:18.003636
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 49 potential peaks
Of 49 potential peaks: 27 in veto map, 4 cut by saddle test, 0 cut by aper test, 18 kept
SED z : 18 new peaks
Found 54 potential peaks
Of 54 potential peaks: 46 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 37 potential peaks
Of 37 potential peaks: 31 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 63 potential peaks
Of 63 potential peaks: 55 in veto map, 7 cut by saddle test, 1 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 78 potential peaks
Of 78 potential peaks: 71 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 24 new sources
Median coadd sky for g : 0.00025080808
Median coadd sky for r : 0.0006798459
Median coadd sky for z : 0.0020315733
Stage srcs : Wall: 0.58 s, CPU: 0.53 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.213116 MB
Stage srcs finished: 2020-08-10T07:46:18.579268
Resources for stage srcs : 0.091 s worker CPU, 0.091 s worker Wall, Wall: 0.577 s, Cores in use: 1.09, Total efficiency (on 8 cores): 13.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T07:46:18.589073
Blob 1 of 9, id: 2, sources: 15, size: 151x239, npix 25991, brick X: 37,188, Y: 0,239, one pixel: 101 0
Blob 2 of 9, id: 6, sources: 2, size: 61x58, npix 2033, brick X: 178,239, Y: 165,223, one pixel: 210 165
Blob 3 of 9, id: 0, sources: 2, size: 52x46, npix 1567, brick X: 0,52, Y: 0,46, one pixel: 30 0
Blob 4 of 9, id: 4, sources: 1, size: 42x39, npix 878, brick X: 9,51, Y: 100,139, one pixel: 24 100
Blob 5 of 9, id: 5, sources: 1, size: 30x29, npix 570, brick X: 202,232, Y: 125,154, one pixel: 216 125
Blob 6 of 9, id: 1, sources: 1, size: 35x17, npix 451, brick X: 49,84, Y: 0,17, one pixel: 52 0
Blob 7 of 9, id: 3, sources: 1, size: 20x30, npix 418, brick X: 219,239, Y: 61,91, one pixel: 232 61
Blob 8 of 9, id: 7, sources: 1, size: 19x24, npix 292, brick X: 0,19, Y: 203,227, one pixel: 6 203
Blob 9 of 9, id: 8, sources: 1, size: 21x15, npix 199, brick X: 172,193, Y: 224,239, one pixel: 182 224
Blob 8 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145412 MB
Blob 4 finished, total: Wall: 0.45 s, CPU: 0.44 s, VmPeak: 958 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144508 MB
Blob 6 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14522 MB
Blob 5 finished, total: Wall: 1.11 s, CPU: 1.10 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.14366 MB
Blob 3 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144716 MB
Blob 9 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145412 MB
Blob 7 finished, total: Wall: 1.60 s, CPU: 1.60 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145536 MB
Blob 2 finished, total: Wall: 2.60 s, CPU: 2.59 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146144 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.25573, ee1=0.136214, ee2=0.0313401
Blob 1 finished, total: Wall: 16.15 s, CPU: 16.15 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 151 MB, VmData: 181 MB, maxrss: 0.154408 MB
Old catalog: 27
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/blobs-custom-343029m07619.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/metrics/cus/all-models-custom-343029m07619.fits
Stage fitblobs : Wall: 16.46 s, CPU: 0.27 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.213988 MB
Stage fitblobs finished: 2020-08-10T07:46:35.054060
Resources for stage fitblobs : 25.364 s worker CPU, 25.395 s worker Wall, Wall: 16.466 s, Cores in use: 1.56, Total efficiency (on 8 cores): 19.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T07:46:35.068703
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-resid.jpg
Stage coadds : Wall: 1.33 s, CPU: 0.55 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.2145 MB
Stage coadds finished: 2020-08-10T07:46:36.403544
Resources for stage coadds : 4.075 s worker CPU, 4.596 s worker Wall, Wall: 1.336 s, Cores in use: 3.46, Total efficiency (on 8 cores): 43.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T07:46:36.416291
Cut to 1 unWISE tiles
Reading WISE tile 3432m076 band 2
Reading WISE tile 3432m076 band 1
Reading WISE tile 3432m076 band 4
Reading WISE tile 3432m076 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.1942 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 953 MB, VmSize: 803 MB, VmRSS: 151 MB, VmData: 174 MB, maxrss: 0.215332 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208028 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3432m076/unwise-3432m076-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 958 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209328 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/tmp-legacysurvey-custom-343029m07619-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.99 s, CPU: 0.48 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.215208 MB
Stage wise_forced finished: 2020-08-10T07:46:38.411160
Resources for stage wise_forced : 3.446 s worker CPU, 4.618 s worker Wall, Wall: 1.996 s, Cores in use: 1.97, Total efficiency (on 8 cores): 24.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T07:46:40.181427
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/coadd/cus/custom-343029m07619/legacysurvey-custom-343029m07619-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/tractor-i/cus/tractor-custom-343029m07619.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/tractor/cus/tractor-custom-343029m07619.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/tractor/cus/brick-custom-343029m07619.sha256sum
Stage writecat : Wall: 0.61 s, CPU: 0.47 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 212 MB, VmData: 237 MB, maxrss: 0.347996 MB
Stage writecat finished: 2020-08-10T07:46:40.787398
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.607 s, Cores in use: 0.78, Total efficiency (on 8 cores): 9.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1015891/PGC1015891-largegalaxy-writecat.p
All done: 43.020 s worker CPU, 480.326 s worker Wall, Wall: 147.170 s, Cores in use: 0.34, Total efficiency (on 8 cores): 4.2 %
Finished galaxy PGC1015891 in 2.480 minutes.