Started working on galaxy PGC212879 at Wed Aug  5 21:26:08 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.455350000000003 33.409698 --width 319 --height 319 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:26:09.423325
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.455350000000003', '33.409698', '--width', '319', '--height', '319', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.455350000000003 33.409698 --width 319 --height 319 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.455350000000003 33.409698
Starting process 47128 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 47129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 47130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 47131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 47132 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB
Starting process 47133 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 47134 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 47135 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 47136 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 47137 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47138 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 47139 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 47140 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 47141 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 47142 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 47143 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:26:10.805325
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_181110_030041_ooi_r_ls9-S24 r expnum 792793 exptime 67.0 propid 2014B-0404 seeing 1.85 MJD 58432.125 object DECaLS_20806_r 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_030041_ooi_r_ls9.fits.fz
  c4d_181104_041106_ooi_g_ls9-S24 g expnum 790572 exptime 193.0 propid 2014B-0404 seeing 1.61 MJD 58426.174 object DECaLS_20806_g 
    decam/CP/V4.8.2a/CP20181103/c4d_181104_041106_ooi_g_ls9.fits.fz
  c4d_181105_043024_ooi_z_ls9-S23 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.89 MJD 58427.188 object DECaLS_36678_z 
    decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz
  c4d_181110_030217_ooi_g_ls9-S23 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 2.07 MJD 58432.127 object DECaLS_36678_g 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz
  c4d_181104_041447_ooi_r_ls9-S23 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.25 MJD 58426.177 object DECaLS_36678_r 
    decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz
  c4d_181103_041850_ooi_g_ls9-S20 g expnum 790269 exptime 184.0 propid 2014B-0404 seeing 1.63 MJD 58425.180 object DECaLS_4955_g 
    decam/CP/V4.8.2a/CP20181102/c4d_181103_041850_ooi_g_ls9.fits.fz
  c4d_181002_060032_ooi_z_ls9-S20 z expnum 779932 exptime 96.0 propid 2014B-0404 seeing 1.12 MJD 58393.250 object DECaLS_4955_z 
    decam/CP/V4.8.2a/CP20181001/c4d_181002_060032_ooi_z_ls9.fits.fz
  c4d_181110_030606_ooi_r_ls9-S20 r expnum 792795 exptime 78.0 propid 2014B-0404 seeing 1.63 MJD 58432.129 object DECaLS_4955_r 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_030606_ooi_r_ls9.fits.fz
  c4d_181002_060244_ooi_z_ls9-S24 z expnum 779933 exptime 106.0 propid 2014B-0404 seeing 1.09 MJD 58393.252 object DECaLS_20806_z 
    decam/CP/V4.8.2a/CP20181001/c4d_181002_060244_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030041_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T041106_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060032_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T041850_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T041447_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030606_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T030217_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060244_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181105T043024_oi[S23,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 25.83 s, CPU: 2.15 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 178 MB, VmData: 211 MB, maxrss: 0.182648 MB
Stage tims finished: 2020-08-05T21:26:36.636227
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060032_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030041_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T041447_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T030217_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060244_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181105T043024_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 4.922 s worker CPU, 192.659 s worker Wall, Wall: 25.832 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T041106_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T041850_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030606_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:26:41.148634
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02635.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02634.fits
Matched 11 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/reference-custom-029455p33409.fits
Stage refs : Wall: 7.78 s, CPU: 3.92 s, VmPeak: 1045 MB, VmSize: 1040 MB, VmRSS: 208 MB, VmData: 239 MB, maxrss: 0.213136 MB
Stage refs finished: 2020-08-05T21:26:48.930149
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.783 s, Cores in use: 0.50, Total efficiency (on 16 cores): 3.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:26:49.094084
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/outlier-mask-custom-029455p33409.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/outliers-pre-custom-029455p33409.jpg
Image c4d_181103_041850_ooi_g_ls9-S20 g : masking 302 positive outlier pixels and 0 negative outlier pixels
Image c4d_181104_041106_ooi_g_ls9-S24 g : masking 649 positive outlier pixels and 0 negative outlier pixels
Image c4d_181105_043024_ooi_z_ls9-S23 z : masking 1624 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/outlier-mask-custom-029455p33409.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/outliers-post-custom-029455p33409.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/outliers-masked-pos-custom-029455p33409.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/outliers-masked-neg-custom-029455p33409.jpg
Stage outliers : Wall: 2.48 s, CPU: 1.41 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 226 MB, VmData: 254 MB, maxrss: 0.23112 MB
Stage outliers finished: 2020-08-05T21:26:51.574040
Resources for stage outliers : 0.806 s worker CPU, 0.985 s worker Wall, Wall: 2.481 s, Cores in use: 0.89, Total efficiency (on 16 cores): 5.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:26:51.601408
Stage halos : Wall: 2.39 s, CPU: 1.75 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 226 MB, VmData: 254 MB, maxrss: 0.231548 MB
Stage halos finished: 2020-08-05T21:26:53.996333
Resources for stage halos : 0.529 s worker CPU, 1.846 s worker Wall, Wall: 2.396 s, Cores in use: 0.95, Total efficiency (on 16 cores): 6.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T21:26:54.140885
PSF sigmas in coadd pixels: ['2.61', '3.36', '2.65']
Using average PSF sigma 2.8711246037296276
Gaussian PSF norm 0.09825236822095196 vs pixelized 0.09098219
average tim pixel scale / coadd scale: 1.0014515754923168
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['3.00', '2.04', '2.64']
Using average PSF sigma 2.5607432748523817
Gaussian PSF norm 0.11016129361508917 vs pixelized 0.098401345
average tim pixel scale / coadd scale: 1.0014619062412957
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.45', '1.82', '1.77']
Using average PSF sigma 1.679719491877636
Gaussian PSF norm 0.16794160759457816 vs pixelized 0.14114939
average tim pixel scale / coadd scale: 1.0014528418421915
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 228 MB, VmData: 254 MB, maxrss: 0.233144 MB
Stage fit_on_coadds finished: 2020-08-05T21:26:54.342237
Resources for stage fit_on_coadds : 0.179 s worker CPU, 0.179 s worker Wall, Wall: 0.203 s, Cores in use: 1.76, Total efficiency (on 16 cores): 11.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:26:54.356585
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 35 potential peaks
Of 35 potential peaks: 5 in veto map, 3 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 28 potential peaks
Of 28 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 24 potential peaks
Of 24 potential peaks: 21 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 41 potential peaks
Of 41 potential peaks: 30 in veto map, 5 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 41 potential peaks
Of 41 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 38 new sources
Median coadd sky for g : 1.6465052e-05
Median coadd sky for r : -3.107299e-05
Median coadd sky for z : 0.0003647054
Stage srcs : Wall: 1.33 s, CPU: 1.28 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 228 MB, VmData: 254 MB, maxrss: 0.233676 MB
Stage srcs finished: 2020-08-05T21:26:55.688673
Resources for stage srcs : 0.133 s worker CPU, 0.133 s worker Wall, Wall: 1.333 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:26:55.827064
Blob 1 of 31, id: 10, sources: 6, size: 153x118, npix 10411, brick X: 53,206, Y: 105,223, one pixel: 131 105
Blob 2 of 31, id: 29, sources: 2, size: 79x40, npix 2279, brick X: 129,208, Y: 279,319, one pixel: 185 279
Blob 3 of 31, id: 27, sources: 4, size: 83x52, npix 1972, brick X: 229,312, Y: 267,319, one pixel: 273 267
Blob 4 of 31, id: 26, sources: 1, size: 53x53, npix 1711, brick X: 58,111, Y: 263,316, one pixel: 72 263
Blob 5 of 31, id: 9, sources: 3, size: 48x52, npix 1431, brick X: 53,101, Y: 80,132, one pixel: 91 80
Blob 6 of 31, id: 15, sources: 2, size: 48x35, npix 1001, brick X: 244,292, Y: 191,226, one pixel: 253 191
Blob 7 of 31, id: 11, sources: 2, size: 35x40, npix 784, brick X: 210,245, Y: 144,184, one pixel: 235 144
Blob 8 of 31, id: 3, sources: 1, size: 33x34, npix 697, brick X: 54,87, Y: 33,67, one pixel: 71 33
Blob 9 of 31, id: 21, sources: 1, size: 30x31, npix 620, brick X: 170,200, Y: 225,256, one pixel: 184 225
Blob 10 of 31, id: 6, sources: 1, size: 28x28, npix 525, brick X: 158,186, Y: 58,86, one pixel: 171 58
Blob 11 of 31, id: 24, sources: 1, size: 29x28, npix 515, brick X: 122,151, Y: 259,287, one pixel: 134 259
Blob 12 of 31, id: 18, sources: 1, size: 28x28, npix 508, brick X: 220,248, Y: 213,241, one pixel: 234 213
Blob 13 of 31, id: 0, sources: 3, size: 20x33, npix 470, brick X: 0,20, Y: 0,33, one pixel: 1 0
Blob 14 of 31, id: 5, sources: 1, size: 25x24, npix 377, brick X: 213,238, Y: 42,66, one pixel: 223 42
Blob 15 of 31, id: 22, sources: 1, size: 25x24, npix 366, brick X: 196,221, Y: 241,265, one pixel: 206 241
Blob 16 of 31, id: 8, sources: 1, size: 24x24, npix 355, brick X: 100,124, Y: 64,88, one pixel: 110 64
Blob 17 of 31, id: 12, sources: 1, size: 24x22, npix 327, brick X: 258,282, Y: 146,168, one pixel: 268 146
Blob 15 finished, total: Wall: 0.43 s, CPU: 0.32 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114364 MB
Blob 18 of 31, id: 20, sources: 1, size: 16x27, npix 315, brick X: 0,16, Y: 223,250, one pixel: 3 223
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.47145, 33.39940), pm (6.0, -7.3), parallax 1.430 with NanoMaggies: g=13, r=12.7, z=12.7
Reset brightness to NanoMaggies: g=13.4, r=13.1, z=13
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.49088, 33.39854), pm (5.9, -6.7), parallax 1.153 with NanoMaggies: g=13.9, r=13.5, z=13.3
Reset brightness to NanoMaggies: g=13.9, r=13.5, z=13.3
Blob 13 finished, total: Wall: 0.47 s, CPU: 0.36 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148664 MB
Blob 19 of 31, id: 25, sources: 1, size: 16x26, npix 302, brick X: 303,319, Y: 259,285, one pixel: 312 259
Blob 16 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.156184 MB
Blob 20 of 31, id: 2, sources: 1, size: 25x16, npix 278, brick X: 245,270, Y: 0,16, one pixel: 248 0
Blob 10 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150512 MB
Blob 21 of 31, id: 17, sources: 1, size: 20x19, npix 236, brick X: 9,29, Y: 213,232, one pixel: 17 213
Blob 17 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114592 MB
Blob 22 of 31, id: 13, sources: 1, size: 19x20, npix 227, brick X: 36,55, Y: 168,188, one pixel: 44 168
Blob 12 finished, total: Wall: 0.89 s, CPU: 0.79 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100296 MB
Blob 23 of 31, id: 16, sources: 1, size: 19x19, npix 217, brick X: 180,199, Y: 196,215, one pixel: 188 196
Blob 14 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.15598 MB
Blob 24 of 31, id: 19, sources: 1, size: 19x20, npix 209, brick X: 143,162, Y: 221,241, one pixel: 151 221
Blob 21 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114592 MB
Blob 25 of 31, id: 1, sources: 1, size: 20x15, npix 203, brick X: 91,111, Y: 0,15, one pixel: 95 0
Blob 22 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10044 MB
Blob 26 of 31, id: 14, sources: 1, size: 19x18, npix 198, brick X: 219,238, Y: 191,209, one pixel: 227 191
Blob 11 finished, total: Wall: 1.25 s, CPU: 1.14 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.115056 MB
Blob 27 of 31, id: 23, sources: 1, size: 18x19, npix 198, brick X: 167,185, Y: 254,273, one pixel: 175 254
Measuring 2 iterative sources
Blob 26 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.11524 MB
Blob 28 of 31, id: 30, sources: 1, size: 19x18, npix 189, brick X: 6,25, Y: 301,319, one pixel: 14 301
Blob 7 finished, total: Wall: 1.42 s, CPU: 1.34 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149384 MB
Blob 29 of 31, id: 4, sources: 1, size: 18x18, npix 180, brick X: 123,141, Y: 33,51, one pixel: 131 33
Blob 23 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.156828 MB
Blob 30 of 31, id: 7, sources: 1, size: 18x18, npix 180, brick X: 227,245, Y: 63,81, one pixel: 235 63
Blob 9 finished, total: Wall: 1.47 s, CPU: 1.37 s, VmPeak: 944 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.15202 MB
Blob 31 of 31, id: 28, sources: 1, size: 17x17, npix 145, brick X: 198,215, Y: 277,294, one pixel: 206 277
Blob 24 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114592 MB
Blob 25 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100508 MB
Blob 27 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.11524 MB
Blob 19 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.156912 MB
Blob 29 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 186 MB, maxrss: 0.156828 MB
Blob 28 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149704 MB
Blob 20 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150512 MB
Blob 31 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.1146 MB
Blob 30 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 944 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.15202 MB
Measuring 1 iterative sources
Blob 18 finished, total: Wall: 1.48 s, CPU: 1.47 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149692 MB
Blob 8 finished, total: Wall: 2.07 s, CPU: 1.93 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 114 MB, VmData: 166 MB, maxrss: 0.11626 MB
Blob 6 finished, total: Wall: 2.19 s, CPU: 2.08 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113864 MB
Blob 4 finished, total: Wall: 2.51 s, CPU: 2.43 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095716 MB
Blob 5 finished, total: Wall: 2.60 s, CPU: 2.47 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096316 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 3.63 s, CPU: 3.58 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151588 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 3.98 s, CPU: 3.82 s, VmPeak: 940 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151556 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.89164, ee1=0.079635, ee2=1.16492
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 8.94 s, CPU: 8.90 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 156 MB, VmData: 187 MB, maxrss: 0.159516 MB
Old catalog: 50
New catalog: 49
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/blobs-custom-029455p33409.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/metrics/cus/all-models-custom-029455p33409.fits
Stage fitblobs : Wall: 14.07 s, CPU: 2.81 s, VmPeak: 1049 MB, VmSize: 1049 MB, VmRSS: 229 MB, VmData: 254 MB, maxrss: 0.234096 MB
Stage fitblobs finished: 2020-08-05T21:27:09.896233
Resources for stage fitblobs : 40.816 s worker CPU, 48.627 s worker Wall, Wall: 14.071 s, Cores in use: 3.10, Total efficiency (on 16 cores): 19.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:27:10.088234
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/tmp-legacysurvey-custom-029455p33409-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/tmp-legacysurvey-custom-029455p33409-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/tmp-legacysurvey-custom-029455p33409-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/tmp-legacysurvey-custom-029455p33409-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-resid.jpg
Stage coadds : Wall: 4.48 s, CPU: 2.27 s, VmPeak: 1049 MB, VmSize: 1046 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.23444 MB
Stage coadds finished: 2020-08-05T21:27:14.571198
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 11.212 s worker CPU, 19.059 s worker Wall, Wall: 4.485 s, Cores in use: 3.01, Total efficiency (on 16 cores): 18.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T21:27:14.729193
Cut to 1 unWISE tiles
Reading WISE tile 0287p333 band 1
Reading WISE tile 0287p333 band 2
Reading WISE tile 0287p333 band 4
Reading WISE tile 0287p333 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 956 MB, VmSize: 814 MB, VmRSS: 155 MB, VmData: 179 MB, maxrss: 0.199868 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 944 MB, VmSize: 811 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.2136 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.21326 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 940 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.214572 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/tmp-legacysurvey-custom-029455p33409-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/tmp-legacysurvey-custom-029455p33409-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.96 s, CPU: 1.24 s, VmPeak: 1049 MB, VmSize: 1045 MB, VmRSS: 226 MB, VmData: 250 MB, maxrss: 0.23444 MB
Stage wise_forced finished: 2020-08-05T21:27:17.686015
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.239 s worker CPU, 5.347 s worker Wall, Wall: 2.958 s, Cores in use: 1.51, Total efficiency (on 16 cores): 9.5 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T21:27:17.795081
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/coadd/cus/custom-029455p33409/legacysurvey-custom-029455p33409-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/tractor-i/cus/tractor-custom-029455p33409.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/tractor/cus/tractor-custom-029455p33409.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/tractor/cus/brick-custom-029455p33409.sha256sum
Stage writecat : Wall: 3.38 s, CPU: 1.54 s, VmPeak: 1178 MB, VmSize: 1050 MB, VmRSS: 228 MB, VmData: 250 MB, maxrss: 0.364132 MB
Stage writecat finished: 2020-08-05T21:27:21.179038
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.386 s, Cores in use: 0.46, Total efficiency (on 16 cores): 2.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC212879/PGC212879-largegalaxy-writecat.p
All done: 61.839 s worker CPU, 268.838 s worker Wall, Wall: 70.400 s, Cores in use: 1.14, Total efficiency (on 16 cores): 7.2 %
Finished galaxy PGC212879 in 1.221 minutes.
Started working on galaxy PGC212879 at Fri Aug  7 09:58:38 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.455948518531176 33.41001786014995 --width 319 --height 319 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:58:38.983783
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.455948518531176', '33.41001786014995', '--width', '319', '--height', '319', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.455948518531176 33.41001786014995 --width 319 --height 319 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.455948518531176 33.41001786014995
Starting process 5353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 5354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 5355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 5356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 5357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 5358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 5359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 5360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 5361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 5362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 5363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 5364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 5365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 5366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5368 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:58:39.498279
Keeping 9 CCDs:
  c4d_181110_030041_ooi_r_ls9-S24 r expnum 792793 exptime 67.0 propid 2014B-0404 seeing 1.85 MJD 58432.125 object DECaLS_20806_r 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_030041_ooi_r_ls9.fits.fz
  c4d_181104_041106_ooi_g_ls9-S24 g expnum 790572 exptime 193.0 propid 2014B-0404 seeing 1.61 MJD 58426.174 object DECaLS_20806_g 
    decam/CP/V4.8.2a/CP20181103/c4d_181104_041106_ooi_g_ls9.fits.fz
  c4d_181105_043024_ooi_z_ls9-S23 z expnum 790926 exptime 106.0 propid 2014B-0404 seeing 0.89 MJD 58427.188 object DECaLS_36678_z 
    decam/CP/V4.8.2a/CP20181104/c4d_181105_043024_ooi_z_ls9.fits.fz
  c4d_181110_030217_ooi_g_ls9-S23 g expnum 792794 exptime 200.0 propid 2014B-0404 seeing 2.07 MJD 58432.127 object DECaLS_36678_g 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_030217_ooi_g_ls9.fits.fz
  c4d_181104_041447_ooi_r_ls9-S23 r expnum 790573 exptime 90.0 propid 2014B-0404 seeing 1.25 MJD 58426.177 object DECaLS_36678_r 
    decam/CP/V4.8.2a/CP20181103/c4d_181104_041447_ooi_r_ls9.fits.fz
  c4d_181103_041850_ooi_g_ls9-S20 g expnum 790269 exptime 184.0 propid 2014B-0404 seeing 1.63 MJD 58425.180 object DECaLS_4955_g 
    decam/CP/V4.8.2a/CP20181102/c4d_181103_041850_ooi_g_ls9.fits.fz
  c4d_181002_060032_ooi_z_ls9-S20 z expnum 779932 exptime 96.0 propid 2014B-0404 seeing 1.12 MJD 58393.250 object DECaLS_4955_z 
    decam/CP/V4.8.2a/CP20181001/c4d_181002_060032_ooi_z_ls9.fits.fz
  c4d_181110_030606_ooi_r_ls9-S20 r expnum 792795 exptime 78.0 propid 2014B-0404 seeing 1.63 MJD 58432.129 object DECaLS_4955_r 
    decam/CP/V4.8.2a/CP20181109/c4d_181110_030606_ooi_r_ls9.fits.fz
  c4d_181002_060244_ooi_z_ls9-S24 z expnum 779933 exptime 106.0 propid 2014B-0404 seeing 1.09 MJD 58393.252 object DECaLS_20806_z 
    decam/CP/V4.8.2a/CP20181001/c4d_181002_060244_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T041106_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181105T043024_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060032_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030041_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T030217_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T041447_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030606_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060244_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T041850_oi[S20,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 130.49 s, CPU: 0.94 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.1805 MB
Stage tims finished: 2020-08-07T10:00:49.986802
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T041106_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T041447_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T030217_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181105T043024_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060032_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060244_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T041850_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030041_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030606_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.571 s worker CPU, 1028.051 s worker Wall, Wall: 130.490 s, Cores in use: 0.04, Total efficiency (on 16 cores): 0.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-07T10:00:55.717838
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02635.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02634.fits
Matched 11 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/reference-custom-029455p33410.fits
Stage refs : Wall: 41.92 s, CPU: 2.80 s, VmPeak: 1038 MB, VmSize: 1033 MB, VmRSS: 206 MB, VmData: 239 MB, maxrss: 0.210852 MB
Stage refs finished: 2020-08-07T10:01:37.636511
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 41.921 s, Cores in use: 0.07, Total efficiency (on 16 cores): 0.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T10:01:37.816574
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/outlier-mask-custom-029455p33410.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/outliers-pre-custom-029455p33410.jpg
Image c4d_181103_041850_ooi_g_ls9-S20 g : masking 377 positive outlier pixels and 0 negative outlier pixels
Image c4d_181104_041106_ooi_g_ls9-S24 g : masking 654 positive outlier pixels and 0 negative outlier pixels
Image c4d_181105_043024_ooi_z_ls9-S23 z : masking 1642 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/outlier-mask-custom-029455p33410.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/outliers-post-custom-029455p33410.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/outliers-masked-pos-custom-029455p33410.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/outliers-masked-neg-custom-029455p33410.jpg
Stage outliers : Wall: 1.00 s, CPU: 0.66 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 224 MB, VmData: 253 MB, maxrss: 0.2294 MB
Stage outliers finished: 2020-08-07T10:01:38.816675
Resources for stage outliers : 0.790 s worker CPU, 0.929 s worker Wall, Wall: 1.001 s, Cores in use: 1.45, Total efficiency (on 16 cores): 9.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T10:01:38.954174
Stage halos : Wall: 0.59 s, CPU: 0.30 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 224 MB, VmData: 254 MB, maxrss: 0.229688 MB
Stage halos finished: 2020-08-07T10:01:39.543510
Resources for stage halos : 0.608 s worker CPU, 1.411 s worker Wall, Wall: 0.591 s, Cores in use: 1.54, Total efficiency (on 16 cores): 9.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-07T10:01:39.575481
PSF sigmas in coadd pixels: ['2.61', '3.36', '2.65']
Using average PSF sigma 2.8711246037296276
Gaussian PSF norm 0.09825236822095196 vs pixelized 0.09098185
average tim pixel scale / coadd scale: 1.0014515754923168
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['3.00', '2.04', '2.64']
Using average PSF sigma 2.5607432748523817
Gaussian PSF norm 0.11016129361508917 vs pixelized 0.09840104
average tim pixel scale / coadd scale: 1.0014619062412957
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.45', '1.82', '1.77']
Using average PSF sigma 1.679719491877636
Gaussian PSF norm 0.16794160759457816 vs pixelized 0.14114684
average tim pixel scale / coadd scale: 1.0014528418421915
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.16 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 226 MB, VmData: 254 MB, maxrss: 0.231288 MB
Stage fit_on_coadds finished: 2020-08-07T10:01:39.751978
Resources for stage fit_on_coadds : 0.193 s worker CPU, 0.193 s worker Wall, Wall: 0.178 s, Cores in use: 2.01, Total efficiency (on 16 cores): 12.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T10:01:39.762429
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 33 potential peaks
Of 33 potential peaks: 6 in veto map, 3 cut by saddle test, 0 cut by aper test, 24 kept
SED z : 24 new peaks
Found 27 potential peaks
Of 27 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 23 potential peaks
Of 23 potential peaks: 21 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 39 potential peaks
Of 39 potential peaks: 28 in veto map, 5 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 37 potential peaks
Of 37 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept
SED Red : 4 new peaks
Adding 34 new sources
Median coadd sky for g : 7.2473013e-06
Median coadd sky for r : -2.769254e-05
Median coadd sky for z : 0.00038505063
Stage srcs : Wall: 0.60 s, CPU: 0.54 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 226 MB, VmData: 254 MB, maxrss: 0.23182 MB
Stage srcs finished: 2020-08-07T10:01:40.359915
Resources for stage srcs : 0.131 s worker CPU, 0.131 s worker Wall, Wall: 0.599 s, Cores in use: 1.13, Total efficiency (on 16 cores): 7.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T10:01:40.372440
Blob 1 of 26, id: 8, sources: 5, size: 153x117, npix 10442, brick X: 60,213, Y: 101,218, one pixel: 137 101
Blob 2 of 26, id: 24, sources: 2, size: 79x44, npix 2551, brick X: 136,215, Y: 275,319, one pixel: 192 275
Blob 3 of 26, id: 22, sources: 4, size: 83x53, npix 1990, brick X: 236,319, Y: 263,316, one pixel: 279 263
Blob 4 of 26, id: 21, sources: 1, size: 53x53, npix 1703, brick X: 65,118, Y: 259,312, one pixel: 77 259
Blob 5 of 26, id: 7, sources: 3, size: 48x52, npix 1457, brick X: 60,108, Y: 75,127, one pixel: 98 75
Blob 6 of 26, id: 13, sources: 2, size: 48x36, npix 989, brick X: 251,299, Y: 186,222, one pixel: 261 186
Blob 7 of 26, id: 17, sources: 2, size: 58x36, npix 983, brick X: 149,207, Y: 216,252, one pixel: 158 216
Blob 8 of 26, id: 0, sources: 4, size: 26x45, npix 856, brick X: 0,26, Y: 0,45, one pixel: 0 0
Blob 9 of 26, id: 9, sources: 2, size: 35x40, npix 792, brick X: 217,252, Y: 140,180, one pixel: 241 140
Blob 10 of 26, id: 15, sources: 2, size: 36x40, npix 779, brick X: 0,36, Y: 208,248, one pixel: 25 208
Blob 11 of 26, id: 2, sources: 1, size: 33x33, npix 697, brick X: 61,94, Y: 29,62, one pixel: 77 29
Blob 12 of 26, id: 4, sources: 1, size: 28x29, npix 518, brick X: 165,193, Y: 53,82, one pixel: 179 53
Blob 13 of 26, id: 20, sources: 1, size: 29x29, npix 517, brick X: 129,158, Y: 254,283, one pixel: 142 254
Blob 14 of 26, id: 16, sources: 1, size: 28x28, npix 511, brick X: 227,255, Y: 209,237, one pixel: 239 209
Blob 15 of 26, id: 3, sources: 1, size: 24x25, npix 376, brick X: 220,244, Y: 37,62, one pixel: 231 37
Blob 16 of 26, id: 18, sources: 1, size: 24x25, npix 366, brick X: 203,227, Y: 236,261, one pixel: 214 236
Blob 17 of 26, id: 6, sources: 1, size: 24x25, npix 365, brick X: 107,131, Y: 59,84, one pixel: 117 59
Blob 16 finished, total: Wall: 0.34 s, CPU: 0.33 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092684 MB
Blob 18 of 26, id: 10, sources: 1, size: 24x23, npix 331, brick X: 265,289, Y: 141,164, one pixel: 276 141
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.47171, 33.39642), pm (33.1, -16.6), parallax 0.613 with NanoMaggies: g=21.6, r=20.2, z=-9.31
Reset brightness to NanoMaggies: g=21.6, r=20.2, z=19
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.47145, 33.39940), pm (6.0, -7.3), parallax 1.430 with NanoMaggies: g=13.6, r=13.2, z=13.6
Reset brightness to NanoMaggies: g=13.4, r=13.1, z=13
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.49088, 33.39854), pm (5.9, -6.7), parallax 1.153 with NanoMaggies: g=13.9, r=13.5, z=13.3
Reset brightness to NanoMaggies: g=13.9, r=13.5, z=13.3
Blob 8 finished, total: Wall: 0.53 s, CPU: 0.52 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.146984 MB
Blob 19 of 26, id: 11, sources: 1, size: 19x20, npix 227, brick X: 43,62, Y: 164,184, one pixel: 51 164
Blob 12 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147192 MB
Blob 20 of 26, id: 25, sources: 1, size: 20x19, npix 217, brick X: 12,32, Y: 297,316, one pixel: 20 297
Blob 14 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.1147 MB
Blob 21 of 26, id: 14, sources: 1, size: 19x20, npix 200, brick X: 187,206, Y: 191,211, one pixel: 196 191
Blob 18 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147376 MB
Blob 22 of 26, id: 19, sources: 1, size: 18x19, npix 198, brick X: 174,192, Y: 249,268, one pixel: 182 249
Blob 15 finished, total: Wall: 1.15 s, CPU: 1.14 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147168 MB
Blob 17 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092976 MB
Blob 23 of 26, id: 1, sources: 1, size: 19x19, npix 190, brick X: 129,148, Y: 28,47, one pixel: 138 28
Blob 13 finished, total: Wall: 1.16 s, CPU: 1.15 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14544 MB
Measuring 2 iterative sources
Blob 24 of 26, id: 5, sources: 1, size: 18x19, npix 189, brick X: 234,252, Y: 58,77, one pixel: 243 58
Blob 25 of 26, id: 12, sources: 1, size: 18x19, npix 180, brick X: 226,244, Y: 186,205, one pixel: 235 186
Blob 20 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114908 MB
Blob 26 of 26, id: 23, sources: 1, size: 17x17, npix 145, brick X: 205,222, Y: 273,290, one pixel: 213 273
Blob 25 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114908 MB
Blob 21 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147376 MB
Blob 19 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 960 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147364 MB
Blob 23 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147328 MB
Blob 22 finished, total: Wall: 0.38 s, CPU: 0.37 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093172 MB
Blob 7 finished, total: Wall: 1.58 s, CPU: 1.57 s, VmPeak: 940 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146168 MB
Blob 26 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114908 MB
Blob 24 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145584 MB
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10024 MB
Blob 11 finished, total: Wall: 1.81 s, CPU: 1.81 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146432 MB
Blob 10 finished, total: Wall: 1.89 s, CPU: 1.89 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 115 MB, VmData: 167 MB, maxrss: 0.117388 MB
Blob 6 finished, total: Wall: 2.06 s, CPU: 2.06 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 165 MB, maxrss: 0.116032 MB
Blob 5 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115952 MB
Blob 4 finished, total: Wall: 2.43 s, CPU: 2.43 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146916 MB
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 3.88 s, CPU: 3.87 s, VmPeak: 940 MB, VmSize: 723 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145884 MB
Blob 3 finished, total: Wall: 4.00 s, CPU: 3.99 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099364 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.58781, ee1=0.0725263, ee2=1.0283
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 7.80 s, CPU: 7.80 s, VmPeak: 944 MB, VmSize: 723 MB, VmRSS: 143 MB, VmData: 178 MB, maxrss: 0.146292 MB
Old catalog: 46
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/blobs-custom-029455p33410.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/metrics/cus/all-models-custom-029455p33410.fits
Stage fitblobs : Wall: 8.21 s, CPU: 0.44 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 227 MB, VmData: 254 MB, maxrss: 0.23224 MB
Stage fitblobs finished: 2020-08-07T10:01:48.580958
Resources for stage fitblobs : 38.628 s worker CPU, 39.081 s worker Wall, Wall: 8.210 s, Cores in use: 4.76, Total efficiency (on 16 cores): 29.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T10:01:48.725275
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/tmp-legacysurvey-custom-029455p33410-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/tmp-legacysurvey-custom-029455p33410-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/tmp-legacysurvey-custom-029455p33410-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/tmp-legacysurvey-custom-029455p33410-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-resid.jpg
Stage coadds : Wall: 1.88 s, CPU: 0.70 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 227 MB, VmData: 254 MB, maxrss: 0.23278 MB
Stage coadds finished: 2020-08-07T10:01:50.602568
Resources for stage coadds : 11.197 s worker CPU, 11.731 s worker Wall, Wall: 1.879 s, Cores in use: 6.33, Total efficiency (on 16 cores): 39.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T10:01:50.629542
Cut to 1 unWISE tiles
Reading WISE tile 0287p333 band 1
Reading WISE tile 0287p333 band 2
Reading WISE tile 0287p333 band 3
Reading WISE tile 0287p333 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 806 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.19082 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 800 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.205424 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 800 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.20554 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/028/0287p333/unwise-0287p333-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.212472 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/tmp-legacysurvey-custom-029455p33410-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/tmp-legacysurvey-custom-029455p33410-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.76 s, CPU: 0.63 s, VmPeak: 1043 MB, VmSize: 1040 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.233296 MB
Stage wise_forced finished: 2020-08-07T10:01:53.392631
Resources for stage wise_forced : 3.233 s worker CPU, 6.091 s worker Wall, Wall: 2.765 s, Cores in use: 1.40, Total efficiency (on 16 cores): 8.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T10:01:53.419965
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/coadd/cus/custom-029455p33410/legacysurvey-custom-029455p33410-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/tractor-i/cus/tractor-custom-029455p33410.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/tractor/cus/tractor-custom-029455p33410.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/tractor/cus/brick-custom-029455p33410.sha256sum
Stage writecat : Wall: 0.73 s, CPU: 0.54 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 227 MB, VmData: 251 MB, maxrss: 0.363536 MB
Stage writecat finished: 2020-08-07T10:01:54.148436
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.730 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC212879/PGC212879-largegalaxy-writecat.p
All done: 59.353 s worker CPU, 1087.622 s worker Wall, Wall: 194.681 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 %
Finished galaxy PGC212879 in 3.280 minutes.