Started working on galaxy PGC1808519 at Wed Aug  5 19:30:57 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3865065 27.450132399999998 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:31:01.021218
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.3865065', '27.450132399999998', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3865065 27.450132399999998 --width 239 --height 239 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 243.3865065 27.450132399999998
Starting process 12190 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 12191 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 12192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 12193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 12194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 12195 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 12196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 12197 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 12198 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 12199 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 12200 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 12201 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 12202 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 12203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 12204 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 12205 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:31:01.570896
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_150417_072506_ooi_g_ls9-S9 g expnum 433370 exptime 125.0 propid 2014B-0404 seeing 1.55 MJD 57129.307 object DECaLS_15978_g 
    decam/CP/V4.8.2a/CP20150416/c4d_150417_072506_ooi_g_ls9.fits.fz
  c4d_150417_072230_ooi_r_ls9-S9 r expnum 433369 exptime 76.0 propid 2014B-0404 seeing 1.42 MJD 57129.306 object DECaLS_15978_r 
    decam/CP/V4.8.2a/CP20150416/c4d_150417_072230_ooi_r_ls9.fits.fz
  c4d_150409_093555_ooi_z_ls9-S9 z expnum 430950 exptime 182.0 propid 2014B-0404 seeing 1.36 MJD 57121.397 object DECaLS_15978_z 
    decam/CP/V4.8.2a/CP20150408/c4d_150409_093555_ooi_z_ls9.fits.fz
  c4d_190305_085312_ooi_g_ls9-S9 g expnum 830118 exptime 105.0 propid 2014B-0404 seeing 1.55 MJD 58547.370 object DECaLS_31850_g 
    decam/CP/V4.8.2a/CP20190304/c4d_190305_085312_ooi_g_ls9.fits.fz
  c4d_140815_233647_ooi_z_ls9-S4 z expnum 348217 exptime 122.0 propid 2014B-0404 seeing 0.91 MJD 56884.982 object DECaLS_106_z 
    decam/CP/V4.8.2a/CP20140815/c4d_140815_233647_ooi_z_ls9.fits.fz
  c4d_180319_091401_ooi_r_ls9-S4 r expnum 732023 exptime 73.0 propid 2014B-0404 seeing 0.89 MJD 58196.385 object DECaLS_106_r 
    decam/CP/V4.8.2a/CP20180318/c4d_180319_091401_ooi_r_ls9.fits.fz
  c4d_180319_091011_ooi_g_ls9-S4 g expnum 732022 exptime 200.0 propid 2014B-0404 seeing 1.08 MJD 58196.382 object DECaLS_106_g 
    decam/CP/V4.8.2a/CP20180318/c4d_180319_091011_ooi_g_ls9.fits.fz
  c4d_190307_085704_ooi_r_ls9-S9 r expnum 830772 exptime 77.0 propid 2014B-0404 seeing 1.30 MJD 58549.373 object DECaLS_31850_r 
    decam/CP/V4.8.2a/CP20190306/c4d_190307_085704_ooi_r_ls9.fits.fz
  c4d_180212_091626_ooi_z_ls9-S9 z expnum 720574 exptime 157.0 propid 2014B-0404 seeing 1.21 MJD 58161.386 object DECaLS_31850_z 
    decam/CP/V4.8.2a/CP20180211/c4d_180212_091626_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180319T091011_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539ab3-r-20190307T085704_oi[S9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T072023_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091626_oi[S9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95718f0-z-20150409T093202_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T085312_oi[S9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9561a47-g-20150417T072208_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f83e-r-20180319T091401_oi[S4,noinherit][2046,4094][real]: DECaLS_1
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233353_oi[S4,noinherit][2046,4094][real]: DECaLS_1
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 53.13 s, CPU: 0.97 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.178668 MB
Stage tims finished: 2020-08-05T19:31:54.705758
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539ab3-r-20190307T085704_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T072023_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T085312_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091626_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95718f0-z-20150409T093202_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9561a47-g-20150417T072208_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f83e-r-20180319T091401_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233353_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.385 s worker CPU, 245.364 s worker Wall, Wall: 53.137 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180319T091011_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:31:54.779534
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03350.fits
Matched 11 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/reference-custom-243386p27450.fits
Stage refs : Wall: 10.41 s, CPU: 3.17 s, VmPeak: 1043 MB, VmSize: 1038 MB, VmRSS: 203 MB, VmData: 234 MB, maxrss: 0.207612 MB
Stage refs finished: 2020-08-05T19:32:05.191475
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.414 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:32:05.212138
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outlier-mask-custom-243386p27450.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-pre-custom-243386p27450.jpg
Image c4d_190305_085312_ooi_g_ls9-S9 g : masking 279 positive outlier pixels and 0 negative outlier pixels
Image c4d_190307_085704_ooi_r_ls9-S9 r : masking 1656 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outlier-mask-custom-243386p27450.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-post-custom-243386p27450.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-masked-pos-custom-243386p27450.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-masked-neg-custom-243386p27450.jpg
Stage outliers : Wall: 0.79 s, CPU: 0.56 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.218388 MB
Stage outliers finished: 2020-08-05T19:32:05.999033
Resources for stage outliers : 0.492 s worker CPU, 0.661 s worker Wall, Wall: 0.788 s, Cores in use: 1.33, Total efficiency (on 16 cores): 8.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:32:06.019267
Stage halos : Wall: 0.46 s, CPU: 0.35 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.218732 MB
Stage halos finished: 2020-08-05T19:32:06.475168
Resources for stage halos : 0.232 s worker CPU, 0.676 s worker Wall, Wall: 0.457 s, Cores in use: 1.27, Total efficiency (on 16 cores): 7.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:32:06.592355
PSF sigmas in coadd pixels: ['2.52', '2.52', '1.75']
Using average PSF sigma 2.2639793978028244
Gaussian PSF norm 0.1246013069057294 vs pixelized 0.12214948
average tim pixel scale / coadd scale: 1.001374294824955
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.30', '1.44', '2.11']
Using average PSF sigma 1.9507533148274174
Gaussian PSF norm 0.14460813144835538 vs pixelized 0.11065808
average tim pixel scale / coadd scale: 1.001374194849965
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.20', '1.48', '1.97']
Using average PSF sigma 1.8860012415371419
Gaussian PSF norm 0.14957296186293245 vs pixelized 0.124712214
average tim pixel scale / coadd scale: 1.0013857919488187
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.11 s, CPU: 0.10 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.22084 MB
Stage fit_on_coadds finished: 2020-08-05T19:32:06.699274
Resources for stage fit_on_coadds : 0.097 s worker CPU, 0.097 s worker Wall, Wall: 0.108 s, Cores in use: 1.82, Total efficiency (on 16 cores): 11.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:32:06.709091
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 57 potential peaks
Of 57 potential peaks: 45 in veto map, 6 cut by saddle test, 0 cut by aper test, 6 kept
SED z : 6 new peaks
Found 73 potential peaks
Of 73 potential peaks: 65 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 44 potential peaks
Of 44 potential peaks: 38 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 71 potential peaks
Of 71 potential peaks: 62 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 85 potential peaks
Of 85 potential peaks: 76 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 10 new sources
Median coadd sky for g : 0.00044269167
Median coadd sky for r : 0.00096374436
Median coadd sky for z : 0.0016162135
Stage srcs : Wall: 0.59 s, CPU: 0.56 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.221392 MB
Stage srcs finished: 2020-08-05T19:32:07.295126
Resources for stage srcs : 0.073 s worker CPU, 0.073 s worker Wall, Wall: 0.587 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:32:07.313112
Blob 1 of 5, id: 0, sources: 12, size: 215x231, npix 32069, brick X: 14,229, Y: 0,231, one pixel: 30 0
Blob 2 of 5, id: 2, sources: 1, size: 37x30, npix 700, brick X: 8,45, Y: 142,172, one pixel: 26 142
Blob 3 of 5, id: 4, sources: 1, size: 31x24, npix 575, brick X: 208,239, Y: 203,227, one pixel: 228 203
Blob 4 of 5, id: 3, sources: 1, size: 27x29, npix 536, brick X: 31,58, Y: 186,215, one pixel: 43 186
Blob 5 of 5, id: 1, sources: 1, size: 23x22, npix 304, brick X: 185,208, Y: 5,27, one pixel: 195 5
Blob 5 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.115172 MB
Blob 4 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093436 MB
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 0.79 s, CPU: 0.78 s, VmPeak: 940 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150344 MB
Blob 3 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.11248 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.43697, ee1=0.239877, ee2=-0.081003
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (243.38970, 27.43972), pm (2.2, -2.4), parallax 0.059 with NanoMaggies: g=12.4, r=12, z=11.9
Reset brightness to NanoMaggies: g=20.2, r=19.1, z=18.5
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 16.00 s, CPU: 15.99 s, VmPeak: 936 MB, VmSize: 741 MB, VmRSS: 162 MB, VmData: 190 MB, maxrss: 0.165704 MB
Old catalog: 19
New catalog: 20
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/blobs-custom-243386p27450.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/all-models-custom-243386p27450.fits
Stage fitblobs : Wall: 16.64 s, CPU: 0.58 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.221736 MB
Stage fitblobs finished: 2020-08-05T19:32:23.955572
Resources for stage fitblobs : 18.592 s worker CPU, 18.751 s worker Wall, Wall: 16.644 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:32:23.967393
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-resid.jpg
Stage coadds : Wall: 2.86 s, CPU: 0.66 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.222376 MB
Stage coadds finished: 2020-08-05T19:32:26.828768
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 10.875 s worker CPU, 17.020 s worker Wall, Wall: 2.863 s, Cores in use: 4.03, Total efficiency (on 16 cores): 25.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:32:26.842384
Cut to 1 unWISE tiles
Reading WISE tile 2433p272 band 1
Reading WISE tile 2433p272 band 2
Reading WISE tile 2433p272 band 3
Reading WISE tile 2433p272 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.192292 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.205748 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 941 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.203516 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 960 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206512 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.41 s, CPU: 0.88 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 218 MB, VmData: 242 MB, maxrss: 0.223084 MB
Stage wise_forced finished: 2020-08-05T19:32:29.251853
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.226 s worker CPU, 4.850 s worker Wall, Wall: 2.411 s, Cores in use: 1.71, Total efficiency (on 16 cores): 10.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:32:29.265297
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/tractor-i/cus/tractor-custom-243386p27450.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/tractor/cus/tractor-custom-243386p27450.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/tractor/cus/brick-custom-243386p27450.sha256sum
Stage writecat : Wall: 0.72 s, CPU: 0.60 s, VmPeak: 1180 MB, VmSize: 1052 MB, VmRSS: 220 MB, VmData: 242 MB, maxrss: 0.35596 MB
Stage writecat finished: 2020-08-05T19:32:29.989609
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.726 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-writecat.p
All done: 38.975 s worker CPU, 287.496 s worker Wall, Wall: 88.455 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.4 %
Finished galaxy PGC1808519 in 1.556 minutes.
Started working on galaxy PGC1808519 at Wed Aug  5 19:51:44 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3865065 27.450132399999998 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:51:46.619236
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.3865065', '27.450132399999998', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.3865065 27.450132399999998 --width 239 --height 239 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 243.3865065 27.450132399999998
Starting process 16340 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 16342 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 16345 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 16347 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 16349 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 16351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 16352 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 16354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 16356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 16358 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 16360 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 16362 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 16364 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 16366 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 16371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 16372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 16373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 16374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 16375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 16376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 16377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 16378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 16379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 16380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 16381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 16383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 16384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 16385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 16386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 16387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 16389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 16390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:51:49.569506
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  c4d_150417_072506_ooi_g_ls9-S9 g expnum 433370 exptime 125.0 propid 2014B-0404 seeing 1.55 MJD 57129.307 object DECaLS_15978_g 
    decam/CP/V4.8.2a/CP20150416/c4d_150417_072506_ooi_g_ls9.fits.fz
  c4d_150417_072230_ooi_r_ls9-S9 r expnum 433369 exptime 76.0 propid 2014B-0404 seeing 1.42 MJD 57129.306 object DECaLS_15978_r 
    decam/CP/V4.8.2a/CP20150416/c4d_150417_072230_ooi_r_ls9.fits.fz
  c4d_150409_093555_ooi_z_ls9-S9 z expnum 430950 exptime 182.0 propid 2014B-0404 seeing 1.36 MJD 57121.397 object DECaLS_15978_z 
    decam/CP/V4.8.2a/CP20150408/c4d_150409_093555_ooi_z_ls9.fits.fz
  c4d_190305_085312_ooi_g_ls9-S9 g expnum 830118 exptime 105.0 propid 2014B-0404 seeing 1.55 MJD 58547.370 object DECaLS_31850_g 
    decam/CP/V4.8.2a/CP20190304/c4d_190305_085312_ooi_g_ls9.fits.fz
  c4d_140815_233647_ooi_z_ls9-S4 z expnum 348217 exptime 122.0 propid 2014B-0404 seeing 0.91 MJD 56884.982 object DECaLS_106_z 
    decam/CP/V4.8.2a/CP20140815/c4d_140815_233647_ooi_z_ls9.fits.fz
  c4d_180319_091401_ooi_r_ls9-S4 r expnum 732023 exptime 73.0 propid 2014B-0404 seeing 0.89 MJD 58196.385 object DECaLS_106_r 
    decam/CP/V4.8.2a/CP20180318/c4d_180319_091401_ooi_r_ls9.fits.fz
  c4d_180319_091011_ooi_g_ls9-S4 g expnum 732022 exptime 200.0 propid 2014B-0404 seeing 1.08 MJD 58196.382 object DECaLS_106_g 
    decam/CP/V4.8.2a/CP20180318/c4d_180319_091011_ooi_g_ls9.fits.fz
  c4d_190307_085704_ooi_r_ls9-S9 r expnum 830772 exptime 77.0 propid 2014B-0404 seeing 1.30 MJD 58549.373 object DECaLS_31850_r 
    decam/CP/V4.8.2a/CP20190306/c4d_190307_085704_ooi_r_ls9.fits.fz
  c4d_180212_091626_ooi_z_ls9-S9 z expnum 720574 exptime 157.0 propid 2014B-0404 seeing 1.21 MJD 58161.386 object DECaLS_31850_z 
    decam/CP/V4.8.2a/CP20180211/c4d_180212_091626_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539ab3-r-20190307T085704_oi[S9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T072023_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95718f0-z-20150409T093202_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180319T091011_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9561a47-g-20150417T072208_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T085312_oi[S9,noinherit][2046,4094][real]: DECaLS_3
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091626_oi[S9,noinherit][2046,4094][real]: DECaLS_3
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f83e-r-20180319T091401_oi[S4,noinherit][2046,4094][real]: DECaLS_1
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233353_oi[S4,noinherit][2046,4094][real]: DECaLS_1
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 28.60 s, CPU: 2.37 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 174 MB, VmData: 206 MB, maxrss: 0.17864 MB
Stage tims finished: 2020-08-05T19:52:18.166866
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539ab3-r-20190307T085704_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180319T091011_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95718f0-z-20150409T093202_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f83e-r-20180319T091401_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233353_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091626_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 4.963 s worker CPU, 156.193 s worker Wall, Wall: 28.600 s, Cores in use: 0.26, Total efficiency (on 32 cores): 0.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T072023_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9561a47-g-20150417T072208_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T085312_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:52:18.249119
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03350.fits
Matched 11 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/reference-custom-243386p27450.fits
Stage refs : Wall: 7.73 s, CPU: 3.62 s, VmPeak: 1043 MB, VmSize: 1038 MB, VmRSS: 203 MB, VmData: 234 MB, maxrss: 0.207528 MB
Stage refs finished: 2020-08-05T19:52:25.982355
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.736 s, Cores in use: 0.47, Total efficiency (on 32 cores): 1.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:52:26.015303
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outlier-mask-custom-243386p27450.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-pre-custom-243386p27450.jpg
Image c4d_190305_085312_ooi_g_ls9-S9 g : masking 279 positive outlier pixels and 0 negative outlier pixels
Image c4d_190307_085704_ooi_r_ls9-S9 r : masking 1656 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outlier-mask-custom-243386p27450.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-post-custom-243386p27450.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-masked-pos-custom-243386p27450.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/outliers-masked-neg-custom-243386p27450.jpg
Stage outliers : Wall: 1.41 s, CPU: 0.84 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 214 MB, VmData: 243 MB, maxrss: 0.219288 MB
Stage outliers finished: 2020-08-05T19:52:27.424149
Resources for stage outliers : 0.677 s worker CPU, 1.407 s worker Wall, Wall: 1.411 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:52:27.449883
Stage halos : Wall: 0.46 s, CPU: 0.35 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 214 MB, VmData: 243 MB, maxrss: 0.219528 MB
Stage halos finished: 2020-08-05T19:52:27.912607
Resources for stage halos : 0.312 s worker CPU, 0.812 s worker Wall, Wall: 0.465 s, Cores in use: 1.43, Total efficiency (on 32 cores): 4.5 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:52:27.938411
PSF sigmas in coadd pixels: ['2.52', '2.52', '1.75']
Using average PSF sigma 2.2639793978028244
Gaussian PSF norm 0.1246013069057294 vs pixelized 0.12214948
average tim pixel scale / coadd scale: 1.001374294824955
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.30', '1.44', '2.11']
Using average PSF sigma 1.9507533148274174
Gaussian PSF norm 0.14460813144835538 vs pixelized 0.11065808
average tim pixel scale / coadd scale: 1.001374194849965
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.20', '1.48', '1.97']
Using average PSF sigma 1.8860012415371419
Gaussian PSF norm 0.14957296186293245 vs pixelized 0.124712214
average tim pixel scale / coadd scale: 1.0013857919488187
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.12 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.221128 MB
Stage fit_on_coadds finished: 2020-08-05T19:52:28.095372
Resources for stage fit_on_coadds : 0.112 s worker CPU, 0.112 s worker Wall, Wall: 0.159 s, Cores in use: 1.50, Total efficiency (on 32 cores): 4.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:52:28.107940
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 57 potential peaks
Of 57 potential peaks: 45 in veto map, 6 cut by saddle test, 0 cut by aper test, 6 kept
SED z : 6 new peaks
Found 73 potential peaks
Of 73 potential peaks: 65 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 44 potential peaks
Of 44 potential peaks: 38 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 71 potential peaks
Of 71 potential peaks: 62 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 85 potential peaks
Of 85 potential peaks: 76 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 10 new sources
Median coadd sky for g : 0.00044269167
Median coadd sky for r : 0.00096374436
Median coadd sky for z : 0.0016162135
Stage srcs : Wall: 0.74 s, CPU: 0.70 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.22166 MB
Stage srcs finished: 2020-08-05T19:52:28.844980
Resources for stage srcs : 0.096 s worker CPU, 0.096 s worker Wall, Wall: 0.740 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:52:28.864451
Blob 1 of 5, id: 0, sources: 12, size: 215x231, npix 32069, brick X: 14,229, Y: 0,231, one pixel: 30 0
Blob 2 of 5, id: 2, sources: 1, size: 37x30, npix 700, brick X: 8,45, Y: 142,172, one pixel: 26 142
Blob 3 of 5, id: 4, sources: 1, size: 31x24, npix 575, brick X: 208,239, Y: 203,227, one pixel: 228 203
Blob 4 of 5, id: 3, sources: 1, size: 27x29, npix 536, brick X: 31,58, Y: 186,215, one pixel: 43 186
Blob 5 of 5, id: 1, sources: 1, size: 23x22, npix 304, brick X: 185,208, Y: 5,27, one pixel: 195 5
Blob 5 finished, total: Wall: 0.41 s, CPU: 0.40 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092296 MB
Blob 4 finished, total: Wall: 0.59 s, CPU: 0.58 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113448 MB
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 109 MB, VmData: 164 MB, maxrss: 0.112112 MB
Blob 2 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.09402 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.43697, ee1=0.239877, ee2=-0.081003
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (243.38970, 27.43972), pm (2.2, -2.4), parallax 0.059 with NanoMaggies: g=12.4, r=12, z=11.9
Reset brightness to NanoMaggies: g=20.2, r=19.1, z=18.5
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 17.51 s, CPU: 17.47 s, VmPeak: 704 MB, VmSize: 693 MB, VmRSS: 125 MB, VmData: 164 MB, maxrss: 0.138372 MB
Old catalog: 19
New catalog: 20
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/blobs-custom-243386p27450.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/metrics/cus/all-models-custom-243386p27450.fits
Stage fitblobs : Wall: 18.32 s, CPU: 0.71 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 217 MB, VmData: 243 MB, maxrss: 0.22208 MB
Stage fitblobs finished: 2020-08-05T19:52:47.185393
Resources for stage fitblobs : 20.215 s worker CPU, 20.408 s worker Wall, Wall: 18.323 s, Cores in use: 1.14, Total efficiency (on 32 cores): 3.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:52:47.206775
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-resid.jpg
Stage coadds : Wall: 4.06 s, CPU: 1.40 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 217 MB, VmData: 243 MB, maxrss: 0.222648 MB
Stage coadds finished: 2020-08-05T19:52:51.269029
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 28.055 s worker CPU, 51.250 s worker Wall, Wall: 4.064 s, Cores in use: 7.25, Total efficiency (on 32 cores): 22.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:52:51.285246
Cut to 1 unWISE tiles
Reading WISE tile 2433p272 band 1
Reading WISE tile 2433p272 band 4
Reading WISE tile 2433p272 band 3
Reading WISE tile 2433p272 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 802 MB, VmSize: 802 MB, VmRSS: 142 MB, VmData: 174 MB, maxrss: 0.181448 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 935 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.202784 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 862 MB, VmSize: 862 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.206028 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206288 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/tmp-legacysurvey-custom-243386p27450-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.61 s, CPU: 0.85 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 218 MB, VmData: 243 MB, maxrss: 0.223352 MB
Stage wise_forced finished: 2020-08-05T19:52:53.892760
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.383 s worker CPU, 5.247 s worker Wall, Wall: 2.610 s, Cores in use: 1.62, Total efficiency (on 32 cores): 5.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T19:52:53.907563
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/coadd/cus/custom-243386p27450/legacysurvey-custom-243386p27450-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/tractor-i/cus/tractor-custom-243386p27450.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/tractor/cus/tractor-custom-243386p27450.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/tractor/cus/brick-custom-243386p27450.sha256sum
Stage writecat : Wall: 2.10 s, CPU: 1.06 s, VmPeak: 1180 MB, VmSize: 1052 MB, VmRSS: 220 MB, VmData: 243 MB, maxrss: 0.356228 MB
Stage writecat finished: 2020-08-05T19:52:56.010895
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.106 s, Cores in use: 0.50, Total efficiency (on 32 cores): 1.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/243/PGC1808519/PGC1808519-largegalaxy-writecat.p
All done: 57.819 s worker CPU, 235.531 s worker Wall, Wall: 66.469 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 %
Finished galaxy PGC1808519 in 1.199 minutes.
Started working on galaxy PGC1808519 at Mon Aug 10 08:00:54 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.38607031750894 27.44991647495319 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:00:55.258082
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.38607031750894', '27.44991647495319', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.38607031750894 27.44991647495319 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 243.38607031750894 27.44991647495319
Starting process 3027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 3028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 3029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 3030 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 3031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 3032 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 3033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 3034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:00:56.056839
Keeping 9 CCDs:
  c4d_150417_072506_ooi_g_ls9-S9 g expnum 433370 exptime 125.0 propid 2014B-0404 seeing 1.55 MJD 57129.307 object DECaLS_15978_g 
    decam/CP/V4.8.2a/CP20150416/c4d_150417_072506_ooi_g_ls9.fits.fz
  c4d_150417_072230_ooi_r_ls9-S9 r expnum 433369 exptime 76.0 propid 2014B-0404 seeing 1.42 MJD 57129.306 object DECaLS_15978_r 
    decam/CP/V4.8.2a/CP20150416/c4d_150417_072230_ooi_r_ls9.fits.fz
  c4d_150409_093555_ooi_z_ls9-S9 z expnum 430950 exptime 182.0 propid 2014B-0404 seeing 1.36 MJD 57121.397 object DECaLS_15978_z 
    decam/CP/V4.8.2a/CP20150408/c4d_150409_093555_ooi_z_ls9.fits.fz
  c4d_190305_085312_ooi_g_ls9-S9 g expnum 830118 exptime 105.0 propid 2014B-0404 seeing 1.55 MJD 58547.370 object DECaLS_31850_g 
    decam/CP/V4.8.2a/CP20190304/c4d_190305_085312_ooi_g_ls9.fits.fz
  c4d_140815_233647_ooi_z_ls9-S4 z expnum 348217 exptime 122.0 propid 2014B-0404 seeing 0.91 MJD 56884.982 object DECaLS_106_z 
    decam/CP/V4.8.2a/CP20140815/c4d_140815_233647_ooi_z_ls9.fits.fz
  c4d_180319_091401_ooi_r_ls9-S4 r expnum 732023 exptime 73.0 propid 2014B-0404 seeing 0.89 MJD 58196.385 object DECaLS_106_r 
    decam/CP/V4.8.2a/CP20180318/c4d_180319_091401_ooi_r_ls9.fits.fz
  c4d_180319_091011_ooi_g_ls9-S4 g expnum 732022 exptime 200.0 propid 2014B-0404 seeing 1.08 MJD 58196.382 object DECaLS_106_g 
    decam/CP/V4.8.2a/CP20180318/c4d_180319_091011_ooi_g_ls9.fits.fz
  c4d_190307_085704_ooi_r_ls9-S9 r expnum 830772 exptime 77.0 propid 2014B-0404 seeing 1.30 MJD 58549.373 object DECaLS_31850_r 
    decam/CP/V4.8.2a/CP20190306/c4d_190307_085704_ooi_r_ls9.fits.fz
  c4d_180212_091626_ooi_z_ls9-S9 z expnum 720574 exptime 157.0 propid 2014B-0404 seeing 1.21 MJD 58161.386 object DECaLS_31850_z 
    decam/CP/V4.8.2a/CP20180211/c4d_180212_091626_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9561a47-g-20150417T072208_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95718f0-z-20150409T093202_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T085312_oi[S9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f83e-r-20180319T091401_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T072023_oi[S9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180319T091011_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539ab3-r-20190307T085704_oi[S9,noinherit][2046,4094][real]: DECaLS_3
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091626_oi[S9,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233353_oi[S4,noinherit][2046,4094][real]: DECaLS_1
Stage tims : Wall: 45.15 s, CPU: 0.96 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.176808 MB
Stage tims finished: 2020-08-10T08:01:41.206998
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95718f0-z-20150409T093202_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9561a47-g-20150417T072208_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f83e-r-20180319T091401_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95571b1-r-20150417T072023_oi[S9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539ab3-r-20190307T085704_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180319T091011_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d16a-z-20140815T233353_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Resources for stage tims : 4.876 s worker CPU, 215.911 s worker Wall, Wall: 45.151 s, Cores in use: 0.13, Total efficiency (on 8 cores): 1.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-10T08:01:42.521053
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03350.fits
Matched 11 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/reference-custom-243386p27449.fits
Stage refs : Wall: 8.62 s, CPU: 3.05 s, VmPeak: 1036 MB, VmSize: 1032 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.205924 MB
Stage refs finished: 2020-08-10T08:01:51.138780
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953a368-g-20190305T085312_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952764d-z-20180212T091626_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.619 s, Cores in use: 0.35, Total efficiency (on 8 cores): 4.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:01:51.241737
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/outlier-mask-custom-243386p27449.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/outliers-pre-custom-243386p27449.jpg
Image c4d_190305_085312_ooi_g_ls9-S9 g : masking 255 positive outlier pixels and 0 negative outlier pixels
Image c4d_190307_085704_ooi_r_ls9-S9 r : masking 1651 positive outlier pixels and 0 negative outlier pixels
Image c4d_140815_233647_ooi_z_ls9-S4 z : masking 0 positive outlier pixels and 69 negative outlier pixels
Image c4d_150409_093555_ooi_z_ls9-S9 z : masking 0 positive outlier pixels and 238 negative outlier pixels
Image c4d_180212_091626_ooi_z_ls9-S9 z : masking 223 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/outlier-mask-custom-243386p27449.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/outliers-post-custom-243386p27449.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/outliers-masked-pos-custom-243386p27449.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/outliers-masked-neg-custom-243386p27449.jpg
Stage outliers : Wall: 0.94 s, CPU: 0.75 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.216476 MB
Stage outliers finished: 2020-08-10T08:01:52.178687
Resources for stage outliers : 0.463 s worker CPU, 0.463 s worker Wall, Wall: 0.938 s, Cores in use: 1.29, Total efficiency (on 8 cores): 16.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:01:52.199257
Stage halos : Wall: 0.92 s, CPU: 0.73 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 212 MB, VmData: 242 MB, maxrss: 0.216836 MB
Stage halos finished: 2020-08-10T08:01:53.122773
Resources for stage halos : 0.181 s worker CPU, 0.955 s worker Wall, Wall: 0.925 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:01:53.227249
PSF sigmas in coadd pixels: ['2.52', '2.52', '1.75']
Using average PSF sigma 2.2639793978028244
Gaussian PSF norm 0.1246013069057294 vs pixelized 0.12214581
average tim pixel scale / coadd scale: 1.001374294824955
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.30', '1.44', '2.11']
Using average PSF sigma 1.9507533148274174
Gaussian PSF norm 0.14460813144835538 vs pixelized 0.11065289
average tim pixel scale / coadd scale: 1.001374194849965
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.20', '1.48', '1.97']
Using average PSF sigma 1.8860012415371419
Gaussian PSF norm 0.14957296186293245 vs pixelized 0.12471876
average tim pixel scale / coadd scale: 1.0013857919488187
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.10 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.219152 MB
Stage fit_on_coadds finished: 2020-08-10T08:01:53.355152
Resources for stage fit_on_coadds : 0.118 s worker CPU, 0.118 s worker Wall, Wall: 0.129 s, Cores in use: 1.74, Total efficiency (on 8 cores): 21.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:01:53.406476
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 57 potential peaks
Of 57 potential peaks: 46 in veto map, 6 cut by saddle test, 0 cut by aper test, 5 kept
SED z : 5 new peaks
Found 73 potential peaks
Of 73 potential peaks: 64 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 39 potential peaks
Of 39 potential peaks: 33 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 69 potential peaks
Of 69 potential peaks: 60 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 88 potential peaks
Of 88 potential peaks: 79 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 10 new sources
Median coadd sky for g : 0.0004859047
Median coadd sky for r : 0.0009501827
Median coadd sky for z : 0.0017588155
Stage srcs : Wall: 1.17 s, CPU: 1.12 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.219744 MB
Stage srcs finished: 2020-08-10T08:01:54.577785
Resources for stage srcs : 0.085 s worker CPU, 0.085 s worker Wall, Wall: 1.172 s, Cores in use: 1.03, Total efficiency (on 8 cores): 12.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:01:54.590046
Blob 1 of 6, id: 0, sources: 11, size: 215x234, npix 32458, brick X: 9,224, Y: 0,234, one pixel: 27 0
Blob 2 of 6, id: 3, sources: 1, size: 37x30, npix 704, brick X: 2,39, Y: 145,175, one pixel: 21 145
Blob 3 of 6, id: 5, sources: 1, size: 35x24, npix 604, brick X: 202,237, Y: 206,230, one pixel: 222 206
Blob 4 of 6, id: 4, sources: 1, size: 27x29, npix 546, brick X: 26,53, Y: 189,218, one pixel: 37 189
Blob 5 of 6, id: 2, sources: 1, size: 23x22, npix 304, brick X: 180,203, Y: 8,30, one pixel: 190 8
Blob 6 of 6, id: 1, sources: 1, size: 21x20, npix 247, brick X: 205,226, Y: 1,21, one pixel: 213 1
Blob 6 finished, total: Wall: 0.12 s, CPU: 0.09 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144136 MB
Blob 5 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 940 MB, VmSize: 723 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142288 MB
Blob 4 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 936 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146716 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147176 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 943 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146796 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (243.38970, 27.43972), pm (2.2, -2.4), parallax 0.059 with NanoMaggies: g=13.5, r=12.8, z=12.6
Reset brightness to NanoMaggies: g=20.2, r=19.1, z=18.5
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.03458, ee1=0.209592, ee2=-0.0616584
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 15.14 s, CPU: 15.14 s, VmPeak: 941 MB, VmSize: 728 MB, VmRSS: 152 MB, VmData: 183 MB, maxrss: 0.155912 MB
Old catalog: 18
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/blobs-custom-243386p27449.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/metrics/cus/all-models-custom-243386p27449.fits
Stage fitblobs : Wall: 15.94 s, CPU: 0.74 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.220168 MB
Stage fitblobs finished: 2020-08-10T08:02:10.525455
Resources for stage fitblobs : 18.350 s worker CPU, 18.471 s worker Wall, Wall: 15.936 s, Cores in use: 1.20, Total efficiency (on 8 cores): 15.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:02:10.547486
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/tmp-legacysurvey-custom-243386p27449-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/tmp-legacysurvey-custom-243386p27449-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/tmp-legacysurvey-custom-243386p27449-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/tmp-legacysurvey-custom-243386p27449-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-resid.jpg
Stage coadds : Wall: 1.28 s, CPU: 0.61 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.220712 MB
Stage coadds finished: 2020-08-10T08:02:11.826072
Resources for stage coadds : 3.831 s worker CPU, 4.169 s worker Wall, Wall: 1.280 s, Cores in use: 3.47, Total efficiency (on 8 cores): 43.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:02:11.837754
Cut to 1 unWISE tiles
Reading WISE tile 2433p272 band 2
Reading WISE tile 2433p272 band 1
Reading WISE tile 2433p272 band 4
Reading WISE tile 2433p272 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 801 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.188476 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 951 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.205504 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 799 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.20494 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2433p272/unwise-2433p272-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 936 MB, VmSize: 808 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.207368 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/tmp-legacysurvey-custom-243386p27449-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/tmp-legacysurvey-custom-243386p27449-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.86 s, CPU: 0.49 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.22142 MB
Stage wise_forced finished: 2020-08-10T08:02:13.702580
Resources for stage wise_forced : 3.398 s worker CPU, 4.544 s worker Wall, Wall: 1.866 s, Cores in use: 2.08, Total efficiency (on 8 cores): 26.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:02:13.714356
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/coadd/cus/custom-243386p27449/legacysurvey-custom-243386p27449-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/tractor-i/cus/tractor-custom-243386p27449.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/tractor/cus/tractor-custom-243386p27449.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/tractor/cus/brick-custom-243386p27449.sha256sum
Stage writecat : Wall: 0.66 s, CPU: 0.49 s, VmPeak: 1174 MB, VmSize: 1046 MB, VmRSS: 218 MB, VmData: 242 MB, maxrss: 0.354276 MB
Stage writecat finished: 2020-08-10T08:02:14.374249
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.661 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC1808519/PGC1808519-largegalaxy-writecat.p
All done: 31.304 s worker CPU, 244.719 s worker Wall, Wall: 78.342 s, Cores in use: 0.52, Total efficiency (on 8 cores): 6.5 %
Finished galaxy PGC1808519 in 1.357 minutes.