Started working on galaxy PGC1289490 at Wed Aug  5 20:06:08 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.78769450000004 5.8071155999999995 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:06:12.356232
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.78769450000004', '5.8071155999999995', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.78769450000004 5.8071155999999995 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.78769450000004 5.8071155999999995
Starting process 60394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 60395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 60396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 60397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 60398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 60399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 60400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 60401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 60402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 60403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 60404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 60406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 60407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 60405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 60408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 60409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:06:13.184768
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 10 CCDs:
  c4d_170730_060231_ooi_g_ls9-S3 g expnum 663315 exptime 104.0 propid 2014B-0404 seeing 1.21 MJD 57964.250 object DECaLS_7934_g 
    decam/CP/V4.8.2a/CP20170729/c4d_170730_060231_ooi_g_ls9.fits.fz
  c4d_180916_031231_ooi_z_ls9-S3 z expnum 774205 exptime 80.0 propid 2014B-0404 seeing 1.43 MJD 58377.134 object DECaLS_7934_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_031231_ooi_z_ls9.fits.fz
  c4d_180811_051548_ooi_r_ls9-S3 r expnum 764175 exptime 40.0 propid 2014B-0404 seeing 1.64 MJD 58341.219 object DECaLS_7934_r 
    decam/CP/V4.8.2a/CP20180810/c4d_180811_051548_ooi_r_ls9.fits.fz
  c4d_180901_080029_ooi_z_ls9-N2 z expnum 767625 exptime 103.0 propid 2014B-0404 seeing 1.30 MJD 58362.334 object DECaLS_39678_z 
    decam/CP/V4.8.2a/CP20180831/c4d_180901_080029_ooi_z_ls9.fits.fz
  c4d_180914_033108_ooi_g_ls9-N2 g expnum 773265 exptime 160.0 propid 2014B-0404 seeing 1.49 MJD 58375.147 object DECaLS_39678_g 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_033108_ooi_g_ls9.fits.fz
  c4d_180914_032938_ooi_r_ls9-N2 r expnum 773264 exptime 61.0 propid 2014B-0404 seeing 1.39 MJD 58375.146 object DECaLS_39678_r 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_032938_ooi_r_ls9.fits.fz
  c4d_170719_073656_ooi_g_ls9-N2 g expnum 660044 exptime 200.0 propid 2014B-0404 seeing 1.99 MJD 57953.314 object DECaLS_39678_g 
    decam/CP/V4.8.2/CP20170718/c4d_170719_073656_ooi_g_ls9.fits.fz
  c4d_170801_065120_ooi_g_ls9-N3 g expnum 663746 exptime 198.0 propid 2014B-0404 seeing 1.74 MJD 57966.283 object DECaLS_23806_g 
    decam/CP/V4.8.2a/CP20170731/c4d_170801_065120_ooi_g_ls9.fits.fz
  c4d_180902_031455_ooi_r_ls9-N3 r expnum 767887 exptime 68.0 propid 2014B-0404 seeing 1.52 MJD 58363.135 object DECaLS_23806_r 
    decam/CP/V4.8.2a/CP20180901/c4d_180902_031455_ooi_r_ls9.fits.fz
  c4d_160813_054711_ooi_z_ls9-N3 z expnum 563585 exptime 92.0 propid 2014B-0404 seeing 0.88 MJD 57613.239 object DECaLS_23806_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054711_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S3,noinherit][2046,4094][real]: DECaLS_7
Clipping 1 pixels with anomalously large oow values: max 0.044433 vs median 0.0334596
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S3,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T032938_oi[N2,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[N3,noinherit][2046,4094][real]: DECaLS_23806
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S3,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180901T080029_oi[N2,noinherit][2046,4094][real]: DECaLS_39678
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[N3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[N3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T073243_oi[N2,noinherit][2046,4094][real]: DECaLS_3
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T033108_oi[N2,noinherit][2046,4094][real]: DECaLS_3
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 49.81 s, CPU: 1.14 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.181064 MB
Stage tims finished: 2020-08-05T20:07:02.994304
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[N3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[N3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T033108_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 5.909 s worker CPU, 281.428 s worker Wall, Wall: 49.811 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T073243_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180901T080029_oi[N2,noinherit][2046,4094][real]: DECaLS_39678 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:07:03.024779
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05435.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05691.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05564.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05563.fits
Matched 14 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/reference-custom-347787p05807.fits
Stage refs : Wall: 17.06 s, CPU: 2.52 s, VmPeak: 1042 MB, VmSize: 1028 MB, VmRSS: 194 MB, VmData: 225 MB, maxrss: 0.198584 MB
Stage refs finished: 2020-08-05T20:07:20.085065
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[N3,noinherit][2046,4094][real]: DECaLS_23806 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T032938_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 17.062 s, Cores in use: 0.15, Total efficiency (on 16 cores): 0.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:07:20.198897
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outlier-mask-custom-347787p05807.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-pre-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outlier-mask-custom-347787p05807.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-post-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-masked-pos-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-masked-neg-custom-347787p05807.jpg
Stage outliers : Wall: 1.74 s, CPU: 1.48 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.21154 MB
Stage outliers finished: 2020-08-05T20:07:21.941924
Resources for stage outliers : 0.535 s worker CPU, 0.607 s worker Wall, Wall: 1.744 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:07:22.018543
Stage halos : Wall: 1.03 s, CPU: 0.80 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.211928 MB
Stage halos finished: 2020-08-05T20:07:23.044881
Resources for stage halos : 0.282 s worker CPU, 0.907 s worker Wall, Wall: 1.028 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:07:23.203638
PSF sigmas in coadd pixels: ['1.97', '2.42', '3.24', '2.82']
Using average PSF sigma 2.611028781763592
Gaussian PSF norm 0.1080397097665619 vs pixelized 0.08807815
average tim pixel scale / coadd scale: 1.0011644973081912
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66', '2.26', '2.48']
Using average PSF sigma 2.4648898801348857
Gaussian PSF norm 0.1144451904514457 vs pixelized 0.10466065
average tim pixel scale / coadd scale: 1.001182742743888
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.32', '2.11', '1.43']
Using average PSF sigma 1.9543135153406652
Gaussian PSF norm 0.1443446967743581 vs pixelized 0.11621118
average tim pixel scale / coadd scale: 1.0011274898993492
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.13 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 209 MB, VmData: 235 MB, maxrss: 0.214308 MB
Stage fit_on_coadds finished: 2020-08-05T20:07:23.359168
Resources for stage fit_on_coadds : 0.132 s worker CPU, 0.132 s worker Wall, Wall: 0.157 s, Cores in use: 1.68, Total efficiency (on 16 cores): 10.5 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:07:23.383999
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 12 potential peaks
Of 12 potential peaks: 1 in veto map, 1 cut by saddle test, 0 cut by aper test, 10 kept
SED z : 10 new peaks
Found 17 potential peaks
Of 17 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 18 potential peaks
Of 18 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 19 potential peaks
Of 19 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 20 potential peaks
Of 20 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 19 new sources
Median coadd sky for g : -5.2497835e-05
Median coadd sky for r : -0.00012160049
Median coadd sky for z : 3.2591463e-05
Stage srcs : Wall: 0.93 s, CPU: 0.89 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.214836 MB
Stage srcs finished: 2020-08-05T20:07:24.310860
Resources for stage srcs : 0.069 s worker CPU, 0.069 s worker Wall, Wall: 0.928 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:07:24.337828
Blob 1 of 15, id: 4, sources: 4, size: 106x124, npix 9614, brick X: 76,182, Y: 63,187, one pixel: 152 63
Blob 2 of 15, id: 8, sources: 3, size: 44x42, npix 1190, brick X: 0,44, Y: 125,167, one pixel: 6 125
Blob 3 of 15, id: 11, sources: 2, size: 33x40, npix 767, brick X: 150,183, Y: 184,224, one pixel: 169 184
Blob 4 of 15, id: 2, sources: 1, size: 33x28, npix 614, brick X: 148,181, Y: 36,64, one pixel: 161 36
Blob 5 of 15, id: 12, sources: 1, size: 28x30, npix 570, brick X: 39,67, Y: 221,251, one pixel: 54 221
Blob 6 of 15, id: 5, sources: 1, size: 30x28, npix 555, brick X: 169,199, Y: 86,114, one pixel: 184 86
Blob 7 of 15, id: 10, sources: 1, size: 29x28, npix 552, brick X: 10,39, Y: 174,202, one pixel: 22 174
Blob 8 of 15, id: 14, sources: 1, size: 34x21, npix 521, brick X: 215,249, Y: 230,251, one pixel: 230 230
Blob 9 of 15, id: 7, sources: 1, size: 28x30, npix 511, brick X: 206,234, Y: 103,133, one pixel: 217 103
Blob 10 of 15, id: 0, sources: 1, size: 27x28, npix 454, brick X: 81,108, Y: 18,46, one pixel: 95 18
Blob 11 of 15, id: 13, sources: 1, size: 25x22, npix 383, brick X: 0,25, Y: 229,251, one pixel: 11 229
Blob 12 of 15, id: 6, sources: 1, size: 21x27, npix 373, brick X: 230,251, Y: 89,116, one pixel: 243 89
Blob 13 of 15, id: 9, sources: 1, size: 24x24, npix 354, brick X: 187,211, Y: 161,185, one pixel: 197 161
Blob 14 of 15, id: 1, sources: 1, size: 18x18, npix 180, brick X: 204,222, Y: 20,38, one pixel: 212 20
Blob 15 of 15, id: 3, sources: 1, size: 18x17, npix 162, brick X: 72,90, Y: 63,80, one pixel: 80 63
Blob 13 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147792 MB
Blob 15 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147724 MB
Blob 14 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092972 MB
Measuring 1 iterative sources
Blob 11 finished, total: Wall: 0.75 s, CPU: 0.73 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093632 MB
Blob 9 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114704 MB
Blob 3 finished, total: Wall: 0.84 s, CPU: 0.83 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148344 MB
Blob 7 finished, total: Wall: 0.92 s, CPU: 0.91 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.15 MB
Blob 4 finished, total: Wall: 0.94 s, CPU: 0.93 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150024 MB
Blob 5 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115812 MB
Blob 10 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 943 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151148 MB
Blob 6 finished, total: Wall: 1.23 s, CPU: 1.21 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.115092 MB
Blob 12 finished, total: Wall: 1.27 s, CPU: 1.25 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149052 MB
Blob 8 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 939 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.15284 MB
Blob 2 finished, total: Wall: 1.76 s, CPU: 1.75 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094004 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39574, ee1=-0.0100581, ee2=-0.12413
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 7.44 s, CPU: 7.44 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14998 MB
Old catalog: 25
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/blobs-custom-347787p05807.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/all-models-custom-347787p05807.fits
Stage fitblobs : Wall: 8.81 s, CPU: 1.19 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.215004 MB
Stage fitblobs finished: 2020-08-05T20:07:33.152457
Resources for stage fitblobs : 20.754 s worker CPU, 22.609 s worker Wall, Wall: 8.816 s, Cores in use: 2.49, Total efficiency (on 16 cores): 15.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:07:33.175094
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-resid.jpg
Stage coadds : Wall: 3.23 s, CPU: 1.05 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.21552 MB
Stage coadds finished: 2020-08-05T20:07:36.405842
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 10.340 s worker CPU, 15.478 s worker Wall, Wall: 3.232 s, Cores in use: 3.52, Total efficiency (on 16 cores): 22.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:07:36.427193
Cut to 1 unWISE tiles
Reading WISE tile 3478p060 band 1
Reading WISE tile 3478p060 band 4
Reading WISE tile 3478p060 band 2
Reading WISE tile 3478p060 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.21142 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 812 MB, VmRSS: 150 MB, VmData: 177 MB, maxrss: 0.19586 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212508 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 958 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211488 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.11 s, CPU: 1.43 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 235 MB, maxrss: 0.216224 MB
Stage wise_forced finished: 2020-08-05T20:07:41.532879
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 2.980 s worker CPU, 6.165 s worker Wall, Wall: 5.108 s, Cores in use: 0.86, Total efficiency (on 16 cores): 5.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:07:41.551558
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/tractor-i/cus/tractor-custom-347787p05807.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/tractor/cus/tractor-custom-347787p05807.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/tractor/cus/brick-custom-347787p05807.sha256sum
Stage writecat : Wall: 4.43 s, CPU: 2.01 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 213 MB, VmData: 235 MB, maxrss: 0.349032 MB
Stage writecat finished: 2020-08-05T20:07:45.983228
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.433 s, Cores in use: 0.45, Total efficiency (on 16 cores): 2.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-writecat.p
All done: 41.004 s worker CPU, 327.399 s worker Wall, Wall: 92.823 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 %
Finished galaxy PGC1289490 in 1.641 minutes.
Started working on galaxy PGC1289490 at Wed Aug  5 21:03:26 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.78769450000004 5.8071155999999995 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:03:28.179533
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.78769450000004', '5.8071155999999995', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.78769450000004 5.8071155999999995 --width 251 --height 251 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.78769450000004 5.8071155999999995
Starting process 6664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 6666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 6668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 6670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 6672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 6674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 6676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 6678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 6680 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 6682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 6684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 6686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 6688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 6699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 6700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 6701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 6702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 6703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 6705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 6706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 6708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 6709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 6710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 6711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 6712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 6713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 6714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 6715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:03:28.795806
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 10 CCDs:
  c4d_170730_060231_ooi_g_ls9-S3 g expnum 663315 exptime 104.0 propid 2014B-0404 seeing 1.21 MJD 57964.250 object DECaLS_7934_g 
    decam/CP/V4.8.2a/CP20170729/c4d_170730_060231_ooi_g_ls9.fits.fz
  c4d_180916_031231_ooi_z_ls9-S3 z expnum 774205 exptime 80.0 propid 2014B-0404 seeing 1.43 MJD 58377.134 object DECaLS_7934_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_031231_ooi_z_ls9.fits.fz
  c4d_180811_051548_ooi_r_ls9-S3 r expnum 764175 exptime 40.0 propid 2014B-0404 seeing 1.64 MJD 58341.219 object DECaLS_7934_r 
    decam/CP/V4.8.2a/CP20180810/c4d_180811_051548_ooi_r_ls9.fits.fz
  c4d_180901_080029_ooi_z_ls9-N2 z expnum 767625 exptime 103.0 propid 2014B-0404 seeing 1.30 MJD 58362.334 object DECaLS_39678_z 
    decam/CP/V4.8.2a/CP20180831/c4d_180901_080029_ooi_z_ls9.fits.fz
  c4d_180914_033108_ooi_g_ls9-N2 g expnum 773265 exptime 160.0 propid 2014B-0404 seeing 1.49 MJD 58375.147 object DECaLS_39678_g 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_033108_ooi_g_ls9.fits.fz
  c4d_180914_032938_ooi_r_ls9-N2 r expnum 773264 exptime 61.0 propid 2014B-0404 seeing 1.39 MJD 58375.146 object DECaLS_39678_r 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_032938_ooi_r_ls9.fits.fz
  c4d_170719_073656_ooi_g_ls9-N2 g expnum 660044 exptime 200.0 propid 2014B-0404 seeing 1.99 MJD 57953.314 object DECaLS_39678_g 
    decam/CP/V4.8.2/CP20170718/c4d_170719_073656_ooi_g_ls9.fits.fz
  c4d_170801_065120_ooi_g_ls9-N3 g expnum 663746 exptime 198.0 propid 2014B-0404 seeing 1.74 MJD 57966.283 object DECaLS_23806_g 
    decam/CP/V4.8.2a/CP20170731/c4d_170801_065120_ooi_g_ls9.fits.fz
  c4d_180902_031455_ooi_r_ls9-N3 r expnum 767887 exptime 68.0 propid 2014B-0404 seeing 1.52 MJD 58363.135 object DECaLS_23806_r 
    decam/CP/V4.8.2a/CP20180901/c4d_180902_031455_ooi_r_ls9.fits.fz
  c4d_160813_054711_ooi_z_ls9-N3 z expnum 563585 exptime 92.0 propid 2014B-0404 seeing 0.88 MJD 57613.239 object DECaLS_23806_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054711_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180901T080029_oi[N2,noinherit][2046,4094][real]: DECaLS_39678
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T073243_oi[N2,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[N3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S3,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S3,noinherit][2046,4094][real]: DECaLS_7
Clipping 1 pixels with anomalously large oow values: max 0.044433 vs median 0.0334596
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[N3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S3,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T032938_oi[N2,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[N3,noinherit][2046,4094][real]: DECaLS_23806
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T033108_oi[N2,noinherit][2046,4094][real]: DECaLS_3
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 104.42 s, CPU: 1.15 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 177 MB, VmData: 209 MB, maxrss: 0.18102 MB
Stage tims finished: 2020-08-05T21:05:13.214579
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T073243_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T032938_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[N3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[N3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[N3,noinherit][2046,4094][real]: DECaLS_23806 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 6.438 s worker CPU, 344.414 s worker Wall, Wall: 104.422 s, Cores in use: 0.07, Total efficiency (on 32 cores): 0.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-05T21:05:13.239344
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05435.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05691.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05564.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05563.fits
Matched 14 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/reference-custom-347787p05807.fits
Stage refs : Wall: 9.64 s, CPU: 1.63 s, VmPeak: 1042 MB, VmSize: 1028 MB, VmRSS: 194 MB, VmData: 225 MB, maxrss: 0.198724 MB
Stage refs finished: 2020-08-05T21:05:22.880036
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180901T080029_oi[N2,noinherit][2046,4094][real]: DECaLS_39678 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.643 s, Cores in use: 0.17, Total efficiency (on 32 cores): 0.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-refs.p
Running stage outliers
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T033108_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage outliers at 2020-08-05T21:05:23.068732
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outlier-mask-custom-347787p05807.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-pre-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outlier-mask-custom-347787p05807.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-post-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-masked-pos-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/outliers-masked-neg-custom-347787p05807.jpg
Stage outliers : Wall: 1.42 s, CPU: 1.09 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.212484 MB
Stage outliers finished: 2020-08-05T21:05:24.489219
Resources for stage outliers : 0.664 s worker CPU, 0.936 s worker Wall, Wall: 1.423 s, Cores in use: 1.23, Total efficiency (on 32 cores): 3.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:05:24.683099
Stage halos : Wall: 1.15 s, CPU: 0.86 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.21276 MB
Stage halos finished: 2020-08-05T21:05:25.832471
Resources for stage halos : 0.322 s worker CPU, 1.052 s worker Wall, Wall: 1.152 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T21:05:25.857525
PSF sigmas in coadd pixels: ['1.97', '2.42', '3.24', '2.82']
Using average PSF sigma 2.611028781763592
Gaussian PSF norm 0.1080397097665619 vs pixelized 0.08807815
average tim pixel scale / coadd scale: 1.0011644973081912
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66', '2.26', '2.48']
Using average PSF sigma 2.4648898801348857
Gaussian PSF norm 0.1144451904514457 vs pixelized 0.10466065
average tim pixel scale / coadd scale: 1.001182742743888
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.32', '2.11', '1.43']
Using average PSF sigma 1.9543135153406652
Gaussian PSF norm 0.1443446967743581 vs pixelized 0.11621118
average tim pixel scale / coadd scale: 1.0011274898993492
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.13 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.214452 MB
Stage fit_on_coadds finished: 2020-08-05T21:05:26.008075
Resources for stage fit_on_coadds : 0.112 s worker CPU, 0.112 s worker Wall, Wall: 0.153 s, Cores in use: 1.61, Total efficiency (on 32 cores): 5.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:05:26.021462
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 12 potential peaks
Of 12 potential peaks: 1 in veto map, 1 cut by saddle test, 0 cut by aper test, 10 kept
SED z : 10 new peaks
Found 17 potential peaks
Of 17 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 18 potential peaks
Of 18 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 19 potential peaks
Of 19 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 20 potential peaks
Of 20 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 19 new sources
Median coadd sky for g : -5.2497835e-05
Median coadd sky for r : -0.00012160049
Median coadd sky for z : 3.2591463e-05
Stage srcs : Wall: 0.73 s, CPU: 0.69 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.21486 MB
Stage srcs finished: 2020-08-05T21:05:26.748477
Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.729 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:05:26.763784
Blob 1 of 15, id: 4, sources: 4, size: 106x124, npix 9614, brick X: 76,182, Y: 63,187, one pixel: 152 63
Blob 2 of 15, id: 8, sources: 3, size: 44x42, npix 1190, brick X: 0,44, Y: 125,167, one pixel: 6 125
Blob 3 of 15, id: 11, sources: 2, size: 33x40, npix 767, brick X: 150,183, Y: 184,224, one pixel: 169 184
Blob 4 of 15, id: 2, sources: 1, size: 33x28, npix 614, brick X: 148,181, Y: 36,64, one pixel: 161 36
Blob 5 of 15, id: 12, sources: 1, size: 28x30, npix 570, brick X: 39,67, Y: 221,251, one pixel: 54 221
Blob 6 of 15, id: 5, sources: 1, size: 30x28, npix 555, brick X: 169,199, Y: 86,114, one pixel: 184 86
Blob 7 of 15, id: 10, sources: 1, size: 29x28, npix 552, brick X: 10,39, Y: 174,202, one pixel: 22 174
Blob 8 of 15, id: 14, sources: 1, size: 34x21, npix 521, brick X: 215,249, Y: 230,251, one pixel: 230 230
Blob 9 of 15, id: 7, sources: 1, size: 28x30, npix 511, brick X: 206,234, Y: 103,133, one pixel: 217 103
Blob 10 of 15, id: 0, sources: 1, size: 27x28, npix 454, brick X: 81,108, Y: 18,46, one pixel: 95 18
Blob 11 of 15, id: 13, sources: 1, size: 25x22, npix 383, brick X: 0,25, Y: 229,251, one pixel: 11 229
Blob 12 of 15, id: 6, sources: 1, size: 21x27, npix 373, brick X: 230,251, Y: 89,116, one pixel: 243 89
Blob 13 of 15, id: 9, sources: 1, size: 24x24, npix 354, brick X: 187,211, Y: 161,185, one pixel: 197 161
Blob 14 of 15, id: 1, sources: 1, size: 18x18, npix 180, brick X: 204,222, Y: 20,38, one pixel: 212 20
Blob 15 of 15, id: 3, sources: 1, size: 18x17, npix 162, brick X: 72,90, Y: 63,80, one pixel: 80 63
Blob 13 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149644 MB
Blob 15 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 943 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14806 MB
Blob 14 finished, total: Wall: 0.52 s, CPU: 0.51 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113508 MB
Measuring 1 iterative sources
Blob 11 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112224 MB
Blob 9 finished, total: Wall: 0.60 s, CPU: 0.59 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147712 MB
Blob 4 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093472 MB
Blob 3 finished, total: Wall: 0.74 s, CPU: 0.73 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14978 MB
Blob 7 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091876 MB
Blob 10 finished, total: Wall: 0.88 s, CPU: 0.87 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094496 MB
Blob 12 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151092 MB
Blob 5 finished, total: Wall: 0.95 s, CPU: 0.94 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113404 MB
Blob 6 finished, total: Wall: 0.99 s, CPU: 0.98 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095372 MB
Blob 8 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150668 MB
Blob 2 finished, total: Wall: 1.48 s, CPU: 1.48 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093784 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39574, ee1=-0.0100581, ee2=-0.12413
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 7.40 s, CPU: 7.39 s, VmPeak: 677 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.104308 MB
Old catalog: 25
New catalog: 22
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/blobs-custom-347787p05807.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/metrics/cus/all-models-custom-347787p05807.fits
Stage fitblobs : Wall: 8.26 s, CPU: 0.84 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.215028 MB
Stage fitblobs finished: 2020-08-05T21:05:35.024744
Resources for stage fitblobs : 18.151 s worker CPU, 18.347 s worker Wall, Wall: 8.263 s, Cores in use: 2.30, Total efficiency (on 32 cores): 7.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:05:35.044941
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-resid.jpg
Stage coadds : Wall: 4.09 s, CPU: 1.51 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 210 MB, VmData: 236 MB, maxrss: 0.21554 MB
Stage coadds finished: 2020-08-05T21:05:39.136952
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 26.807 s worker CPU, 51.096 s worker Wall, Wall: 4.095 s, Cores in use: 6.92, Total efficiency (on 32 cores): 21.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T21:05:39.150639
Cut to 1 unWISE tiles
Reading WISE tile 3478p060 band 1
Reading WISE tile 3478p060 band 2
Reading WISE tile 3478p060 band 3
Reading WISE tile 3478p060 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 807 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.19146 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.211132 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 804 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.205868 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 953 MB, VmSize: 809 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.211128 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.77 s, CPU: 0.59 s, VmPeak: 1042 MB, VmSize: 1037 MB, VmRSS: 211 MB, VmData: 236 MB, maxrss: 0.216248 MB
Stage wise_forced finished: 2020-08-05T21:05:41.924850
Resources for stage wise_forced : 3.164 s worker CPU, 5.714 s worker Wall, Wall: 2.777 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T21:05:41.943248
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/tractor-i/cus/tractor-custom-347787p05807.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/tractor/cus/tractor-custom-347787p05807.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/tractor/cus/brick-custom-347787p05807.sha256sum
Stage writecat : Wall: 1.25 s, CPU: 0.81 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 213 MB, VmData: 236 MB, maxrss: 0.349056 MB
Stage writecat finished: 2020-08-05T21:05:43.195132
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.254 s, Cores in use: 0.65, Total efficiency (on 32 cores): 2.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/347/PGC1289490/PGC1289490-largegalaxy-writecat.p
All done: 55.741 s worker CPU, 421.755 s worker Wall, Wall: 134.420 s, Cores in use: 0.49, Total efficiency (on 32 cores): 1.5 %
Finished galaxy PGC1289490 in 2.284 minutes.
Started working on galaxy PGC1289490 at Mon Aug 10 08:45:58 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.787510585515 5.807469300576259 --width 251 --height 251 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:45:59.189247
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.787510585515', '5.807469300576259', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.787510585515 5.807469300576259 --width 251 --height 251 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.787510585515 5.807469300576259
Starting process 23433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 23435 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 23437 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 23442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 23448 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 23451 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB
Starting process 23452 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB
Starting process 23454 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:45:59.863474
Keeping 10 CCDs:
  c4d_170730_060231_ooi_g_ls9-S3 g expnum 663315 exptime 104.0 propid 2014B-0404 seeing 1.21 MJD 57964.250 object DECaLS_7934_g 
    decam/CP/V4.8.2a/CP20170729/c4d_170730_060231_ooi_g_ls9.fits.fz
  c4d_180916_031231_ooi_z_ls9-S3 z expnum 774205 exptime 80.0 propid 2014B-0404 seeing 1.43 MJD 58377.134 object DECaLS_7934_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_031231_ooi_z_ls9.fits.fz
  c4d_180811_051548_ooi_r_ls9-S3 r expnum 764175 exptime 40.0 propid 2014B-0404 seeing 1.64 MJD 58341.219 object DECaLS_7934_r 
    decam/CP/V4.8.2a/CP20180810/c4d_180811_051548_ooi_r_ls9.fits.fz
  c4d_180901_080029_ooi_z_ls9-N2 z expnum 767625 exptime 103.0 propid 2014B-0404 seeing 1.30 MJD 58362.334 object DECaLS_39678_z 
    decam/CP/V4.8.2a/CP20180831/c4d_180901_080029_ooi_z_ls9.fits.fz
  c4d_180914_033108_ooi_g_ls9-N2 g expnum 773265 exptime 160.0 propid 2014B-0404 seeing 1.49 MJD 58375.147 object DECaLS_39678_g 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_033108_ooi_g_ls9.fits.fz
  c4d_180914_032938_ooi_r_ls9-N2 r expnum 773264 exptime 61.0 propid 2014B-0404 seeing 1.39 MJD 58375.146 object DECaLS_39678_r 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_032938_ooi_r_ls9.fits.fz
  c4d_170719_073656_ooi_g_ls9-N2 g expnum 660044 exptime 200.0 propid 2014B-0404 seeing 1.99 MJD 57953.314 object DECaLS_39678_g 
    decam/CP/V4.8.2/CP20170718/c4d_170719_073656_ooi_g_ls9.fits.fz
  c4d_170801_065120_ooi_g_ls9-N3 g expnum 663746 exptime 198.0 propid 2014B-0404 seeing 1.74 MJD 57966.283 object DECaLS_23806_g 
    decam/CP/V4.8.2a/CP20170731/c4d_170801_065120_ooi_g_ls9.fits.fz
  c4d_180902_031455_ooi_r_ls9-N3 r expnum 767887 exptime 68.0 propid 2014B-0404 seeing 1.52 MJD 58363.135 object DECaLS_23806_r 
    decam/CP/V4.8.2a/CP20180901/c4d_180902_031455_ooi_r_ls9.fits.fz
  c4d_160813_054711_ooi_z_ls9-N3 z expnum 563585 exptime 92.0 propid 2014B-0404 seeing 0.88 MJD 57613.239 object DECaLS_23806_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_054711_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S3,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[N3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T073243_oi[N2,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180901T080029_oi[N2,noinherit][2046,4094][real]: DECaLS_39678
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S3,noinherit][2046,4094][real]: DECaLS_7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T032938_oi[N2,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S3,noinherit][2046,4094][real]: DECaLS_7
Clipping 1 pixels with anomalously large oow values: max 0.044433 vs median 0.0334596
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[N3,noinherit][2046,4094][real]: DECaLS_23806
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[N3,noinherit][2046,4094][real]: DECaLS_2
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T033108_oi[N2,noinherit][2046,4094][real]: DECaLS_3
Stage tims : Wall: 101.93 s, CPU: 0.97 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179204 MB
Stage tims finished: 2020-08-10T08:47:41.797878
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535e75-r-20180914T032938_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521352-g-20170801T064709_oi[N3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T031231_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520b9e-g-20170730T055954_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532014-r-20180811T051548_oi[S3,noinherit][2046,4094][real]: DECaLS_7 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180901T080029_oi[N2,noinherit][2046,4094][real]: DECaLS_39678 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054449_oi[N3,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ba61-g-20170719T073243_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031455_oi[N3,noinherit][2046,4094][real]: DECaLS_23806 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T033108_oi[N2,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Resources for stage tims : 5.669 s worker CPU, 485.331 s worker Wall, Wall: 101.936 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-10T08:47:43.112090
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05435.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05691.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05564.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05563.fits
Matched 14 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/reference-custom-347787p05807.fits
Stage refs : Wall: 11.74 s, CPU: 1.99 s, VmPeak: 1035 MB, VmSize: 1021 MB, VmRSS: 192 MB, VmData: 225 MB, maxrss: 0.196912 MB
Stage refs finished: 2020-08-10T08:47:54.848878
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.738 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:47:54.917127
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/outlier-mask-custom-347787p05807.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/outliers-pre-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/outlier-mask-custom-347787p05807.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/outliers-post-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/outliers-masked-pos-custom-347787p05807.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/outliers-masked-neg-custom-347787p05807.jpg
Stage outliers : Wall: 1.35 s, CPU: 1.21 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 204 MB, VmData: 233 MB, maxrss: 0.208944 MB
Stage outliers finished: 2020-08-10T08:47:56.271903
Resources for stage outliers : 0.511 s worker CPU, 0.511 s worker Wall, Wall: 1.356 s, Cores in use: 1.27, Total efficiency (on 8 cores): 15.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:47:56.333871
Stage halos : Wall: 1.40 s, CPU: 0.62 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 204 MB, VmData: 234 MB, maxrss: 0.209184 MB
Stage halos finished: 2020-08-10T08:47:57.738411
Resources for stage halos : 0.259 s worker CPU, 1.350 s worker Wall, Wall: 1.406 s, Cores in use: 0.63, Total efficiency (on 8 cores): 7.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:47:58.823974
PSF sigmas in coadd pixels: ['1.97', '2.42', '3.24', '2.82']
Using average PSF sigma 2.611028781763592
Gaussian PSF norm 0.1080397097665619 vs pixelized 0.08807197
average tim pixel scale / coadd scale: 1.0011644973081912
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66', '2.26', '2.48']
Using average PSF sigma 2.4648898801348857
Gaussian PSF norm 0.1144451904514457 vs pixelized 0.10466673
average tim pixel scale / coadd scale: 1.001182742743888
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.32', '2.11', '1.43']
Using average PSF sigma 1.9543135153406652
Gaussian PSF norm 0.1443446967743581 vs pixelized 0.11620868
average tim pixel scale / coadd scale: 1.0011274898993492
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.14 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.211488 MB
Stage fit_on_coadds finished: 2020-08-10T08:47:58.974855
Resources for stage fit_on_coadds : 0.136 s worker CPU, 0.138 s worker Wall, Wall: 0.152 s, Cores in use: 1.83, Total efficiency (on 8 cores): 22.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:47:59.003729
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 12 potential peaks
Of 12 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 9 kept
SED z : 9 new peaks
Found 18 potential peaks
Of 18 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 18 potential peaks
Of 18 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 19 potential peaks
Of 19 potential peaks: 16 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 20 potential peaks
Of 20 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 18 new sources
Median coadd sky for g : -5.1984796e-05
Median coadd sky for r : -0.00011330338
Median coadd sky for z : 0.00010376325
Stage srcs : Wall: 0.58 s, CPU: 0.53 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.212044 MB
Stage srcs finished: 2020-08-10T08:47:59.581483
Resources for stage srcs : 0.085 s worker CPU, 0.085 s worker Wall, Wall: 0.579 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:47:59.591585
Blob 1 of 15, id: 4, sources: 3, size: 106x124, npix 9612, brick X: 73,179, Y: 58,182, one pixel: 149 58
Blob 2 of 15, id: 8, sources: 3, size: 41x42, npix 1110, brick X: 0,41, Y: 120,162, one pixel: 5 120
Blob 3 of 15, id: 11, sources: 2, size: 33x40, npix 778, brick X: 148,181, Y: 179,219, one pixel: 167 179
Blob 4 of 15, id: 14, sources: 1, size: 37x26, npix 692, brick X: 210,247, Y: 225,251, one pixel: 229 225
Blob 5 of 15, id: 2, sources: 1, size: 34x29, npix 607, brick X: 145,179, Y: 31,60, one pixel: 159 31
Blob 6 of 15, id: 12, sources: 1, size: 28x30, npix 577, brick X: 36,64, Y: 216,246, one pixel: 52 216
Blob 7 of 15, id: 5, sources: 1, size: 31x28, npix 564, brick X: 166,197, Y: 81,109, one pixel: 182 81
Blob 8 of 15, id: 10, sources: 1, size: 28x28, npix 539, brick X: 8,36, Y: 169,197, one pixel: 19 169
Blob 9 of 15, id: 7, sources: 1, size: 28x30, npix 506, brick X: 204,232, Y: 98,128, one pixel: 215 98
Blob 5 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.144976 MB
Blob 10 of 15, id: 0, sources: 1, size: 26x27, npix 449, brick X: 79,105, Y: 14,41, one pixel: 91 14
Blob 8 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145268 MB
Blob 11 of 15, id: 6, sources: 1, size: 23x27, npix 436, brick X: 228,251, Y: 84,111, one pixel: 240 84
Blob 3 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143668 MB
Blob 12 of 15, id: 13, sources: 1, size: 23x26, npix 393, brick X: 0,23, Y: 224,250, one pixel: 10 224
Blob 6 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 943 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145328 MB
Blob 13 of 15, id: 9, sources: 1, size: 24x24, npix 374, brick X: 184,208, Y: 156,180, one pixel: 194 156
Blob 7 finished, total: Wall: 1.32 s, CPU: 1.32 s, VmPeak: 939 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148172 MB
Blob 14 of 15, id: 1, sources: 1, size: 17x17, npix 145, brick X: 202,219, Y: 16,33, one pixel: 210 16
Blob 4 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146412 MB
Blob 15 of 15, id: 3, sources: 1, size: 17x17, npix 145, brick X: 70,87, Y: 58,75, one pixel: 78 58
Blob 13 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 939 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148896 MB
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.144976 MB
Blob 12 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 943 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 179 MB, maxrss: 0.1461 MB
Blob 15 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 939 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148896 MB
Blob 10 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145268 MB
Blob 2 finished, total: Wall: 2.14 s, CPU: 2.14 s, VmPeak: 939 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14852 MB
Blob 14 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146412 MB
Blob 11 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146328 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.785588, ee1=-0.0629917, ee2=-0.0412018
Blob 1 finished, total: Wall: 7.42 s, CPU: 7.42 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148304 MB
Old catalog: 24
New catalog: 19
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/blobs-custom-347787p05807.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/metrics/cus/all-models-custom-347787p05807.fits
Stage fitblobs : Wall: 7.84 s, CPU: 0.40 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 207 MB, VmData: 234 MB, maxrss: 0.212208 MB
Stage fitblobs finished: 2020-08-10T08:48:07.427387
Resources for stage fitblobs : 21.896 s worker CPU, 21.969 s worker Wall, Wall: 7.837 s, Cores in use: 2.85, Total efficiency (on 8 cores): 35.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:48:07.440457
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-resid.jpg
Stage coadds : Wall: 1.52 s, CPU: 0.69 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.212728 MB
Stage coadds finished: 2020-08-10T08:48:08.958059
Resources for stage coadds : 3.717 s worker CPU, 4.556 s worker Wall, Wall: 1.519 s, Cores in use: 2.90, Total efficiency (on 8 cores): 36.3 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:48:08.970410
Cut to 1 unWISE tiles
Reading WISE tile 3478p060 band 2
Reading WISE tile 3478p060 band 1
Reading WISE tile 3478p060 band 3
Reading WISE tile 3478p060 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 943 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.191424 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.211424 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208444 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3478p060/unwise-3478p060-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208368 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/tmp-legacysurvey-custom-347787p05807-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.28 s, CPU: 0.57 s, VmPeak: 1035 MB, VmSize: 1031 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.213436 MB
Stage wise_forced finished: 2020-08-10T08:48:12.250413
Resources for stage wise_forced : 3.188 s worker CPU, 5.919 s worker Wall, Wall: 3.281 s, Cores in use: 1.15, Total efficiency (on 8 cores): 14.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:48:12.263053
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/coadd/cus/custom-347787p05807/legacysurvey-custom-347787p05807-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/tractor-i/cus/tractor-custom-347787p05807.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/tractor/cus/tractor-custom-347787p05807.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/tractor/cus/brick-custom-347787p05807.sha256sum
Stage writecat : Wall: 0.72 s, CPU: 0.51 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.346424 MB
Stage writecat finished: 2020-08-10T08:48:12.985143
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.723 s, Cores in use: 0.70, Total efficiency (on 8 cores): 8.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1289490/PGC1289490-largegalaxy-writecat.p
All done: 35.462 s worker CPU, 519.860 s worker Wall, Wall: 133.139 s, Cores in use: 0.32, Total efficiency (on 8 cores): 4.1 %
Finished galaxy PGC1289490 in 2.252 minutes.