Started working on galaxy PGC979977 at Wed Aug  5 19:23:21 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.88082499999996 -10.297429 --width 241 --height 241 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:23:22.650281
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.88082499999996', '-10.297429', '--width', '241', '--height', '241', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.88082499999996 -10.297429 --width 241 --height 241 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.88082499999996 -10.297429
Starting process 51149 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 51151 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51153 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51155 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 51157 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 51159 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 51161 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 51163 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 51165 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 51167 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 51169 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51174 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51176 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51178 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 51179 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:23:25.074049
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  c4d_180916_004530_ooi_z_ls9-S25 z expnum 774131 exptime 80.0 propid 2014B-0404 seeing 1.55 MJD 58377.032 object DECaLS_11738_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_004530_ooi_z_ls9.fits.fz
  c4d_160803_041600_ooi_r_ls9-S25 r expnum 558548 exptime 50.0 propid 2014B-0404 seeing 1.13 MJD 57603.177 object DECaLS_11738_r 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_041600_ooi_r_ls9.fits.fz
  c4d_160803_041749_ooi_g_ls9-S25 g expnum 558549 exptime 81.0 propid 2014B-0404 seeing 1.17 MJD 57603.178 object DECaLS_11738_g 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_041749_ooi_g_ls9.fits.fz
  c4d_180517_090600_ooi_g_ls9-N29 g expnum 747155 exptime 200.0 propid 2014B-0404 seeing 1.11 MJD 58255.379 object DECaLS_43483_g 
    decam/CP/V4.8.2a/CP20180516/c4d_180517_090600_ooi_g_ls9.fits.fz
  c4d_170801_013404_ooi_z_ls9-N29 z expnum 663641 exptime 250.0 propid 2014B-0404 seeing 1.55 MJD 57966.062 object DECaLS_43483_z 
    decam/CP/V4.8.2/CP20170731/c4d_170801_013404_ooi_z_ls9.fits.fz
  c4d_180903_012206_ooi_g_ls9-N27 g expnum 768258 exptime 108.0 propid 2014B-0404 seeing 1.31 MJD 58364.057 object DECaLS_27611_g 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_012206_ooi_g_ls9.fits.fz
  c4d_180903_010924_ooi_r_ls9-N27 r expnum 768252 exptime 81.0 propid 2014B-0404 seeing 0.99 MJD 58364.048 object DECaLS_27611_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_010924_ooi_r_ls9.fits.fz
  c4d_180914_004001_ooi_z_ls9-N27 z expnum 773180 exptime 145.0 propid 2014B-0404 seeing 1.46 MJD 58375.028 object DECaLS_27611_z 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_004001_ooi_z_ls9.fits.fz
  c4d_180812_030737_ooi_g_ls9-N28 g expnum 764575 exptime 77.0 propid 2014B-0404 seeing 1.06 MJD 58342.130 object DECaLS_11739_g 
    decam/CP/V4.8.2a/CP20180811/c4d_180812_030737_ooi_g_ls9.fits.fz
  c4d_180812_030629_ooi_r_ls9-N28 r expnum 764574 exptime 40.0 propid 2014B-0404 seeing 0.91 MJD 58342.130 object DECaLS_11739_r 
    decam/CP/V4.8.2a/CP20180811/c4d_180812_030629_ooi_r_ls9.fits.fz
  c4d_180916_004153_ooi_z_ls9-N28 z expnum 774129 exptime 80.0 propid 2014B-0404 seeing 1.20 MJD 58377.029 object DECaLS_11739_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_004153_ooi_z_ls9.fits.fz
  c4d_180906_005716_ooi_g_ls9-S9 g expnum 769484 exptime 56.0 propid 2014B-0404 seeing 0.92 MJD 58367.040 object DECaLS_59186_g 
    decam/CP/V4.8.2a/CP20180905/c4d_180906_005716_ooi_g_ls9.fits.fz
  c4d_180905_012852_ooi_g_ls9-S12 g expnum 768986 exptime 68.0 propid 2014B-0404 seeing 1.19 MJD 58366.062 object DECaLS_51299_g 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_012852_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T041539_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004530_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d60f-z-20180914T004001_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041420_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005716_oi[S9,noinherit][2046,4094][real]: DECaLS_5
Clipping 1 pixels with anomalously large oow values: max 0.0662022 vs median 0.0500784
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530903-g-20180517T090600_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T030629_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T012901_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T012852_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532e22-g-20180812T030737_oi[N28,noinherit][2046,4094][real]: DECaLS_
Clipping 1 pixels with anomalously large oow values: max 0.0502192 vs median 0.0383018
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004153_oi[N28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T012206_oi[N27,noinherit][2046,4094][real]: DECaLS_2761
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T010924_oi[N27,noinherit][2046,4094][real]: DECaLS_2761
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 31.63 s, CPU: 2.13 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 179 MB, VmData: 211 MB, maxrss: 0.183028 MB
Stage tims finished: 2020-08-05T19:23:56.704249
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004530_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d60f-z-20180914T004001_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041420_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T012901_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004153_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005716_oi[S9,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530903-g-20180517T090600_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T012852_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T012206_oi[N27,noinherit][2046,4094][real]: DECaLS_2761 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T030629_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 8.425 s worker CPU, 213.696 s worker Wall, Wall: 31.632 s, Cores in use: 0.33, Total efficiency (on 16 cores): 2.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T041539_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532e22-g-20180812T030737_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T010924_oi[N27,noinherit][2046,4094][real]: DECaLS_2761 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:23:56.882453
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07219.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07347.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/reference-custom-323880m10297.fits
Stage refs : Wall: 9.58 s, CPU: 2.89 s, VmPeak: 1047 MB, VmSize: 1042 MB, VmRSS: 210 MB, VmData: 241 MB, maxrss: 0.21512 MB
Stage refs finished: 2020-08-05T19:24:06.467069
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.586 s, Cores in use: 0.30, Total efficiency (on 16 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:24:06.566747
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outlier-mask-custom-323880m10297.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-pre-custom-323880m10297.jpg
Image c4d_180903_012206_ooi_g_ls9-N27 g : masking 2571 positive outlier pixels and 0 negative outlier pixels
Image c4d_180812_030737_ooi_g_ls9-N28 g : masking 0 positive outlier pixels and 162 negative outlier pixels
Image c4d_180906_005716_ooi_g_ls9-S9 g : masking 157 positive outlier pixels and 61 negative outlier pixels
Image c4d_180517_090600_ooi_g_ls9-N29 g : masking 515 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_010924_ooi_r_ls9-N27 r : masking 1043 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outlier-mask-custom-323880m10297.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-post-custom-323880m10297.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-masked-pos-custom-323880m10297.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-masked-neg-custom-323880m10297.jpg
Stage outliers : Wall: 2.03 s, CPU: 1.77 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 224 MB, VmData: 253 MB, maxrss: 0.229808 MB
Stage outliers finished: 2020-08-05T19:24:08.601555
Resources for stage outliers : 0.964 s worker CPU, 1.078 s worker Wall, Wall: 2.036 s, Cores in use: 1.34, Total efficiency (on 16 cores): 8.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:24:08.652315
Stage halos : Wall: 0.96 s, CPU: 0.78 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 224 MB, VmData: 253 MB, maxrss: 0.229884 MB
Stage halos finished: 2020-08-05T19:24:09.613138
Resources for stage halos : 0.710 s worker CPU, 1.850 s worker Wall, Wall: 0.963 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:24:09.667221
PSF sigmas in coadd pixels: ['1.90', '1.80', '2.13', '1.72', '1.50', '1.94']
Using average PSF sigma 1.8308040824819927
Gaussian PSF norm 0.15408245725094005 vs pixelized 0.12758102
average tim pixel scale / coadd scale: 1.0010949647025638
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.61', '1.48']
Using average PSF sigma 1.63965182399422
Gaussian PSF norm 0.17204554506376263 vs pixelized 0.13865887
average tim pixel scale / coadd scale: 1.0011149597005875
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.52', '2.53', '2.38', '1.94']
Using average PSF sigma 2.3425976973879363
Gaussian PSF norm 0.12041964870383932 vs pixelized 0.09880191
average tim pixel scale / coadd scale: 1.0010997635020895
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.17 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 226 MB, VmData: 253 MB, maxrss: 0.231484 MB
Stage fit_on_coadds finished: 2020-08-05T19:24:09.880824
Resources for stage fit_on_coadds : 0.260 s worker CPU, 0.260 s worker Wall, Wall: 0.215 s, Cores in use: 2.01, Total efficiency (on 16 cores): 12.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:24:09.893146
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 1181 potential peaks
Of 1181 potential peaks: 1166 in veto map, 3 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 276 potential peaks
Of 276 potential peaks: 274 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 53 potential peaks
Of 53 potential peaks: 45 in veto map, 1 cut by saddle test, 0 cut by aper test, 7 kept
SED g : 7 new peaks
Found 70 potential peaks
Of 70 potential peaks: 69 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 88 potential peaks
Of 88 potential peaks: 85 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : -3.62188e-05
Median coadd sky for r : -4.5984038e-05
Median coadd sky for z : 0.0010169529
Stage srcs : Wall: 0.71 s, CPU: 0.68 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 227 MB, VmData: 253 MB, maxrss: 0.232016 MB
Stage srcs finished: 2020-08-05T19:24:10.602908
Resources for stage srcs : 0.075 s worker CPU, 0.075 s worker Wall, Wall: 0.711 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:24:10.659589
Blob 1 of 7, id: 1, sources: 18, size: 241x173, npix 20466, brick X: 0,241, Y: 46,219, one pixel: 28 46
Blob 2 of 7, id: 3, sources: 3, size: 73x51, npix 2094, brick X: 24,97, Y: 158,209, one pixel: 41 158
Blob 3 of 7, id: 5, sources: 3, size: 32x40, npix 771, brick X: 13,45, Y: 201,241, one pixel: 29 201
Blob 4 of 7, id: 6, sources: 2, size: 44x25, npix 761, brick X: 186,230, Y: 216,241, one pixel: 215 216
Blob 5 of 7, id: 2, sources: 1, size: 28x29, npix 513, brick X: 194,222, Y: 154,183, one pixel: 207 154
Blob 6 of 7, id: 4, sources: 1, size: 24x27, npix 436, brick X: 191,215, Y: 190,217, one pixel: 199 190
Blob 7 of 7, id: 0, sources: 1, size: 23x23, npix 316, brick X: 208,231, Y: 18,41, one pixel: 218 18
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.87453, -10.28804), pm (-20.2, -17.1), parallax 1.021 with NanoMaggies: g=18, r=17.3, z=16.4
Reset brightness to NanoMaggies: g=17.6, r=16.6, z=16.1
Blob 4 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 107 MB, VmData: 165 MB, maxrss: 0.109524 MB
Blob 5 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.114468 MB
Blob 7 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149748 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.88795, -10.28846), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.8, r=20.6, z=20.5
Reset brightness to NanoMaggies: g=20.8, r=20.7, z=20.7
Blob 3 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149856 MB
Blob 6 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150656 MB
Blob 2 finished, total: Wall: 2.95 s, CPU: 2.95 s, VmPeak: 946 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150592 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.85637, -10.29920), pm (-8.8, -10.0), parallax 0.899 with NanoMaggies: g=9.91, r=8.65, z=7.93
Reset brightness to NanoMaggies: g=9.91, r=8.65, z=7.93
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.32552, ee1=-0.337955, ee2=-0.0428568
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 14.19 s, CPU: 14.19 s, VmPeak: 943 MB, VmSize: 736 MB, VmRSS: 157 MB, VmData: 185 MB, maxrss: 0.160576 MB
Old catalog: 31
New catalog: 27
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/blobs-custom-323880m10297.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/all-models-custom-323880m10297.fits
Stage fitblobs : Wall: 14.87 s, CPU: 0.61 s, VmPeak: 1051 MB, VmSize: 1038 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.23218 MB
Stage fitblobs finished: 2020-08-05T19:24:25.529236
Resources for stage fitblobs : 19.224 s worker CPU, 19.329 s worker Wall, Wall: 14.871 s, Cores in use: 1.33, Total efficiency (on 16 cores): 8.3 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:24:25.551600
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-resid.jpg
Stage coadds : Wall: 4.01 s, CPU: 1.04 s, VmPeak: 1051 MB, VmSize: 1038 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.23218 MB
Stage coadds finished: 2020-08-05T19:24:29.566139
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 8.296 s worker CPU, 14.600 s worker Wall, Wall: 4.016 s, Cores in use: 2.33, Total efficiency (on 16 cores): 14.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:24:29.588536
Cut to 1 unWISE tiles
Reading WISE tile 3246m107 band 3
Reading WISE tile 3246m107 band 4
Reading WISE tile 3246m107 band 2
Reading WISE tile 3246m107 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 802 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.205996 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 946 MB, VmSize: 810 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.192632 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 959 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206648 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 954 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206828 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 10.60 s, CPU: 1.59 s, VmPeak: 1051 MB, VmSize: 1038 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.23218 MB
Stage wise_forced finished: 2020-08-05T19:24:40.189789
Resources for stage wise_forced : 3.112 s worker CPU, 6.793 s worker Wall, Wall: 10.603 s, Cores in use: 0.44, Total efficiency (on 16 cores): 2.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:24:40.298367
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/tractor-i/cus/tractor-custom-323880m10297.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/tractor/cus/tractor-custom-323880m10297.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/tractor/cus/brick-custom-323880m10297.sha256sum
Stage writecat : Wall: 1.56 s, CPU: 1.00 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 216 MB, VmData: 239 MB, maxrss: 0.352196 MB
Stage writecat finished: 2020-08-05T19:24:41.853578
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.557 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-writecat.p
All done: 41.069 s worker CPU, 257.685 s worker Wall, Wall: 76.814 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 %
Finished galaxy PGC979977 in 1.344 minutes.
Started working on galaxy PGC979977 at Wed Aug  5 19:53:36 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.88082499999996 -10.297429 --width 241 --height 241 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:53:37.819693
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.88082499999996', '-10.297429', '--width', '241', '--height', '241', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.88082499999996 -10.297429 --width 241 --height 241 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.88082499999996 -10.297429
Starting process 57376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 57377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 57378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 57379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 57380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059468 MB
Starting process 57381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB
Starting process 57382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059416 MB
Starting process 57383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 57386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 57387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57391 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 57393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 57394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 57395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 57396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 57397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 57398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 57399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 57400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 57401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 57402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 57403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 57404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 57405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 57406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 57407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:53:38.383829
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 13 CCDs:
  c4d_180916_004530_ooi_z_ls9-S25 z expnum 774131 exptime 80.0 propid 2014B-0404 seeing 1.55 MJD 58377.032 object DECaLS_11738_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_004530_ooi_z_ls9.fits.fz
  c4d_160803_041600_ooi_r_ls9-S25 r expnum 558548 exptime 50.0 propid 2014B-0404 seeing 1.13 MJD 57603.177 object DECaLS_11738_r 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_041600_ooi_r_ls9.fits.fz
  c4d_160803_041749_ooi_g_ls9-S25 g expnum 558549 exptime 81.0 propid 2014B-0404 seeing 1.17 MJD 57603.178 object DECaLS_11738_g 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_041749_ooi_g_ls9.fits.fz
  c4d_180517_090600_ooi_g_ls9-N29 g expnum 747155 exptime 200.0 propid 2014B-0404 seeing 1.11 MJD 58255.379 object DECaLS_43483_g 
    decam/CP/V4.8.2a/CP20180516/c4d_180517_090600_ooi_g_ls9.fits.fz
  c4d_170801_013404_ooi_z_ls9-N29 z expnum 663641 exptime 250.0 propid 2014B-0404 seeing 1.55 MJD 57966.062 object DECaLS_43483_z 
    decam/CP/V4.8.2/CP20170731/c4d_170801_013404_ooi_z_ls9.fits.fz
  c4d_180903_012206_ooi_g_ls9-N27 g expnum 768258 exptime 108.0 propid 2014B-0404 seeing 1.31 MJD 58364.057 object DECaLS_27611_g 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_012206_ooi_g_ls9.fits.fz
  c4d_180903_010924_ooi_r_ls9-N27 r expnum 768252 exptime 81.0 propid 2014B-0404 seeing 0.99 MJD 58364.048 object DECaLS_27611_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_010924_ooi_r_ls9.fits.fz
  c4d_180914_004001_ooi_z_ls9-N27 z expnum 773180 exptime 145.0 propid 2014B-0404 seeing 1.46 MJD 58375.028 object DECaLS_27611_z 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_004001_ooi_z_ls9.fits.fz
  c4d_180812_030737_ooi_g_ls9-N28 g expnum 764575 exptime 77.0 propid 2014B-0404 seeing 1.06 MJD 58342.130 object DECaLS_11739_g 
    decam/CP/V4.8.2a/CP20180811/c4d_180812_030737_ooi_g_ls9.fits.fz
  c4d_180812_030629_ooi_r_ls9-N28 r expnum 764574 exptime 40.0 propid 2014B-0404 seeing 0.91 MJD 58342.130 object DECaLS_11739_r 
    decam/CP/V4.8.2a/CP20180811/c4d_180812_030629_ooi_r_ls9.fits.fz
  c4d_180916_004153_ooi_z_ls9-N28 z expnum 774129 exptime 80.0 propid 2014B-0404 seeing 1.20 MJD 58377.029 object DECaLS_11739_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_004153_ooi_z_ls9.fits.fz
  c4d_180906_005716_ooi_g_ls9-S9 g expnum 769484 exptime 56.0 propid 2014B-0404 seeing 0.92 MJD 58367.040 object DECaLS_59186_g 
    decam/CP/V4.8.2a/CP20180905/c4d_180906_005716_ooi_g_ls9.fits.fz
  c4d_180905_012852_ooi_g_ls9-S12 g expnum 768986 exptime 68.0 propid 2014B-0404 seeing 1.19 MJD 58366.062 object DECaLS_51299_g 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_012852_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T041539_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041420_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005716_oi[S9,noinherit][2046,4094][real]: DECaLS_5
Clipping 1 pixels with anomalously large oow values: max 0.0662022 vs median 0.0500784
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004530_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T012206_oi[N27,noinherit][2046,4094][real]: DECaLS_2761
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530903-g-20180517T090600_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T012852_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d60f-z-20180914T004001_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532e22-g-20180812T030737_oi[N28,noinherit][2046,4094][real]: DECaLS_
Clipping 1 pixels with anomalously large oow values: max 0.0502192 vs median 0.0383018
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T030629_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T012901_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004153_oi[N28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T010924_oi[N27,noinherit][2046,4094][real]: DECaLS_2761
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 43.79 s, CPU: 1.99 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 179 MB, VmData: 211 MB, maxrss: 0.183484 MB
Stage tims finished: 2020-08-05T19:54:22.170614
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T041539_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041420_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T012206_oi[N27,noinherit][2046,4094][real]: DECaLS_2761 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532e22-g-20180812T030737_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T012901_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530903-g-20180517T090600_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T012852_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T010924_oi[N27,noinherit][2046,4094][real]: DECaLS_2761 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T030629_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 7.675 s worker CPU, 253.737 s worker Wall, Wall: 43.789 s, Cores in use: 0.22, Total efficiency (on 32 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004530_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004153_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d60f-z-20180914T004001_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005716_oi[S9,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:54:22.352779
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07219.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07347.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/reference-custom-323880m10297.fits
Stage refs : Wall: 5.62 s, CPU: 3.37 s, VmPeak: 1047 MB, VmSize: 1042 MB, VmRSS: 210 MB, VmData: 241 MB, maxrss: 0.215336 MB
Stage refs finished: 2020-08-05T19:54:27.976079
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.625 s, Cores in use: 0.60, Total efficiency (on 32 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:54:28.176668
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outlier-mask-custom-323880m10297.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-pre-custom-323880m10297.jpg
Image c4d_180517_090600_ooi_g_ls9-N29 g : masking 515 positive outlier pixels and 0 negative outlier pixels
Image c4d_180906_005716_ooi_g_ls9-S9 g : masking 157 positive outlier pixels and 61 negative outlier pixels
Image c4d_180903_012206_ooi_g_ls9-N27 g : masking 2571 positive outlier pixels and 0 negative outlier pixels
Image c4d_180812_030737_ooi_g_ls9-N28 g : masking 0 positive outlier pixels and 162 negative outlier pixels
Image c4d_180903_010924_ooi_r_ls9-N27 r : masking 1043 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outlier-mask-custom-323880m10297.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-post-custom-323880m10297.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-masked-pos-custom-323880m10297.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/outliers-masked-neg-custom-323880m10297.jpg
Stage outliers : Wall: 1.53 s, CPU: 1.16 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 224 MB, VmData: 253 MB, maxrss: 0.229864 MB
Stage outliers finished: 2020-08-05T19:54:29.703176
Resources for stage outliers : 1.056 s worker CPU, 1.357 s worker Wall, Wall: 1.529 s, Cores in use: 1.45, Total efficiency (on 32 cores): 4.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:54:29.777776
Stage halos : Wall: 1.30 s, CPU: 1.16 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 224 MB, VmData: 253 MB, maxrss: 0.229888 MB
Stage halos finished: 2020-08-05T19:54:31.077859
Resources for stage halos : 0.778 s worker CPU, 1.510 s worker Wall, Wall: 1.302 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:54:31.288078
PSF sigmas in coadd pixels: ['1.90', '1.80', '2.13', '1.72', '1.50', '1.94']
Using average PSF sigma 1.8308040824819927
Gaussian PSF norm 0.15408245725094005 vs pixelized 0.127581
average tim pixel scale / coadd scale: 1.0010949647025638
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.61', '1.48']
Using average PSF sigma 1.63965182399422
Gaussian PSF norm 0.17204554506376263 vs pixelized 0.13865887
average tim pixel scale / coadd scale: 1.0011149597005875
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.52', '2.53', '2.38', '1.94']
Using average PSF sigma 2.3425976973879363
Gaussian PSF norm 0.12041964870383932 vs pixelized 0.09880191
average tim pixel scale / coadd scale: 1.0010997635020895
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.16 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 226 MB, VmData: 253 MB, maxrss: 0.231492 MB
Stage fit_on_coadds finished: 2020-08-05T19:54:31.458077
Resources for stage fit_on_coadds : 0.234 s worker CPU, 0.235 s worker Wall, Wall: 0.172 s, Cores in use: 2.31, Total efficiency (on 32 cores): 7.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:54:31.472081
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 1181 potential peaks
Of 1181 potential peaks: 1166 in veto map, 3 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 276 potential peaks
Of 276 potential peaks: 274 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 53 potential peaks
Of 53 potential peaks: 45 in veto map, 1 cut by saddle test, 0 cut by aper test, 7 kept
SED g : 7 new peaks
Found 61 potential peaks
Of 61 potential peaks: 60 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 93 potential peaks
Of 93 potential peaks: 90 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : -3.6218793e-05
Median coadd sky for r : -4.5984038e-05
Median coadd sky for z : 0.0010169529
Stage srcs : Wall: 0.53 s, CPU: 0.49 s, VmPeak: 1051 MB, VmSize: 1051 MB, VmRSS: 227 MB, VmData: 253 MB, maxrss: 0.232024 MB
Stage srcs finished: 2020-08-05T19:54:31.999306
Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 0.529 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:54:32.018215
Blob 1 of 7, id: 1, sources: 18, size: 241x173, npix 20466, brick X: 0,241, Y: 46,219, one pixel: 28 46
Blob 2 of 7, id: 3, sources: 3, size: 73x51, npix 2094, brick X: 24,97, Y: 158,209, one pixel: 41 158
Blob 3 of 7, id: 5, sources: 3, size: 32x40, npix 771, brick X: 13,45, Y: 201,241, one pixel: 29 201
Blob 4 of 7, id: 6, sources: 2, size: 44x25, npix 761, brick X: 186,230, Y: 216,241, one pixel: 215 216
Blob 5 of 7, id: 2, sources: 1, size: 28x29, npix 513, brick X: 194,222, Y: 154,183, one pixel: 207 154
Blob 6 of 7, id: 4, sources: 1, size: 24x27, npix 436, brick X: 191,215, Y: 190,217, one pixel: 199 190
Blob 7 of 7, id: 0, sources: 1, size: 23x23, npix 316, brick X: 208,231, Y: 18,41, one pixel: 218 18
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.87453, -10.28804), pm (-20.2, -17.1), parallax 1.021 with NanoMaggies: g=18, r=17.3, z=16.4
Reset brightness to NanoMaggies: g=17.6, r=16.6, z=16.1
Blob 4 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 946 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149968 MB
Blob 5 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113924 MB
Blob 7 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.1154 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.88795, -10.28846), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.8, r=20.6, z=20.5
Reset brightness to NanoMaggies: g=20.8, r=20.7, z=20.7
Blob 3 finished, total: Wall: 0.57 s, CPU: 0.56 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093076 MB
Blob 6 finished, total: Wall: 0.76 s, CPU: 0.75 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093484 MB
Blob 2 finished, total: Wall: 2.97 s, CPU: 2.96 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095272 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.85637, -10.29920), pm (-8.8, -10.0), parallax 0.899 with NanoMaggies: g=9.91, r=8.65, z=7.93
Reset brightness to NanoMaggies: g=9.91, r=8.65, z=7.93
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.32552, ee1=-0.337955, ee2=-0.0428569
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 14.13 s, CPU: 14.11 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 125 MB, VmData: 164 MB, maxrss: 0.128744 MB
Old catalog: 31
New catalog: 27
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/blobs-custom-323880m10297.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/metrics/cus/all-models-custom-323880m10297.fits
Stage fitblobs : Wall: 14.65 s, CPU: 0.46 s, VmPeak: 1051 MB, VmSize: 1037 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.232188 MB
Stage fitblobs finished: 2020-08-05T19:54:46.666503
Resources for stage fitblobs : 19.192 s worker CPU, 19.266 s worker Wall, Wall: 14.651 s, Cores in use: 1.34, Total efficiency (on 32 cores): 4.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:54:46.690561
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-resid.jpg
Stage coadds : Wall: 4.31 s, CPU: 1.64 s, VmPeak: 1051 MB, VmSize: 1037 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.232188 MB
Stage coadds finished: 2020-08-05T19:54:51.000303
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 25.597 s worker CPU, 45.458 s worker Wall, Wall: 4.312 s, Cores in use: 6.32, Total efficiency (on 32 cores): 19.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T19:54:51.020694
Cut to 1 unWISE tiles
Reading WISE tile 3246m107 band 3
Reading WISE tile 3246m107 band 4
Reading WISE tile 3246m107 band 1
Reading WISE tile 3246m107 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 805 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206316 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 946 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.192696 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 139 MB, VmData: 172 MB, maxrss: 0.199284 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 938 MB, VmSize: 865 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.210004 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.03 s, CPU: 1.29 s, VmPeak: 1051 MB, VmSize: 1037 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.232188 MB
Stage wise_forced finished: 2020-08-05T19:54:54.052482
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.188 s worker CPU, 5.290 s worker Wall, Wall: 3.034 s, Cores in use: 1.48, Total efficiency (on 32 cores): 4.6 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T19:54:54.070561
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/tractor-i/cus/tractor-custom-323880m10297.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/tractor/cus/tractor-custom-323880m10297.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/tractor/cus/brick-custom-323880m10297.sha256sum
Stage writecat : Wall: 1.90 s, CPU: 0.92 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 216 MB, VmData: 239 MB, maxrss: 0.351948 MB
Stage writecat finished: 2020-08-05T19:54:55.973205
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.905 s, Cores in use: 0.48, Total efficiency (on 32 cores): 1.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC979977/PGC979977-largegalaxy-writecat.p
All done: 57.812 s worker CPU, 326.944 s worker Wall, Wall: 77.616 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 %
Finished galaxy PGC979977 in 1.324 minutes.
Started working on galaxy PGC979977 at Mon Aug 10 08:34:46 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.88059355579423 -10.297575687992103 --width 241 --height 241 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:34:47.972924
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.88059355579423', '-10.297575687992103', '--width', '241', '--height', '241', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.88059355579423 -10.297575687992103 --width 241 --height 241 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.88059355579423 -10.297575687992103
Starting process 12594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 12595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 12596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 12597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 12598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059524 MB
Starting process 12599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 12600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 12601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:34:48.525972
Keeping 13 CCDs:
  c4d_180916_004530_ooi_z_ls9-S25 z expnum 774131 exptime 80.0 propid 2014B-0404 seeing 1.55 MJD 58377.032 object DECaLS_11738_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_004530_ooi_z_ls9.fits.fz
  c4d_160803_041600_ooi_r_ls9-S25 r expnum 558548 exptime 50.0 propid 2014B-0404 seeing 1.13 MJD 57603.177 object DECaLS_11738_r 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_041600_ooi_r_ls9.fits.fz
  c4d_160803_041749_ooi_g_ls9-S25 g expnum 558549 exptime 81.0 propid 2014B-0404 seeing 1.17 MJD 57603.178 object DECaLS_11738_g 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_041749_ooi_g_ls9.fits.fz
  c4d_180517_090600_ooi_g_ls9-N29 g expnum 747155 exptime 200.0 propid 2014B-0404 seeing 1.11 MJD 58255.379 object DECaLS_43483_g 
    decam/CP/V4.8.2a/CP20180516/c4d_180517_090600_ooi_g_ls9.fits.fz
  c4d_170801_013404_ooi_z_ls9-N29 z expnum 663641 exptime 250.0 propid 2014B-0404 seeing 1.55 MJD 57966.062 object DECaLS_43483_z 
    decam/CP/V4.8.2/CP20170731/c4d_170801_013404_ooi_z_ls9.fits.fz
  c4d_180903_012206_ooi_g_ls9-N27 g expnum 768258 exptime 108.0 propid 2014B-0404 seeing 1.31 MJD 58364.057 object DECaLS_27611_g 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_012206_ooi_g_ls9.fits.fz
  c4d_180903_010924_ooi_r_ls9-N27 r expnum 768252 exptime 81.0 propid 2014B-0404 seeing 0.99 MJD 58364.048 object DECaLS_27611_r 
    decam/CP/V4.8.2a/CP20180902/c4d_180903_010924_ooi_r_ls9.fits.fz
  c4d_180914_004001_ooi_z_ls9-N27 z expnum 773180 exptime 145.0 propid 2014B-0404 seeing 1.46 MJD 58375.028 object DECaLS_27611_z 
    decam/CP/V4.8.2a/CP20180913/c4d_180914_004001_ooi_z_ls9.fits.fz
  c4d_180812_030737_ooi_g_ls9-N28 g expnum 764575 exptime 77.0 propid 2014B-0404 seeing 1.06 MJD 58342.130 object DECaLS_11739_g 
    decam/CP/V4.8.2a/CP20180811/c4d_180812_030737_ooi_g_ls9.fits.fz
  c4d_180812_030629_ooi_r_ls9-N28 r expnum 764574 exptime 40.0 propid 2014B-0404 seeing 0.91 MJD 58342.130 object DECaLS_11739_r 
    decam/CP/V4.8.2a/CP20180811/c4d_180812_030629_ooi_r_ls9.fits.fz
  c4d_180916_004153_ooi_z_ls9-N28 z expnum 774129 exptime 80.0 propid 2014B-0404 seeing 1.20 MJD 58377.029 object DECaLS_11739_z 
    decam/CP/V4.8.2a/CP20180915/c4d_180916_004153_ooi_z_ls9.fits.fz
  c4d_180906_005716_ooi_g_ls9-S9 g expnum 769484 exptime 56.0 propid 2014B-0404 seeing 0.92 MJD 58367.040 object DECaLS_59186_g 
    decam/CP/V4.8.2a/CP20180905/c4d_180906_005716_ooi_g_ls9.fits.fz
  c4d_180905_012852_ooi_g_ls9-S12 g expnum 768986 exptime 68.0 propid 2014B-0404 seeing 1.19 MJD 58366.062 object DECaLS_51299_g 
    decam/CP/V4.8.2a/CP20180904/c4d_180905_012852_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T041539_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041420_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T012901_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004530_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T012206_oi[N27,noinherit][2046,4094][real]: DECaLS_2761
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530903-g-20180517T090600_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d60f-z-20180914T004001_oi[N27,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532e22-g-20180812T030737_oi[N28,noinherit][2046,4094][real]: DECaLS_
Clipping 1 pixels with anomalously large oow values: max 0.0502192 vs median 0.0383018
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T030629_oi[N28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005716_oi[S9,noinherit][2046,4094][real]: DECaLS_5
Clipping 1 pixels with anomalously large oow values: max 0.0662022 vs median 0.0500784
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004153_oi[N28,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T012852_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T010924_oi[N27,noinherit][2046,4094][real]: DECaLS_2761
Stage tims : Wall: 133.64 s, CPU: 1.13 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.181596 MB
Stage tims finished: 2020-08-10T08:37:02.162743
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T012901_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952d60f-z-20180914T004001_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T041539_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532e22-g-20180812T030737_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530903-g-20180517T090600_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005716_oi[S9,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004530_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180916T004153_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041420_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T030629_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 6.559 s worker CPU, 547.144 s worker Wall, Wall: 133.638 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T012206_oi[N27,noinherit][2046,4094][real]: DECaLS_2761 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T012852_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T010924_oi[N27,noinherit][2046,4094][real]: DECaLS_2761 [astropy.io.fits.card]
Running stage refs at 2020-08-10T08:37:02.189046
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07219.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07347.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/reference-custom-323880m10297.fits
Stage refs : Wall: 13.61 s, CPU: 3.04 s, VmPeak: 1041 MB, VmSize: 1035 MB, VmRSS: 208 MB, VmData: 241 MB, maxrss: 0.213192 MB
Stage refs finished: 2020-08-10T08:37:15.796327
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.608 s, Cores in use: 0.22, Total efficiency (on 8 cores): 2.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:37:15.822128
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/outlier-mask-custom-323880m10297.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/outliers-pre-custom-323880m10297.jpg
Image c4d_180517_090600_ooi_g_ls9-N29 g : masking 521 positive outlier pixels and 0 negative outlier pixels
Image c4d_180903_012206_ooi_g_ls9-N27 g : masking 2403 positive outlier pixels and 0 negative outlier pixels
Image c4d_180812_030737_ooi_g_ls9-N28 g : masking 0 positive outlier pixels and 180 negative outlier pixels
Image c4d_180903_010924_ooi_r_ls9-N27 r : masking 972 positive outlier pixels and 0 negative outlier pixels
Image c4d_180914_004001_ooi_z_ls9-N27 z : masking 86 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/outlier-mask-custom-323880m10297.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/outliers-post-custom-323880m10297.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/outliers-masked-pos-custom-323880m10297.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/outliers-masked-neg-custom-323880m10297.jpg
Stage outliers : Wall: 0.86 s, CPU: 0.70 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 220 MB, VmData: 251 MB, maxrss: 0.225616 MB
Stage outliers finished: 2020-08-10T08:37:16.678486
Resources for stage outliers : 1.004 s worker CPU, 1.008 s worker Wall, Wall: 0.857 s, Cores in use: 1.99, Total efficiency (on 8 cores): 24.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:37:16.874872
Stage halos : Wall: 1.09 s, CPU: 0.31 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 221 MB, VmData: 251 MB, maxrss: 0.22588 MB
Stage halos finished: 2020-08-10T08:37:17.966636
Resources for stage halos : 0.567 s worker CPU, 1.904 s worker Wall, Wall: 1.093 s, Cores in use: 0.80, Total efficiency (on 8 cores): 10.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:37:18.162291
PSF sigmas in coadd pixels: ['1.90', '1.80', '2.13', '1.72', '1.50', '1.94']
Using average PSF sigma 1.8308040824819927
Gaussian PSF norm 0.15408245725094005 vs pixelized 0.12757982
average tim pixel scale / coadd scale: 1.0010949647025638
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.61', '1.48']
Using average PSF sigma 1.63965182399422
Gaussian PSF norm 0.17204554506376263 vs pixelized 0.13865767
average tim pixel scale / coadd scale: 1.0011149597005875
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.52', '2.53', '2.38', '1.94']
Using average PSF sigma 2.3425976973879363
Gaussian PSF norm 0.12041964870383932 vs pixelized 0.09879947
average tim pixel scale / coadd scale: 1.0010997635020895
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 223 MB, VmData: 252 MB, maxrss: 0.22868 MB
Stage fit_on_coadds finished: 2020-08-10T08:37:18.362434
Resources for stage fit_on_coadds : 0.304 s worker CPU, 0.304 s worker Wall, Wall: 0.201 s, Cores in use: 2.43, Total efficiency (on 8 cores): 30.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:37:18.371829
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 1189 potential peaks
Of 1189 potential peaks: 1174 in veto map, 4 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 284 potential peaks
Of 284 potential peaks: 281 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 51 potential peaks
Of 51 potential peaks: 44 in veto map, 1 cut by saddle test, 0 cut by aper test, 6 kept
SED g : 6 new peaks
Found 59 potential peaks
Of 59 potential peaks: 58 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 97 potential peaks
Of 97 potential peaks: 95 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 19 new sources
Median coadd sky for g : -3.1775962e-05
Median coadd sky for r : -3.4984718e-05
Median coadd sky for z : 0.0011558696
Stage srcs : Wall: 0.52 s, CPU: 0.48 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 224 MB, VmData: 252 MB, maxrss: 0.229464 MB
Stage srcs finished: 2020-08-10T08:37:18.895323
Resources for stage srcs : 0.108 s worker CPU, 0.108 s worker Wall, Wall: 0.524 s, Cores in use: 1.13, Total efficiency (on 8 cores): 14.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:37:18.906678
Blob 1 of 7, id: 1, sources: 18, size: 241x173, npix 20433, brick X: 0,241, Y: 48,221, one pixel: 25 48
Blob 2 of 7, id: 3, sources: 3, size: 73x51, npix 2095, brick X: 21,94, Y: 160,211, one pixel: 38 160
Blob 3 of 7, id: 6, sources: 2, size: 37x23, npix 584, brick X: 186,223, Y: 218,241, one pixel: 212 218
Blob 4 of 7, id: 5, sources: 1, size: 29x29, npix 534, brick X: 13,42, Y: 203,232, one pixel: 25 203
Blob 5 of 7, id: 2, sources: 1, size: 28x29, npix 503, brick X: 191,219, Y: 156,185, one pixel: 204 156
Blob 6 of 7, id: 4, sources: 1, size: 24x27, npix 445, brick X: 188,212, Y: 192,219, one pixel: 196 192
Blob 7 of 7, id: 0, sources: 1, size: 23x23, npix 317, brick X: 205,228, Y: 20,43, one pixel: 215 20
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.87453, -10.28804), pm (-20.2, -17.1), parallax 1.021 with NanoMaggies: g=18.2, r=17.4, z=16.5
Reset brightness to NanoMaggies: g=17.6, r=16.6, z=16.1
Blob 3 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 967 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147492 MB
Blob 5 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 963 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144876 MB
Blob 7 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 967 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147644 MB
Blob 4 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 966 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144948 MB
Blob 6 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 938 MB, VmSize: 723 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142884 MB
Blob 2 finished, total: Wall: 3.12 s, CPU: 3.12 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147664 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (323.85637, -10.29920), pm (-8.8, -10.0), parallax 0.899 with NanoMaggies: g=9.91, r=8.65, z=7.93
Reset brightness to NanoMaggies: g=9.91, r=8.65, z=7.93
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.20235, ee1=-0.319183, ee2=-0.0761408
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 13.06 s, CPU: 13.06 s, VmPeak: 939 MB, VmSize: 727 MB, VmRSS: 151 MB, VmData: 182 MB, maxrss: 0.154516 MB
Old catalog: 31
New catalog: 24
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/blobs-custom-323880m10297.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/metrics/cus/all-models-custom-323880m10297.fits
Stage fitblobs : Wall: 13.43 s, CPU: 0.32 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 224 MB, VmData: 252 MB, maxrss: 0.229628 MB
Stage fitblobs finished: 2020-08-10T08:37:32.339237
Resources for stage fitblobs : 18.579 s worker CPU, 18.625 s worker Wall, Wall: 13.434 s, Cores in use: 1.41, Total efficiency (on 8 cores): 17.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:37:32.358670
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-resid.jpg
Stage coadds : Wall: 1.95 s, CPU: 1.08 s, VmPeak: 1045 MB, VmSize: 1033 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.230012 MB
Stage coadds finished: 2020-08-10T08:37:34.312432
Resources for stage coadds : 3.691 s worker CPU, 4.572 s worker Wall, Wall: 1.955 s, Cores in use: 2.44, Total efficiency (on 8 cores): 30.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:37:34.323794
Cut to 1 unWISE tiles
Reading WISE tile 3246m107 band 1
Reading WISE tile 3246m107 band 2
Reading WISE tile 3246m107 band 3
Reading WISE tile 3246m107 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 946 MB, VmSize: 796 MB, VmRSS: 139 MB, VmData: 171 MB, maxrss: 0.202888 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 971 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.204884 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 963 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207976 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/324/3246m107/unwise-3246m107-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 966 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.1928 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/tmp-legacysurvey-custom-323880m10297-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.39 s, CPU: 0.58 s, VmPeak: 1045 MB, VmSize: 1033 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.230012 MB
Stage wise_forced finished: 2020-08-10T08:37:37.715153
Resources for stage wise_forced : 2.976 s worker CPU, 6.191 s worker Wall, Wall: 3.392 s, Cores in use: 1.05, Total efficiency (on 8 cores): 13.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:37:37.770740
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/coadd/cus/custom-323880m10297/legacysurvey-custom-323880m10297-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/tractor-i/cus/tractor-custom-323880m10297.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/tractor/cus/tractor-custom-323880m10297.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/tractor/cus/brick-custom-323880m10297.sha256sum
Stage writecat : Wall: 0.99 s, CPU: 0.56 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.350896 MB
Stage writecat finished: 2020-08-10T08:37:38.757343
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.988 s, Cores in use: 0.56, Total efficiency (on 8 cores): 7.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC979977/PGC979977-largegalaxy-writecat.p
All done: 33.789 s worker CPU, 579.859 s worker Wall, Wall: 170.248 s, Cores in use: 0.25, Total efficiency (on 8 cores): 3.1 %
Finished galaxy PGC979977 in 2.869 minutes.