Started working on galaxy PGC715657 at Wed Aug  5 19:39:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.14797 -30.5690476 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:40:04.690071
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '32.14797', '-30.5690476', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.14797 -30.5690476 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 32.14797 -30.5690476
Starting process 41699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 41701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 41703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 41704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 41709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 41710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 41711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB
Starting process 41712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 41713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 41714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 41715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 41716 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 41717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 41718 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 41720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 41721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:40:05.564617
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 22 CCDs:
  c4d_171018_063145_ooi_g_v1-N6 g expnum 688200 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 58044.272 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.1/CP20171017/c4d_171018_063145_ooi_g_v1.fits.fz
  c4d_170201_010804_ooi_z_ls9-N6 z expnum 615074 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57785.046 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.8.2/CP20170131/c4d_170201_010804_ooi_z_ls9.fits.fz
  c4d_180203_010051_ooi_r_v1-N7 r expnum 716850 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 58152.042 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010051_ooi_r_v1.fits.fz
  c4d_180203_010250_ooi_g_v1-N7 g expnum 716851 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58152.044 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010250_ooi_g_v1.fits.fz
  c4d_180123_010814_ooi_z_v1-N7 z expnum 714408 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 58141.047 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180122/c4d_180123_010814_ooi_z_v1.fits.fz
  c4d_151214_011553_ooi_g_ls9-S5 g expnum 501642 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57370.051 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151213/c4d_151214_011553_ooi_g_ls9.fits.fz
  c4d_141230_034550_ooi_z_ls9-S5 z expnum 393123 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57021.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_034550_ooi_z_ls9.fits.fz
  c4d_151205_034605_ooi_r_ls9-S5 r expnum 499423 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57361.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151204/c4d_151205_034605_ooi_r_ls9.fits.fz
  c4d_171020_075834_ooi_r_ls9-N22 r expnum 689042 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58046.332 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_075834_ooi_r_ls9.fits.fz
  c4d_171020_080032_ooi_g_ls9-N22 g expnum 689043 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58046.334 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_080032_ooi_g_ls9.fits.fz
  c4d_171207_050449_ooi_z_ls9-N22 z expnum 702364 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 58094.212 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171206/c4d_171207_050449_ooi_z_ls9.fits.fz
  c4d_151024_015535_ooi_z_ls9-S22 z expnum 487065 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57319.079 object DES survey hex 321-318 tiling 4 
    decam/CP/V4.8.2a/CP20151023/c4d_151024_015535_ooi_z_ls9.fits.fz
  c4d_151204_031543_ooi_g_ls9-N26 g expnum 499071 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57360.134 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151203/c4d_151204_031543_ooi_g_ls9.fits.fz
  c4d_151118_025337_ooi_r_ls9-N26 r expnum 494335 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57344.119 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151117/c4d_151118_025337_ooi_r_ls9.fits.fz
  c4d_161207_051343_ooi_r_ls9-S28 r expnum 600574 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57729.216 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161206/c4d_161207_051343_ooi_r_ls9.fits.fz
  c4d_161023_072150_ooi_z_ls9-S28 z expnum 585344 exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 57684.305 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2a/CP20161022/c4d_161023_072150_ooi_z_ls9.fits.fz
  c4d_161124_054139_ooi_g_ls9-S28 g expnum 595828 exptime 90.0 propid 2012B-0001 seeing 1.85 MJD 57716.236 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161123/c4d_161124_054139_ooi_g_ls9.fits.fz
  c4d_161218_041900_ooi_z_ls9-S28 z expnum 601831 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57740.178 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161217/c4d_161218_041900_ooi_z_ls9.fits.fz
  c4d_161123_055050_ooi_g_v1-S28 g expnum 595463 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57715.242 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.1/CP20161123/c4d_161123_055050_ooi_g_v1.fits.fz
  c4d_151009_083921_ooi_r_ls9-N8 r expnum 483215 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 57304.359 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20151008/c4d_151009_083921_ooi_r_ls9.fits.fz
  c4d_141211_041131_ooi_z_ls9-N8 z expnum 386322 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57002.173 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20141210/c4d_141211_041131_ooi_z_ls9.fits.fz
  c4d_151211_011636_ooi_g_ls9-N8 g expnum 501083 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57367.052 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20151210/c4d_151211_011636_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N7,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N7,noinherit][2046,4094][real]: DES
Zeroing out 4428 weight-map pixels below quantization error (= median 0.000147)
Clipping 1 pixels with anomalously large oow values: max 0.0360973 vs median 0.0275388
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N7,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N26,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0434882 vs median 0.0330191
Zeroing out 4429 weight-map pixels below quantization error (= median 4.16e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 4447 weight-map pixels below quantization error (= median 6.62e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE
Zeroing out 1 weight-map pixels below quantization error (= median 0.000264)
Clipping 1 pixels with anomalously large oow values: max 0.0514289 vs median 0.0393758
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N6,noinherit][2046,4094][real]: DES
Zeroing out 246 weight-map pixels below quantization error (= median 0.000169)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 76.90 s, CPU: 2.06 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 188 MB, VmData: 220 MB, maxrss: 0.192544 MB
Stage tims finished: 2020-08-05T19:41:22.460926
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 12.377 s worker CPU, 905.754 s worker Wall, Wall: 76.898 s, Cores in use: 0.19, Total efficiency (on 16 cores): 1.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T19:41:22.842781
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09291.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09163.fits
Matched 9 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/reference-custom-032147m30569.fits
Stage refs : Wall: 8.76 s, CPU: 1.48 s, VmPeak: 1045 MB, VmSize: 1025 MB, VmRSS: 201 MB, VmData: 231 MB, maxrss: 0.205472 MB
Stage refs finished: 2020-08-05T19:41:31.604725
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.764 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:41:31.925143
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outlier-mask-custom-032147m30569.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-pre-custom-032147m30569.jpg
Image c4d_161124_054139_ooi_g_ls9-S28 g : masking 301 positive outlier pixels and 0 negative outlier pixels
Image c4d_151214_011553_ooi_g_ls9-S5 g : masking 484 positive outlier pixels and 0 negative outlier pixels
Image c4d_151118_025337_ooi_r_ls9-N26 r : masking 215 positive outlier pixels and 0 negative outlier pixels
Image c4d_161207_051343_ooi_r_ls9-S28 r : masking 468 positive outlier pixels and 0 negative outlier pixels
Image c4d_161023_072150_ooi_z_ls9-S28 z : masking 353 positive outlier pixels and 0 negative outlier pixels
Image c4d_170201_010804_ooi_z_ls9-N6 z : masking 57 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outlier-mask-custom-032147m30569.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-post-custom-032147m30569.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-masked-pos-custom-032147m30569.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-masked-neg-custom-032147m30569.jpg
Stage outliers : Wall: 1.06 s, CPU: 0.91 s, VmPeak: 1045 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227136 MB
Stage outliers finished: 2020-08-05T19:41:32.981836
Resources for stage outliers : 1.376 s worker CPU, 1.376 s worker Wall, Wall: 1.058 s, Cores in use: 2.16, Total efficiency (on 16 cores): 13.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:41:33.028840
Stage halos : Wall: 0.79 s, CPU: 0.62 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227524 MB
Stage halos finished: 2020-08-05T19:41:33.814130
Resources for stage halos : 0.377 s worker CPU, 2.120 s worker Wall, Wall: 0.787 s, Cores in use: 1.26, Total efficiency (on 16 cores): 7.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:41:34.327042
PSF sigmas in coadd pixels: ['1.88', '1.58', '1.91', '1.58', '2.15', '3.00', '2.21', '2.02']
Using average PSF sigma 2.0412931454117014
Gaussian PSF norm 0.1381941601126493 vs pixelized 0.10921314
average tim pixel scale / coadd scale: 1.001026519324954
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.73', '2.09', '1.75', '1.82', '1.99', '2.42']
Using average PSF sigma 1.9645656786961168
Gaussian PSF norm 0.14359142829019828 vs pixelized 0.1503741
average tim pixel scale / coadd scale: 1.0010726536172692
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.74', '2.11', '1.78', '1.78', '1.83', '2.33', '1.71', '1.83']
Using average PSF sigma 1.890045294332996
Gaussian PSF norm 0.14925292669953208 vs pixelized 0.14032017
average tim pixel scale / coadd scale: 1.0010060369488534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.36 s, CPU: 0.28 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.229844 MB
Stage fit_on_coadds finished: 2020-08-05T19:41:34.684899
Resources for stage fit_on_coadds : 0.313 s worker CPU, 0.313 s worker Wall, Wall: 0.359 s, Cores in use: 1.65, Total efficiency (on 16 cores): 10.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:41:34.697214
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 32 potential peaks
Of 32 potential peaks: 1 in veto map, 4 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 38 potential peaks
Of 38 potential peaks: 26 in veto map, 3 cut by saddle test, 0 cut by aper test, 9 kept
SED r : 9 new peaks
Found 32 potential peaks
Of 32 potential peaks: 30 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 46 potential peaks
Of 46 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 49 potential peaks
Of 49 potential peaks: 41 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 44 new sources
Median coadd sky for g : -5.85875e-05
Median coadd sky for r : -7.1326496e-05
Median coadd sky for z : 5.6415785e-05
Stage srcs : Wall: 1.10 s, CPU: 1.03 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.230464 MB
Stage srcs finished: 2020-08-05T19:41:35.792774
Resources for stage srcs : 0.074 s worker CPU, 0.074 s worker Wall, Wall: 1.097 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:41:35.809822
Blob 1 of 21, id: 7, sources: 16, size: 132x165, npix 9845, brick X: 54,186, Y: 38,203, one pixel: 175 38
Blob 2 of 21, id: 13, sources: 6, size: 81x80, npix 2924, brick X: 0,81, Y: 148,228, one pixel: 21 148
Blob 3 of 21, id: 10, sources: 4, size: 54x67, npix 1671, brick X: 174,228, Y: 128,195, one pixel: 212 128
Blob 4 of 21, id: 0, sources: 2, size: 47x40, npix 1367, brick X: 0,47, Y: 0,40, one pixel: 0 0
Blob 5 of 21, id: 6, sources: 1, size: 40x42, npix 1172, brick X: 186,226, Y: 36,78, one pixel: 200 36
Blob 6 of 21, id: 17, sources: 2, size: 32x35, npix 787, brick X: 146,178, Y: 210,245, one pixel: 159 210
Blob 7 of 21, id: 5, sources: 1, size: 33x28, npix 619, brick X: 71,104, Y: 23,51, one pixel: 82 23
Blob 8 of 21, id: 9, sources: 1, size: 29x30, npix 544, brick X: 174,203, Y: 105,135, one pixel: 187 105
Blob 9 of 21, id: 2, sources: 1, size: 35x23, npix 540, brick X: 167,202, Y: 0,23, one pixel: 172 0
Blob 10 of 21, id: 15, sources: 1, size: 30x23, npix 455, brick X: 85,115, Y: 203,226, one pixel: 103 203
Blob 11 of 21, id: 19, sources: 1, size: 27x21, npix 405, brick X: 14,41, Y: 224,245, one pixel: 24 224
Blob 12 of 21, id: 1, sources: 1, size: 23x23, npix 336, brick X: 70,93, Y: 0,23, one pixel: 79 0
Blob 13 of 21, id: 14, sources: 1, size: 22x22, npix 292, brick X: 62,84, Y: 154,176, one pixel: 73 154
Blob 14 of 21, id: 8, sources: 1, size: 22x21, npix 270, brick X: 196,218, Y: 79,100, one pixel: 206 79
Blob 15 of 21, id: 3, sources: 1, size: 21x23, npix 268, brick X: 114,135, Y: 11,34, one pixel: 123 11
Blob 16 of 21, id: 4, sources: 1, size: 21x20, npix 239, brick X: 160,181, Y: 19,39, one pixel: 168 19
Blob 17 of 21, id: 11, sources: 1, size: 20x20, npix 228, brick X: 24,44, Y: 132,152, one pixel: 32 132
Blob 14 finished, total: Wall: 0.12 s, CPU: 0.10 s, VmPeak: 1025 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148672 MB
Blob 18 of 21, id: 16, sources: 1, size: 19x20, npix 218, brick X: 190,209, Y: 207,227, one pixel: 198 207
Blob 13 finished, total: Wall: 0.42 s, CPU: 0.40 s, VmPeak: 999 MB, VmSize: 730 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147244 MB
Blob 19 of 21, id: 12, sources: 1, size: 17x20, npix 208, brick X: 0,17, Y: 136,156, one pixel: 6 136
Blob 16 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148792 MB
Blob 20 of 21, id: 20, sources: 1, size: 15x17, npix 177, brick X: 230,245, Y: 228,245, one pixel: 238 228
Blob 21 of 21, id: 18, sources: 1, size: 17x17, npix 145, brick X: 35,52, Y: 215,232, one pixel: 43 215
Blob 18 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 999 MB, VmSize: 730 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147244 MB
Blob 15 finished, total: Wall: 0.76 s, CPU: 0.74 s, VmPeak: 974 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147896 MB
Blob 17 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 1025 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.15034 MB
Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 974 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147896 MB
Blob 12 finished, total: Wall: 0.90 s, CPU: 0.88 s, VmPeak: 969 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149876 MB
Measuring 1 iterative sources
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 19 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14888 MB
Blob 7 finished, total: Wall: 1.37 s, CPU: 1.36 s, VmPeak: 970 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149184 MB
Blob 5 finished, total: Wall: 1.42 s, CPU: 1.40 s, VmPeak: 939 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151108 MB
Blob 11 finished, total: Wall: 1.43 s, CPU: 1.42 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149212 MB
Blob 20 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 999 MB, VmSize: 730 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147244 MB
Blob 8 finished, total: Wall: 1.59 s, CPU: 1.59 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149556 MB
Blob 10 finished, total: Wall: 1.76 s, CPU: 1.75 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148728 MB
Blob 6 finished, total: Wall: 1.79 s, CPU: 1.78 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148788 MB
Blob 9 finished, total: Wall: 1.80 s, CPU: 1.79 s, VmPeak: 973 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148736 MB
Blob 3 finished, total: Wall: 2.53 s, CPU: 2.52 s, VmPeak: 996 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150424 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 4.12 s, CPU: 4.12 s, VmPeak: 955 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155208 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 5.58 s, CPU: 5.56 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.15056 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39909, ee1=-0.325388, ee2=0.0823597
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 12.54 s, CPU: 12.52 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150816 MB
Old catalog: 49
New catalog: 49
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/blobs-custom-032147m30569.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/all-models-custom-032147m30569.fits
Stage fitblobs : Wall: 13.63 s, CPU: 1.03 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.230628 MB
Stage fitblobs finished: 2020-08-05T19:41:49.440857
Resources for stage fitblobs : 41.343 s worker CPU, 41.876 s worker Wall, Wall: 13.632 s, Cores in use: 3.11, Total efficiency (on 16 cores): 19.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:41:49.462457
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-resid.jpg
Stage coadds : Wall: 2.36 s, CPU: 1.20 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.231144 MB
Stage coadds finished: 2020-08-05T19:41:51.824329
Resources for stage coadds : 8.018 s worker CPU, 11.798 s worker Wall, Wall: 2.363 s, Cores in use: 3.90, Total efficiency (on 16 cores): 24.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:41:51.840489
Cut to 2 unWISE tiles
Reading WISE tile 0313m303 band 1
Reading WISE tile 0313m303 band 3
Reading WISE tile 0313m303 band 2
Reading WISE tile 0313m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.14 s, VmPeak: 1010 MB, VmSize: 815 MB, VmRSS: 154 MB, VmData: 179 MB, maxrss: 0.197188 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 955 MB, VmSize: 810 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.212704 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 974 MB, VmSize: 810 MB, VmRSS: 151 MB, VmData: 175 MB, maxrss: 0.212956 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 960 MB, VmSize: 810 MB, VmRSS: 148 MB, VmData: 175 MB, maxrss: 0.211528 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.48 s, CPU: 0.86 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.231848 MB
Stage wise_forced finished: 2020-08-05T19:41:56.324124
Resources for stage wise_forced : 6.160 s worker CPU, 10.413 s worker Wall, Wall: 4.485 s, Cores in use: 1.57, Total efficiency (on 16 cores): 9.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:41:56.337115
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/tractor-i/cus/tractor-custom-032147m30569.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/tractor/cus/tractor-custom-032147m30569.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/tractor/cus/brick-custom-032147m30569.sha256sum
Stage writecat : Wall: 2.77 s, CPU: 1.29 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 228 MB, VmData: 251 MB, maxrss: 0.364852 MB
Stage writecat finished: 2020-08-05T19:41:59.103599
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.768 s, Cores in use: 0.47, Total efficiency (on 16 cores): 2.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-writecat.p
All done: 70.040 s worker CPU, 973.728 s worker Wall, Wall: 113.570 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.5 %
Finished galaxy PGC715657 in 2.011 minutes.
Started working on galaxy PGC715657 at Wed Aug  5 20:22:37 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.14797 -30.5690476 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:22:41.363908
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '32.14797', '-30.5690476', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.14797 -30.5690476 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 32.14797 -30.5690476
Starting process 50643 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 50645 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 50647 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 50649 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 50650 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB
Starting process 50652 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 50654 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059352 MB
Starting process 50656 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 50658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 50660 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 50662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 50664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 50669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 50674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 50675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 50677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 50678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 50679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 50681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 50682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 50683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 50684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 50685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 50686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 50687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 50688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 50689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 50690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:22:44.101564
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 22 CCDs:
  c4d_171018_063145_ooi_g_v1-N6 g expnum 688200 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 58044.272 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.1/CP20171017/c4d_171018_063145_ooi_g_v1.fits.fz
  c4d_170201_010804_ooi_z_ls9-N6 z expnum 615074 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57785.046 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.8.2/CP20170131/c4d_170201_010804_ooi_z_ls9.fits.fz
  c4d_180203_010051_ooi_r_v1-N7 r expnum 716850 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 58152.042 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010051_ooi_r_v1.fits.fz
  c4d_180203_010250_ooi_g_v1-N7 g expnum 716851 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58152.044 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010250_ooi_g_v1.fits.fz
  c4d_180123_010814_ooi_z_v1-N7 z expnum 714408 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 58141.047 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180122/c4d_180123_010814_ooi_z_v1.fits.fz
  c4d_151214_011553_ooi_g_ls9-S5 g expnum 501642 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57370.051 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151213/c4d_151214_011553_ooi_g_ls9.fits.fz
  c4d_141230_034550_ooi_z_ls9-S5 z expnum 393123 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57021.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_034550_ooi_z_ls9.fits.fz
  c4d_151205_034605_ooi_r_ls9-S5 r expnum 499423 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57361.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151204/c4d_151205_034605_ooi_r_ls9.fits.fz
  c4d_171020_075834_ooi_r_ls9-N22 r expnum 689042 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58046.332 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_075834_ooi_r_ls9.fits.fz
  c4d_171020_080032_ooi_g_ls9-N22 g expnum 689043 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58046.334 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_080032_ooi_g_ls9.fits.fz
  c4d_171207_050449_ooi_z_ls9-N22 z expnum 702364 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 58094.212 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171206/c4d_171207_050449_ooi_z_ls9.fits.fz
  c4d_151024_015535_ooi_z_ls9-S22 z expnum 487065 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57319.079 object DES survey hex 321-318 tiling 4 
    decam/CP/V4.8.2a/CP20151023/c4d_151024_015535_ooi_z_ls9.fits.fz
  c4d_151204_031543_ooi_g_ls9-N26 g expnum 499071 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57360.134 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151203/c4d_151204_031543_ooi_g_ls9.fits.fz
  c4d_151118_025337_ooi_r_ls9-N26 r expnum 494335 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57344.119 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151117/c4d_151118_025337_ooi_r_ls9.fits.fz
  c4d_161207_051343_ooi_r_ls9-S28 r expnum 600574 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57729.216 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161206/c4d_161207_051343_ooi_r_ls9.fits.fz
  c4d_161023_072150_ooi_z_ls9-S28 z expnum 585344 exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 57684.305 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2a/CP20161022/c4d_161023_072150_ooi_z_ls9.fits.fz
  c4d_161124_054139_ooi_g_ls9-S28 g expnum 595828 exptime 90.0 propid 2012B-0001 seeing 1.85 MJD 57716.236 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161123/c4d_161124_054139_ooi_g_ls9.fits.fz
  c4d_161218_041900_ooi_z_ls9-S28 z expnum 601831 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57740.178 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161217/c4d_161218_041900_ooi_z_ls9.fits.fz
  c4d_161123_055050_ooi_g_v1-S28 g expnum 595463 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57715.242 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.1/CP20161123/c4d_161123_055050_ooi_g_v1.fits.fz
  c4d_151009_083921_ooi_r_ls9-N8 r expnum 483215 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 57304.359 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20151008/c4d_151009_083921_ooi_r_ls9.fits.fz
  c4d_141211_041131_ooi_z_ls9-N8 z expnum 386322 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57002.173 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20141210/c4d_141211_041131_ooi_z_ls9.fits.fz
  c4d_151211_011636_ooi_g_ls9-N8 g expnum 501083 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57367.052 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20151210/c4d_151211_011636_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE
Zeroing out 1 weight-map pixels below quantization error (= median 0.000264)
Clipping 1 pixels with anomalously large oow values: max 0.0514289 vs median 0.0393758
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N7,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N7,noinherit][2046,4094][real]: DES
Zeroing out 4428 weight-map pixels below quantization error (= median 0.000147)
Clipping 1 pixels with anomalously large oow values: max 0.0360973 vs median 0.0275388
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N7,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N26,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0434882 vs median 0.0330191
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 4429 weight-map pixels below quantization error (= median 4.16e-05)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 4447 weight-map pixels below quantization error (= median 6.62e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N6,noinherit][2046,4094][real]: DES
Zeroing out 246 weight-map pixels below quantization error (= median 0.000169)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 29.80 s, CPU: 1.65 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 188 MB, VmData: 220 MB, maxrss: 0.19272 MB
Stage tims finished: 2020-08-05T20:23:13.901737
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 14.951 s worker CPU, 415.456 s worker Wall, Wall: 29.802 s, Cores in use: 0.56, Total efficiency (on 32 cores): 1.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:23:14.174399
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09291.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09163.fits
Matched 9 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/reference-custom-032147m30569.fits
Stage refs : Wall: 2.71 s, CPU: 1.61 s, VmPeak: 1045 MB, VmSize: 1026 MB, VmRSS: 201 MB, VmData: 232 MB, maxrss: 0.205436 MB
Stage refs finished: 2020-08-05T20:23:16.888827
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.717 s, Cores in use: 0.59, Total efficiency (on 32 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:23:17.457270
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outlier-mask-custom-032147m30569.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-pre-custom-032147m30569.jpg
Image c4d_161124_054139_ooi_g_ls9-S28 g : masking 301 positive outlier pixels and 0 negative outlier pixels
Image c4d_151214_011553_ooi_g_ls9-S5 g : masking 484 positive outlier pixels and 0 negative outlier pixels
Image c4d_161207_051343_ooi_r_ls9-S28 r : masking 468 positive outlier pixels and 0 negative outlier pixels
Image c4d_151118_025337_ooi_r_ls9-N26 r : masking 215 positive outlier pixels and 0 negative outlier pixels
Image c4d_170201_010804_ooi_z_ls9-N6 z : masking 57 positive outlier pixels and 0 negative outlier pixels
Image c4d_161023_072150_ooi_z_ls9-S28 z : masking 353 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outlier-mask-custom-032147m30569.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-post-custom-032147m30569.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-masked-pos-custom-032147m30569.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/outliers-masked-neg-custom-032147m30569.jpg
Stage outliers : Wall: 2.34 s, CPU: 1.95 s, VmPeak: 1045 MB, VmSize: 1035 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.226128 MB
Stage outliers finished: 2020-08-05T20:23:19.800212
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage outliers : 1.473 s worker CPU, 1.991 s worker Wall, Wall: 2.345 s, Cores in use: 1.46, Total efficiency (on 32 cores): 4.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:23:20.058868
Stage halos : Wall: 1.11 s, CPU: 0.87 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.226664 MB
Stage halos finished: 2020-08-05T20:23:21.168640
Resources for stage halos : 0.495 s worker CPU, 2.750 s worker Wall, Wall: 1.112 s, Cores in use: 1.23, Total efficiency (on 32 cores): 3.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:23:21.229630
PSF sigmas in coadd pixels: ['1.88', '1.58', '1.91', '1.58', '2.15', '3.00', '2.21', '2.02']
Using average PSF sigma 2.0412931454117014
Gaussian PSF norm 0.1381941601126493 vs pixelized 0.10921314
average tim pixel scale / coadd scale: 1.001026519324954
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.73', '2.09', '1.75', '1.82', '1.99', '2.42']
Using average PSF sigma 1.9645656786961168
Gaussian PSF norm 0.14359142829019828 vs pixelized 0.1503741
average tim pixel scale / coadd scale: 1.0010726536172692
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.74', '2.11', '1.78', '1.78', '1.83', '2.33', '1.71', '1.83']
Using average PSF sigma 1.890045294332996
Gaussian PSF norm 0.14925292669953208 vs pixelized 0.14032018
average tim pixel scale / coadd scale: 1.0010060369488534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.29 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.22976 MB
Stage fit_on_coadds finished: 2020-08-05T20:23:21.522579
Resources for stage fit_on_coadds : 0.286 s worker CPU, 0.286 s worker Wall, Wall: 0.295 s, Cores in use: 1.94, Total efficiency (on 32 cores): 6.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:23:21.537461
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 32 potential peaks
Of 32 potential peaks: 1 in veto map, 4 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 38 potential peaks
Of 38 potential peaks: 26 in veto map, 3 cut by saddle test, 0 cut by aper test, 9 kept
SED r : 9 new peaks
Found 32 potential peaks
Of 32 potential peaks: 30 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 46 potential peaks
Of 46 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 49 potential peaks
Of 49 potential peaks: 41 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 44 new sources
Median coadd sky for g : -5.8587528e-05
Median coadd sky for r : -7.132647e-05
Median coadd sky for z : 5.641578e-05
Stage srcs : Wall: 0.81 s, CPU: 0.77 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.230356 MB
Stage srcs finished: 2020-08-05T20:23:22.347601
Resources for stage srcs : 0.082 s worker CPU, 0.082 s worker Wall, Wall: 0.813 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:23:22.402216
Blob 1 of 21, id: 7, sources: 16, size: 132x165, npix 9845, brick X: 54,186, Y: 38,203, one pixel: 175 38
Blob 2 of 21, id: 13, sources: 6, size: 81x80, npix 2924, brick X: 0,81, Y: 148,228, one pixel: 21 148
Blob 3 of 21, id: 10, sources: 4, size: 54x67, npix 1671, brick X: 174,228, Y: 128,195, one pixel: 212 128
Blob 4 of 21, id: 0, sources: 2, size: 47x40, npix 1367, brick X: 0,47, Y: 0,40, one pixel: 0 0
Blob 5 of 21, id: 6, sources: 1, size: 40x42, npix 1172, brick X: 186,226, Y: 36,78, one pixel: 200 36
Blob 6 of 21, id: 17, sources: 2, size: 32x35, npix 787, brick X: 146,178, Y: 210,245, one pixel: 159 210
Blob 7 of 21, id: 5, sources: 1, size: 33x28, npix 619, brick X: 71,104, Y: 23,51, one pixel: 82 23
Blob 8 of 21, id: 9, sources: 1, size: 29x30, npix 544, brick X: 174,203, Y: 105,135, one pixel: 187 105
Blob 9 of 21, id: 2, sources: 1, size: 35x23, npix 540, brick X: 167,202, Y: 0,23, one pixel: 172 0
Blob 10 of 21, id: 15, sources: 1, size: 30x23, npix 455, brick X: 85,115, Y: 203,226, one pixel: 103 203
Blob 11 of 21, id: 19, sources: 1, size: 27x21, npix 405, brick X: 14,41, Y: 224,245, one pixel: 24 224
Blob 12 of 21, id: 1, sources: 1, size: 23x23, npix 336, brick X: 70,93, Y: 0,23, one pixel: 79 0
Blob 13 of 21, id: 14, sources: 1, size: 22x22, npix 292, brick X: 62,84, Y: 154,176, one pixel: 73 154
Blob 14 of 21, id: 8, sources: 1, size: 22x21, npix 270, brick X: 196,218, Y: 79,100, one pixel: 206 79
Blob 15 of 21, id: 3, sources: 1, size: 21x23, npix 268, brick X: 114,135, Y: 11,34, one pixel: 123 11
Blob 16 of 21, id: 4, sources: 1, size: 21x20, npix 239, brick X: 160,181, Y: 19,39, one pixel: 168 19
Blob 17 of 21, id: 11, sources: 1, size: 20x20, npix 228, brick X: 24,44, Y: 132,152, one pixel: 32 132
Blob 18 of 21, id: 16, sources: 1, size: 19x20, npix 218, brick X: 190,209, Y: 207,227, one pixel: 198 207
Blob 19 of 21, id: 12, sources: 1, size: 17x20, npix 208, brick X: 0,17, Y: 136,156, one pixel: 6 136
Blob 20 of 21, id: 20, sources: 1, size: 15x17, npix 177, brick X: 230,245, Y: 228,245, one pixel: 238 228
Blob 21 of 21, id: 18, sources: 1, size: 17x17, npix 145, brick X: 35,52, Y: 215,232, one pixel: 43 215
Blob 21 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149144 MB
Blob 14 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 995 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148616 MB
Blob 13 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148544 MB
Blob 16 finished, total: Wall: 0.34 s, CPU: 0.33 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 112 MB, VmData: 167 MB, maxrss: 0.11492 MB
Blob 18 finished, total: Wall: 0.34 s, CPU: 0.33 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14836 MB
Blob 15 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 996 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.1496 MB
Blob 17 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148796 MB
Blob 19 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148544 MB
Measuring 1 iterative sources
Blob 20 finished, total: Wall: 0.75 s, CPU: 0.74 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.1488 MB
Blob 12 finished, total: Wall: 0.83 s, CPU: 0.82 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113284 MB
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 1.13 s, CPU: 1.12 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14886 MB
Blob 8 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 166 MB, maxrss: 0.115372 MB
Blob 11 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148672 MB
Blob 6 finished, total: Wall: 1.33 s, CPU: 1.32 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147812 MB
Blob 10 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147736 MB
Blob 5 finished, total: Wall: 1.40 s, CPU: 1.39 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095464 MB
Blob 9 finished, total: Wall: 1.45 s, CPU: 1.44 s, VmPeak: 999 MB, VmSize: 730 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.14748 MB
Blob 3 finished, total: Wall: 2.08 s, CPU: 2.07 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.094732 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 4.02 s, CPU: 4.02 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150268 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 5.58 s, CPU: 5.58 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149676 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39909, ee1=-0.325388, ee2=0.0823599
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 11.60 s, CPU: 11.56 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.1508 MB
Old catalog: 49
New catalog: 49
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/blobs-custom-032147m30569.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/metrics/cus/all-models-custom-032147m30569.fits
Stage fitblobs : Wall: 12.05 s, CPU: 0.47 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.23052 MB
Stage fitblobs finished: 2020-08-05T20:23:34.454093
Resources for stage fitblobs : 36.865 s worker CPU, 37.210 s worker Wall, Wall: 12.054 s, Cores in use: 3.10, Total efficiency (on 32 cores): 9.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:23:34.471559
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-resid.jpg
Stage coadds : Wall: 3.36 s, CPU: 1.00 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.231036 MB
Stage coadds finished: 2020-08-05T20:23:37.827789
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 17.141 s worker CPU, 37.359 s worker Wall, Wall: 3.359 s, Cores in use: 5.40, Total efficiency (on 32 cores): 16.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:23:37.845502
Cut to 2 unWISE tiles
Reading WISE tile 0313m303 band 2
Reading WISE tile 0313m303 band 1
Reading WISE tile 0313m303 band 3
Reading WISE tile 0313m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.15 s, CPU: 0.15 s, VmPeak: 952 MB, VmSize: 813 MB, VmRSS: 155 MB, VmData: 178 MB, maxrss: 0.197092 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 952 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.208028 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 807 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.208324 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 950 MB, VmSize: 810 MB, VmRSS: 151 MB, VmData: 175 MB, maxrss: 0.21272 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.70 s, CPU: 1.38 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 226 MB, VmData: 251 MB, maxrss: 0.23174 MB
Stage wise_forced finished: 2020-08-05T20:23:43.548129
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 6.142 s worker CPU, 11.839 s worker Wall, Wall: 5.705 s, Cores in use: 1.32, Total efficiency (on 32 cores): 4.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-wise_forced.p
Running stage writecat
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage writecat at 2020-08-05T20:23:43.569679
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/tractor-i/cus/tractor-custom-032147m30569.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/tractor/cus/tractor-custom-032147m30569.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/tractor/cus/brick-custom-032147m30569.sha256sum
Stage writecat : Wall: 1.99 s, CPU: 1.22 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 228 MB, VmData: 251 MB, maxrss: 0.364744 MB
Stage writecat finished: 2020-08-05T20:23:45.560590
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.993 s, Cores in use: 0.62, Total efficiency (on 32 cores): 1.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/032/PGC715657/PGC715657-largegalaxy-writecat.p
All done: 77.440 s worker CPU, 506.979 s worker Wall, Wall: 61.508 s, Cores in use: 1.45, Total efficiency (on 32 cores): 4.5 %
Finished galaxy PGC715657 in 1.135 minutes.
Started working on galaxy PGC715657 at Mon Aug 10 08:20:02 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.147597569241334 -30.56901763059877 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:20:04.315582
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '32.147597569241334', '-30.56901763059877', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 32.147597569241334 -30.56901763059877 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 32.147597569241334 -30.56901763059877
Starting process 43372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 43374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 43376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 43378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 43380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059524 MB
Starting process 43382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 43384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059472 MB
Starting process 43386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:20:05.192313
Keeping 22 CCDs:
  c4d_171018_063145_ooi_g_v1-N6 g expnum 688200 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 58044.272 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.1/CP20171017/c4d_171018_063145_ooi_g_v1.fits.fz
  c4d_170201_010804_ooi_z_ls9-N6 z expnum 615074 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57785.046 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.8.2/CP20170131/c4d_170201_010804_ooi_z_ls9.fits.fz
  c4d_180203_010051_ooi_r_v1-N7 r expnum 716850 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 58152.042 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010051_ooi_r_v1.fits.fz
  c4d_180203_010250_ooi_g_v1-N7 g expnum 716851 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58152.044 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010250_ooi_g_v1.fits.fz
  c4d_180123_010814_ooi_z_v1-N7 z expnum 714408 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 58141.047 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180122/c4d_180123_010814_ooi_z_v1.fits.fz
  c4d_151214_011553_ooi_g_ls9-S5 g expnum 501642 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57370.051 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151213/c4d_151214_011553_ooi_g_ls9.fits.fz
  c4d_141230_034550_ooi_z_ls9-S5 z expnum 393123 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57021.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_034550_ooi_z_ls9.fits.fz
  c4d_151205_034605_ooi_r_ls9-S5 r expnum 499423 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57361.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151204/c4d_151205_034605_ooi_r_ls9.fits.fz
  c4d_171020_075834_ooi_r_ls9-N22 r expnum 689042 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58046.332 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_075834_ooi_r_ls9.fits.fz
  c4d_171020_080032_ooi_g_ls9-N22 g expnum 689043 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58046.334 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_080032_ooi_g_ls9.fits.fz
  c4d_171207_050449_ooi_z_ls9-N22 z expnum 702364 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 58094.212 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171206/c4d_171207_050449_ooi_z_ls9.fits.fz
  c4d_151024_015535_ooi_z_ls9-S22 z expnum 487065 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57319.079 object DES survey hex 321-318 tiling 4 
    decam/CP/V4.8.2a/CP20151023/c4d_151024_015535_ooi_z_ls9.fits.fz
  c4d_151204_031543_ooi_g_ls9-N26 g expnum 499071 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57360.134 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151203/c4d_151204_031543_ooi_g_ls9.fits.fz
  c4d_151118_025337_ooi_r_ls9-N26 r expnum 494335 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57344.119 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151117/c4d_151118_025337_ooi_r_ls9.fits.fz
  c4d_161207_051343_ooi_r_ls9-S28 r expnum 600574 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57729.216 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161206/c4d_161207_051343_ooi_r_ls9.fits.fz
  c4d_161023_072150_ooi_z_ls9-S28 z expnum 585344 exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 57684.305 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2a/CP20161022/c4d_161023_072150_ooi_z_ls9.fits.fz
  c4d_161124_054139_ooi_g_ls9-S28 g expnum 595828 exptime 90.0 propid 2012B-0001 seeing 1.85 MJD 57716.236 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161123/c4d_161124_054139_ooi_g_ls9.fits.fz
  c4d_161218_041900_ooi_z_ls9-S28 z expnum 601831 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57740.178 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161217/c4d_161218_041900_ooi_z_ls9.fits.fz
  c4d_161123_055050_ooi_g_v1-S28 g expnum 595463 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57715.242 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.1/CP20161123/c4d_161123_055050_ooi_g_v1.fits.fz
  c4d_151009_083921_ooi_r_ls9-N8 r expnum 483215 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 57304.359 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20151008/c4d_151009_083921_ooi_r_ls9.fits.fz
  c4d_141211_041131_ooi_z_ls9-N8 z expnum 386322 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57002.173 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20141210/c4d_141211_041131_ooi_z_ls9.fits.fz
  c4d_151211_011636_ooi_g_ls9-N8 g expnum 501083 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57367.052 object DES survey hex 340-308 tiling 2 
    decam/CP/V4.8.2a/CP20151210/c4d_151211_011636_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N7,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N7,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[S5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N7,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[S5,noinherit][2046,4094][real]: DES surv
Zeroing out 4446 weight-map pixels below quantization error (= median 0.000147)
Clipping 1 pixels with anomalously large oow values: max 0.0360973 vs median 0.0275388
Zeroing out 4447 weight-map pixels below quantization error (= median 6.62e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N22,noinherit][2046,4094][real]: DES sur
Zeroing out 4447 weight-map pixels below quantization error (= median 4.16e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N26,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0434882 vs median 0.0330191
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N6,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE
Zeroing out 1 weight-map pixels below quantization error (= median 0.000264)
Clipping 1 pixels with anomalously large oow values: max 0.0514289 vs median 0.0393758
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[N8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[N8,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[N8,noinherit][2046,4094][real]: DES surv
Stage tims : Wall: 73.97 s, CPU: 0.96 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 186 MB, VmData: 220 MB, maxrss: 0.190452 MB
Stage tims finished: 2020-08-10T08:21:19.157999
Zeroing out 247 weight-map pixels below quantization error (= median 0.000169)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N6,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N7,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[S5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 8.742 s worker CPU, 544.170 s worker Wall, Wall: 73.967 s, Cores in use: 0.13, Total efficiency (on 8 cores): 1.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Running stage refs at 2020-08-10T08:21:20.086313
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09291.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09163.fits
Matched 9 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/reference-custom-032147m30569.fits
Stage refs : Wall: 16.82 s, CPU: 1.36 s, VmPeak: 1039 MB, VmSize: 1019 MB, VmRSS: 199 MB, VmData: 231 MB, maxrss: 0.203384 MB
Stage refs finished: 2020-08-10T08:21:36.909491
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 16.824 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:21:37.159182
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/outlier-mask-custom-032147m30569.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/outliers-pre-custom-032147m30569.jpg
Image c4d_161123_055050_ooi_g_v1-S28 g : masking 115 positive outlier pixels and 82 negative outlier pixels
Image c4d_151214_011553_ooi_g_ls9-S5 g : masking 481 positive outlier pixels and 0 negative outlier pixels
Image c4d_161124_054139_ooi_g_ls9-S28 g : masking 272 positive outlier pixels and 0 negative outlier pixels
Image c4d_151211_011636_ooi_g_ls9-N8 g : masking 0 positive outlier pixels and 231 negative outlier pixels
Image c4d_161207_051343_ooi_r_ls9-S28 r : masking 474 positive outlier pixels and 0 negative outlier pixels
Image c4d_151118_025337_ooi_r_ls9-N26 r : masking 195 positive outlier pixels and 0 negative outlier pixels
Image c4d_171020_075834_ooi_r_ls9-N22 r : masking 0 positive outlier pixels and 147 negative outlier pixels
Image c4d_161023_072150_ooi_z_ls9-S28 z : masking 347 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/outlier-mask-custom-032147m30569.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/outliers-post-custom-032147m30569.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/outliers-masked-pos-custom-032147m30569.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/outliers-masked-neg-custom-032147m30569.jpg
Stage outliers : Wall: 1.17 s, CPU: 0.97 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.222936 MB
Stage outliers finished: 2020-08-10T08:21:38.326099
Resources for stage outliers : 1.673 s worker CPU, 1.676 s worker Wall, Wall: 1.168 s, Cores in use: 2.26, Total efficiency (on 8 cores): 28.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:21:38.397408
Stage halos : Wall: 1.09 s, CPU: 0.36 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.223356 MB
Stage halos finished: 2020-08-10T08:21:39.488157
Resources for stage halos : 0.406 s worker CPU, 2.039 s worker Wall, Wall: 1.092 s, Cores in use: 0.70, Total efficiency (on 8 cores): 8.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:21:39.535381
PSF sigmas in coadd pixels: ['1.88', '1.58', '1.91', '1.58', '2.15', '3.00', '2.21', '2.02']
Using average PSF sigma 2.0412931454117014
Gaussian PSF norm 0.1381941601126493 vs pixelized 0.10921312
average tim pixel scale / coadd scale: 1.001026519324954
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.73', '2.09', '1.75', '1.82', '1.99', '2.42']
Using average PSF sigma 1.9645656786961168
Gaussian PSF norm 0.14359142829019828 vs pixelized 0.15037115
average tim pixel scale / coadd scale: 1.0010726536172692
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.74', '2.11', '1.78', '1.78', '1.83', '2.33', '1.71', '1.83']
Using average PSF sigma 1.890045294332996
Gaussian PSF norm 0.14925292669953208 vs pixelized 0.14031607
average tim pixel scale / coadd scale: 1.0010060369488534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.34 s, CPU: 0.32 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.226376 MB
Stage fit_on_coadds finished: 2020-08-10T08:21:39.874566
Resources for stage fit_on_coadds : 0.413 s worker CPU, 0.413 s worker Wall, Wall: 0.340 s, Cores in use: 2.16, Total efficiency (on 8 cores): 27.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:21:39.887737
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 33 potential peaks
Of 33 potential peaks: 2 in veto map, 4 cut by saddle test, 0 cut by aper test, 27 kept
SED z : 27 new peaks
Found 38 potential peaks
Of 38 potential peaks: 27 in veto map, 3 cut by saddle test, 0 cut by aper test, 8 kept
SED r : 8 new peaks
Found 33 potential peaks
Of 33 potential peaks: 30 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 46 potential peaks
Of 46 potential peaks: 37 in veto map, 4 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 49 potential peaks
Of 49 potential peaks: 41 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 42 new sources
Median coadd sky for g : -4.6945097e-05
Median coadd sky for r : -6.421744e-05
Median coadd sky for z : 2.4435105e-05
Stage srcs : Wall: 0.75 s, CPU: 0.71 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.226972 MB
Stage srcs finished: 2020-08-10T08:21:40.638412
Resources for stage srcs : 0.068 s worker CPU, 0.068 s worker Wall, Wall: 0.752 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:21:40.651650
Blob 1 of 22, id: 7, sources: 15, size: 132x165, npix 9836, brick X: 49,181, Y: 38,203, one pixel: 170 38
Blob 2 of 22, id: 13, sources: 4, size: 77x62, npix 2310, brick X: 0,77, Y: 147,209, one pixel: 21 147
Blob 3 of 22, id: 11, sources: 4, size: 55x66, npix 1672, brick X: 169,224, Y: 128,194, one pixel: 207 128
Blob 4 of 22, id: 0, sources: 2, size: 43x40, npix 1246, brick X: 0,43, Y: 0,40, one pixel: 0 0
Blob 5 of 22, id: 6, sources: 1, size: 40x43, npix 1185, brick X: 182,222, Y: 35,78, one pixel: 197 35
Blob 6 of 22, id: 18, sources: 2, size: 32x35, npix 795, brick X: 141,173, Y: 210,245, one pixel: 152 210
Blob 7 of 22, id: 5, sources: 1, size: 33x28, npix 615, brick X: 67,100, Y: 23,51, one pixel: 77 23
Blob 8 of 22, id: 10, sources: 1, size: 29x30, npix 546, brick X: 170,199, Y: 105,135, one pixel: 180 105
Blob 9 of 22, id: 2, sources: 1, size: 36x22, npix 533, brick X: 162,198, Y: 0,22, one pixel: 167 0
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 999 MB, VmSize: 727 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145664 MB
Blob 10 of 22, id: 16, sources: 1, size: 31x23, npix 456, brick X: 80,111, Y: 203,226, one pixel: 90 203
Blob 8 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 972 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146792 MB
Blob 11 of 22, id: 20, sources: 1, size: 26x22, npix 418, brick X: 10,36, Y: 223,245, one pixel: 21 223
Blob 5 finished, total: Wall: 1.72 s, CPU: 1.72 s, VmPeak: 996 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147928 MB
Blob 12 of 22, id: 15, sources: 1, size: 22x26, npix 405, brick X: 0,22, Y: 202,228, one pixel: 5 202
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 2.62 s, CPU: 2.61 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146544 MB
Blob 13 of 22, id: 1, sources: 1, size: 23x22, npix 333, brick X: 66,89, Y: 0,22, one pixel: 74 0
Blob 9 finished, total: Wall: 1.96 s, CPU: 1.96 s, VmPeak: 999 MB, VmSize: 727 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145664 MB
Blob 14 of 22, id: 14, sources: 1, size: 23x22, npix 292, brick X: 57,80, Y: 154,176, one pixel: 68 154
Blob 11 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 996 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147928 MB
Blob 15 of 22, id: 9, sources: 1, size: 22x21, npix 281, brick X: 192,214, Y: 79,100, one pixel: 201 79
Blob 10 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 972 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146792 MB
Blob 16 of 22, id: 3, sources: 1, size: 22x23, npix 269, brick X: 109,131, Y: 11,34, one pixel: 118 11
Blob 3 finished, total: Wall: 3.55 s, CPU: 3.55 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144292 MB
Blob 17 of 22, id: 21, sources: 1, size: 20x20, npix 264, brick X: 225,245, Y: 225,245, one pixel: 235 225
Blob 14 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 996 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147928 MB
Blob 18 of 22, id: 8, sources: 1, size: 16x23, npix 247, brick X: 229,245, Y: 40,63, one pixel: 238 40
Blob 15 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 972 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146792 MB
Blob 19 of 22, id: 4, sources: 1, size: 21x20, npix 239, brick X: 155,176, Y: 18,38, one pixel: 165 18
Blob 13 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 999 MB, VmSize: 727 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145664 MB
Blob 20 of 22, id: 12, sources: 1, size: 21x19, npix 237, brick X: 19,40, Y: 132,151, one pixel: 27 132
Blob 12 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146544 MB
Blob 21 of 22, id: 17, sources: 1, size: 20x20, npix 219, brick X: 185,205, Y: 206,226, one pixel: 194 206
Blob 19 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 999 MB, VmSize: 727 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145664 MB
Blob 22 of 22, id: 19, sources: 1, size: 18x18, npix 171, brick X: 30,48, Y: 214,232, one pixel: 38 214
Blob 16 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144292 MB
Blob 22 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144292 MB
Blob 21 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 999 MB, VmSize: 727 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145664 MB
Measuring 1 iterative sources
Blob 18 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 972 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146792 MB
Blob 17 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 996 MB, VmSize: 727 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147928 MB
Blob 20 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146544 MB
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 5.84 s, CPU: 5.84 s, VmPeak: 1010 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147176 MB
Blob 4 finished, total: Wall: 6.07 s, CPU: 6.06 s, VmPeak: 1017 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146092 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.04166, ee1=-0.245898, ee2=0.0631818
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 14.25 s, CPU: 14.25 s, VmPeak: 995 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150208 MB
Old catalog: 47
New catalog: 51
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/blobs-custom-032147m30569.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/metrics/cus/all-models-custom-032147m30569.fits
Stage fitblobs : Wall: 14.69 s, CPU: 0.48 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.227136 MB
Stage fitblobs finished: 2020-08-10T08:21:55.341279
Resources for stage fitblobs : 49.381 s worker CPU, 49.522 s worker Wall, Wall: 14.691 s, Cores in use: 3.39, Total efficiency (on 8 cores): 42.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:21:55.353873
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-resid.jpg
Stage coadds : Wall: 1.52 s, CPU: 0.64 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.227652 MB
Stage coadds finished: 2020-08-10T08:21:56.871448
Resources for stage coadds : 4.421 s worker CPU, 4.861 s worker Wall, Wall: 1.518 s, Cores in use: 3.33, Total efficiency (on 8 cores): 41.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:21:56.903043
Cut to 2 unWISE tiles
Reading WISE tile 0313m303 band 1
Reading WISE tile 0313m303 band 2
Reading WISE tile 0313m303 band 3
Reading WISE tile 0313m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0330m303 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.17 s, VmPeak: 999 MB, VmSize: 808 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.196772 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 967 MB, VmSize: 803 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.210648 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 962 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.209484 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 996 MB, VmSize: 805 MB, VmRSS: 150 MB, VmData: 176 MB, maxrss: 0.212292 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/tmp-legacysurvey-custom-032147m30569-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.65 s, CPU: 0.53 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 223 MB, VmData: 249 MB, maxrss: 0.228356 MB
Stage wise_forced finished: 2020-08-10T08:22:02.556031
Resources for stage wise_forced : 6.420 s worker CPU, 10.852 s worker Wall, Wall: 5.654 s, Cores in use: 1.23, Total efficiency (on 8 cores): 15.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:22:02.577830
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/coadd/cus/custom-032147m30569/legacysurvey-custom-032147m30569-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/tractor-i/cus/tractor-custom-032147m30569.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/tractor/cus/tractor-custom-032147m30569.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/tractor/cus/brick-custom-032147m30569.sha256sum
Stage writecat : Wall: 0.80 s, CPU: 0.63 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 227 MB, VmData: 251 MB, maxrss: 0.363356 MB
Stage writecat finished: 2020-08-10T08:22:03.374256
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.798 s, Cores in use: 0.79, Total efficiency (on 8 cores): 9.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/032/PGC715657/PGC715657-largegalaxy-writecat.p
All done: 71.526 s worker CPU, 613.604 s worker Wall, Wall: 118.201 s, Cores in use: 0.67, Total efficiency (on 8 cores): 8.3 %
Finished galaxy PGC715657 in 2.015 minutes.