Started working on galaxy PGC351959 at Sat Jun  6 15:26:36 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T15:26:46.934254
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.4345005', '-61.8353889', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.4345005 -61.8353889
Starting process 48049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 48050 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 48051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 48052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T15:26:47.185792
Keeping 3 CCDs:
   c4d_171207_070447_ooi_z_v1.fits.fz c4d_171207_070447_ooi_z_v1-N31 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58094.295 object DES survey hex 908-613 tiling 7
   c4d_171212_064552_ooi_r_v1.fits.fz c4d_171212_064552_ooi_r_v1-N31 r exptime 90.0 propid 2012B-0001 seeing 1.35 MJD 58099.282 object DES survey hex 908-613 tiling 7
   c4d_171214_073326_ooi_g_v1.fits.fz c4d_171214_073326_ooi_g_v1-N31 g exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 58101.315 object DES survey hex 908-613 tiling 7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE
Stage tims : Wall: 21.57 s, CPU: 0.66 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 166 MB, VmData: 200 MB, maxrss: 0.454668 MB
Stage tims finished: 2020-06-06T15:27:08.754946
Zeroing out 3760 weight-map pixels below quantization error (= median 7.36e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 3760 weight-map pixels below quantization error (= median 0.000246)
Zeroing out 3760 weight-map pixels below quantization error (= median 2.65e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 1.707 s worker CPU, 57.277 s worker Wall, Wall: 21.570 s, Cores in use: 0.11, Total efficiency (on 4 cores): 2.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-06T15:27:08.766800
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11547.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11622.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/reference-custom-093434m61835.fits
Stage refs : Wall: 6.72 s, CPU: 4.06 s, VmPeak: 1061 MB, VmSize: 1055 MB, VmRSS: 229 MB, VmData: 261 MB, maxrss: 0.454668 MB
Stage refs finished: 2020-06-06T15:27:15.487854
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.722 s, Cores in use: 0.60, Total efficiency (on 4 cores): 15.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T15:27:15.489193
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-pre-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-post-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-pos-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-neg-custom-093434m61835.jpg
Stage outliers : Wall: 0.43 s, CPU: 0.29 s, VmPeak: 1064 MB, VmSize: 1064 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.454668 MB
Stage outliers finished: 2020-06-06T15:27:15.916338
Resources for stage outliers : 0.098 s worker CPU, 0.127 s worker Wall, Wall: 0.428 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T15:27:15.917770
Stage halos : Wall: 0.33 s, CPU: 0.15 s, VmPeak: 1064 MB, VmSize: 1064 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.454668 MB
Stage halos finished: 2020-06-06T15:27:16.251827
Resources for stage halos : 0.095 s worker CPU, 0.479 s worker Wall, Wall: 0.335 s, Cores in use: 0.75, Total efficiency (on 4 cores): 18.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T15:27:16.253539
PSF sigmas in coadd pixels: ['2.15']
Using average PSF sigma 2.1505686572466653
Gaussian PSF norm 0.1311721859347839 vs pixelized 0.10551156
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.19']
Using average PSF sigma 2.1949162453191624
Gaussian PSF norm 0.12852189343236595 vs pixelized 0.1050483
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.70']
Using average PSF sigma 1.7016829164034006
Gaussian PSF norm 0.16577400469536407 vs pixelized 0.12940602
average tim pixel scale / coadd scale: 1.001046076932396
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.06 s, CPU: 0.04 s, VmPeak: 1064 MB, VmSize: 1064 MB, VmRSS: 236 MB, VmData: 264 MB, maxrss: 0.454668 MB
Stage fit_on_coadds finished: 2020-06-06T15:27:16.314633
Resources for stage fit_on_coadds : 0.017 s worker CPU, 0.017 s worker Wall, Wall: 0.062 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T15:27:16.316296
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22492 potential peaks
Of 22492 potential peaks: 22489 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED z : 2 new peaks
Found 21619 potential peaks
Of 21619 potential peaks: 21614 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 22449 potential peaks
Of 22449 potential peaks: 22448 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21618 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21619 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 6 new sources
Median coadd sky for g : -0.00018060706
Median coadd sky for r : -6.436036e-05
Median coadd sky for z : 0.00032627623
Stage srcs : Wall: 1.10 s, CPU: 0.35 s, VmPeak: 1064 MB, VmSize: 1064 MB, VmRSS: 238 MB, VmData: 265 MB, maxrss: 0.454668 MB
Stage srcs finished: 2020-06-06T15:27:17.414913
Resources for stage srcs : 1.950 s worker CPU, 1.951 s worker Wall, Wall: 1.099 s, Cores in use: 2.09, Total efficiency (on 4 cores): 52.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T15:27:19.639106
Blob 1 of 6, id: 0, sources: 7, size: 233x178, npix 33615, brick X: 0,233, Y: 0,178, one pixel: 0 0
Blob 2 of 6, id: 4, sources: 2, size: 55x28, npix 1014, brick X: 59,114, Y: 205,233, one pixel: 80 205
Blob 3 of 6, id: 3, sources: 1, size: 37x28, npix 798, brick X: 0,37, Y: 205,233, one pixel: 16 205
Blob 4 of 6, id: 2, sources: 1, size: 30x30, npix 605, brick X: 163,193, Y: 184,214, one pixel: 176 184
Blob 5 of 6, id: 1, sources: 1, size: 23x24, npix 358, brick X: 199,222, Y: 156,180, one pixel: 209 156
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43894, -61.82628), pm (2.2, 27.4), parallax 1.883 with NanoMaggies: g=15.6, r=14.9, z=14.7
Reset brightness to NanoMaggies: g=16, r=15.1, z=14.6
Blob 2 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 684 MB, VmSize: 684 MB, VmRSS: 110 MB, VmData: 163 MB, maxrss: 0.11216 MB
Blob 6 of 6, id: 5, sources: 1, size: 20x20, npix 220, brick X: 110,130, Y: 206,226, one pixel: 119 206
Blob 5 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 685 MB, VmSize: 685 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112384 MB
Blob 4 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 1001 MB, VmSize: 713 MB, VmRSS: 135 MB, VmData: 176 MB, maxrss: 0.138612 MB
Blob 6 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 685 MB, VmSize: 685 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112384 MB
Blob 3 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 1006 MB, VmSize: 713 MB, VmRSS: 135 MB, VmData: 176 MB, maxrss: 0.1387 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45319, -61.88160), pm (3.2, -1.4), parallax 0.621 with NanoMaggies: g=11.9, r=11.1, z=10.8
Reset brightness to NanoMaggies: g=11.9, r=11.1, z=10.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43063, -61.83646), pm (5.0, 10.3), parallax 0.853 with NanoMaggies: g=(flux -319), r=15.1, z=15.1
Reset brightness to NanoMaggies: g=16.4, r=15.7, z=15.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45189, -61.83766), pm (-3.5, -4.8), parallax 0.489 with NanoMaggies: g=18.4, r=17.5, z=17.1
Reset brightness to NanoMaggies: g=18.4, r=17.5, z=17.1
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.37992, ee1=-0.150687, ee2=0.757993
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.44133, -61.84292), pm (-0.5, 4.2), parallax 0.099 with NanoMaggies: g=19.4, r=18.8, z=18.6
Reset brightness to NanoMaggies: g=19.4, r=18.8, z=18.6
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 3.34 s, CPU: 3.34 s, VmPeak: 1002 MB, VmSize: 717 MB, VmRSS: 147 MB, VmData: 180 MB, maxrss: 0.15054 MB
Old catalog: 16
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/blobs-custom-093434m61835.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/all-models-custom-093434m61835.fits
Stage fitblobs : Wall: 3.62 s, CPU: 0.22 s, VmPeak: 1064 MB, VmSize: 1064 MB, VmRSS: 240 MB, VmData: 266 MB, maxrss: 0.454668 MB
Stage fitblobs finished: 2020-06-06T15:27:23.254866
Resources for stage fitblobs : 6.950 s worker CPU, 6.963 s worker Wall, Wall: 3.617 s, Cores in use: 1.98, Total efficiency (on 4 cores): 49.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T15:27:23.256288
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-resid.jpg
Stage coadds : Wall: 1.97 s, CPU: 0.40 s, VmPeak: 1064 MB, VmSize: 1064 MB, VmRSS: 243 MB, VmData: 269 MB, maxrss: 0.454668 MB
Stage coadds finished: 2020-06-06T15:27:25.225797
Resources for stage coadds : 3.923 s worker CPU, 4.020 s worker Wall, Wall: 1.970 s, Cores in use: 2.19, Total efficiency (on 4 cores): 54.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T15:27:25.227164
Cut to 1 unWISE tiles
Reading WISE tile 0947m621 band 1
Reading WISE tile 0947m621 band 2
Reading WISE tile 0947m621 band 4
Reading WISE tile 0947m621 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 790 MB, VmSize: 787 MB, VmRSS: 138 MB, VmData: 169 MB, maxrss: 0.201332 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 1002 MB, VmSize: 794 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.2116 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 1001 MB, VmSize: 794 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206944 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 1006 MB, VmSize: 797 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.18758 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 7.45 s, CPU: 0.27 s, VmPeak: 1064 MB, VmSize: 1064 MB, VmRSS: 244 MB, VmData: 269 MB, maxrss: 0.454668 MB
Stage wise_forced finished: 2020-06-06T15:27:32.678300
Resources for stage wise_forced : 3.018 s worker CPU, 12.713 s worker Wall, Wall: 7.452 s, Cores in use: 0.44, Total efficiency (on 4 cores): 11.0 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T15:27:32.679736
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor-i/cus/tractor-custom-093434m61835.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/tractor-custom-093434m61835.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/brick-custom-093434m61835.sha256sum
Stage writecat : Wall: 0.44 s, CPU: 0.27 s, VmPeak: 1197 MB, VmSize: 1069 MB, VmRSS: 245 MB, VmData: 269 MB, maxrss: 0.454668 MB
Stage writecat finished: 2020-06-06T15:27:33.119256
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.440 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.4 %
Stage writecat finished
All done: 17.760 s worker CPU, 83.548 s worker Wall, Wall: 45.938 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.3 %
Finished galaxy PGC351959 in 0.945 minutes.
Started working on galaxy PGC351959 at Thu Jul 16 04:07:49 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-16T04:07:50.678283
legacypipe git version: DR9.5.4-57-g2fd66136
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.4345005', '-61.8353889', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.4345005 -61.8353889
Starting process 32102 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB
Starting process 32103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB
Starting process 32104 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 32105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 32106 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 32107 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 32108 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 32109 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 32110 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 32111 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 32112 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 32113 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 32114 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 32115 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 32116 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 32117 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 32118 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 32119 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 32120 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 32121 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 32122 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 32123 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 32124 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 32125 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 32126 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 32127 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 32128 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 32129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 32130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 32131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 32132 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 32133 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-16T04:07:51.072650
Keeping 3 CCDs:
   c4d_171207_070447_ooi_z_v1.fits.fz c4d_171207_070447_ooi_z_v1-N31 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58094.295 object DES survey hex 908-613 tiling 7
   c4d_171212_064552_ooi_r_v1.fits.fz c4d_171212_064552_ooi_r_v1-N31 r exptime 90.0 propid 2012B-0001 seeing 1.35 MJD 58099.282 object DES survey hex 908-613 tiling 7
   c4d_171214_073326_ooi_g_v1.fits.fz c4d_171214_073326_ooi_g_v1-N31 g exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 58101.315 object DES survey hex 908-613 tiling 7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE
Stage tims : Wall: 2.91 s, CPU: 0.73 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 167 MB, VmData: 201 MB, maxrss: 0.17148 MB
Stage tims finished: 2020-07-16T04:07:53.979762
Zeroing out 3760 weight-map pixels below quantization error (= median 7.36e-05)
Zeroing out 3760 weight-map pixels below quantization error (= median 2.65e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 1.457 s worker CPU, 5.791 s worker Wall, Wall: 2.910 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Running stage refs
Zeroing out 3760 weight-map pixels below quantization error (= median 0.000246)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Running stage refs at 2020-07-16T04:07:55.791546
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11547.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11622.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/reference-custom-093434m61835.fits
Stage refs : Wall: 5.53 s, CPU: 4.28 s, VmPeak: 1064 MB, VmSize: 1059 MB, VmRSS: 232 MB, VmData: 264 MB, maxrss: 0.237892 MB
Stage refs finished: 2020-07-16T04:08:01.323005
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 5.535 s, Cores in use: 0.77, Total efficiency (on 32 cores): 2.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-16T04:08:02.121979
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-pre-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-post-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-pos-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-neg-custom-093434m61835.jpg
Stage outliers : Wall: 9.17 s, CPU: 0.30 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 238 MB, VmData: 267 MB, maxrss: 0.243512 MB
Stage outliers finished: 2020-07-16T04:08:11.289235
Resources for stage outliers : 0.170 s worker CPU, 0.232 s worker Wall, Wall: 9.170 s, Cores in use: 0.05, Total efficiency (on 32 cores): 0.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-16T04:08:13.180998
Stage halos : Wall: 0.37 s, CPU: 0.27 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 238 MB, VmData: 267 MB, maxrss: 0.243592 MB
Stage halos finished: 2020-07-16T04:08:13.550382
Resources for stage halos : 0.117 s worker CPU, 0.239 s worker Wall, Wall: 0.372 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-16T04:08:16.128054
PSF sigmas in coadd pixels: ['2.15']
Using average PSF sigma 2.1505686572466653
Gaussian PSF norm 0.1311721859347839 vs pixelized 0.10551156
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.19']
Using average PSF sigma 2.1949162453191624
Gaussian PSF norm 0.12852189343236595 vs pixelized 0.1050483
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.70']
Using average PSF sigma 1.7016829164034006
Gaussian PSF norm 0.16577400469536407 vs pixelized 0.12940602
average tim pixel scale / coadd scale: 1.001046076932396
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 4.12 s, CPU: 0.06 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.245072 MB
Stage fit_on_coadds finished: 2020-07-16T04:08:20.246161
Resources for stage fit_on_coadds : 0.025 s worker CPU, 0.030 s worker Wall, Wall: 4.121 s, Cores in use: 0.02, Total efficiency (on 32 cores): 0.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-16T04:08:21.035232
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22492 potential peaks
Of 22492 potential peaks: 22489 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED z : 2 new peaks
Found 21619 potential peaks
Of 21619 potential peaks: 21614 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 22449 potential peaks
Of 22449 potential peaks: 22448 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21618 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21619 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 6 new sources
Median coadd sky for g : -0.00018060706
Median coadd sky for r : -6.436036e-05
Median coadd sky for z : 0.00032627623
Stage srcs : Wall: 0.98 s, CPU: 0.44 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 241 MB, VmData: 268 MB, maxrss: 0.24682 MB
Stage srcs finished: 2020-07-16T04:08:22.018727
Resources for stage srcs : 1.484 s worker CPU, 1.521 s worker Wall, Wall: 0.986 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-16T04:08:24.237684
Blob 1 of 6, id: 0, sources: 7, size: 233x178, npix 33615, brick X: 0,233, Y: 0,178, one pixel: 0 0
Blob 2 of 6, id: 4, sources: 2, size: 55x28, npix 1014, brick X: 59,114, Y: 205,233, one pixel: 80 205
Blob 3 of 6, id: 3, sources: 1, size: 37x28, npix 798, brick X: 0,37, Y: 205,233, one pixel: 16 205
Blob 4 of 6, id: 2, sources: 1, size: 30x30, npix 605, brick X: 163,193, Y: 184,214, one pixel: 176 184
Blob 5 of 6, id: 1, sources: 1, size: 23x24, npix 358, brick X: 199,222, Y: 156,180, one pixel: 209 156
Blob 6 of 6, id: 5, sources: 1, size: 20x20, npix 220, brick X: 110,130, Y: 206,226, one pixel: 119 206
Blob 6 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091868 MB
Blob 5 finished, total: Wall: 0.26 s, CPU: 0.24 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090096 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43894, -61.82628), pm (2.2, 27.4), parallax 1.883 with NanoMaggies: g=15.6, r=14.9, z=14.7
Reset brightness to NanoMaggies: g=16, r=15.1, z=14.6
Blob 2 finished, total: Wall: 0.38 s, CPU: 0.36 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091352 MB
Blob 4 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 108 MB, VmData: 164 MB, maxrss: 0.110488 MB
Blob 3 finished, total: Wall: 1.14 s, CPU: 1.13 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09346 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45319, -61.88160), pm (3.2, -1.4), parallax 0.621 with NanoMaggies: g=11.9, r=11.1, z=10.8
Reset brightness to NanoMaggies: g=11.9, r=11.1, z=10.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43063, -61.83646), pm (5.0, 10.3), parallax 0.853 with NanoMaggies: g=(flux -319), r=15.1, z=15.1
Reset brightness to NanoMaggies: g=16.4, r=15.7, z=15.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45189, -61.83766), pm (-3.5, -4.8), parallax 0.489 with NanoMaggies: g=18.4, r=17.5, z=17.1
Reset brightness to NanoMaggies: g=18.4, r=17.5, z=17.1
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.37992, ee1=-0.150687, ee2=0.757993
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.44133, -61.84292), pm (-0.5, 4.2), parallax 0.099 with NanoMaggies: g=19.4, r=18.8, z=18.6
Reset brightness to NanoMaggies: g=19.4, r=18.8, z=18.6
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 3.12 s, CPU: 3.07 s, VmPeak: 686 MB, VmSize: 680 MB, VmRSS: 118 MB, VmData: 158 MB, maxrss: 0.127312 MB
Old catalog: 16
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/blobs-custom-093434m61835.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/all-models-custom-093434m61835.fits
Stage fitblobs : Wall: 7.44 s, CPU: 0.29 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 242 MB, VmData: 269 MB, maxrss: 0.248288 MB
Stage fitblobs finished: 2020-07-16T04:08:31.677363
Resources for stage fitblobs : 5.785 s worker CPU, 5.892 s worker Wall, Wall: 7.444 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-16T04:08:33.989904
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-resid.jpg
Stage coadds : Wall: 9.69 s, CPU: 0.52 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.251708 MB
Stage coadds finished: 2020-07-16T04:08:43.684438
Resources for stage coadds : 30.155 s worker CPU, 31.131 s worker Wall, Wall: 9.697 s, Cores in use: 3.16, Total efficiency (on 32 cores): 9.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-16T04:08:43.697806
Cut to 1 unWISE tiles
Reading WISE tile 0947m621 band 1
Reading WISE tile 0947m621 band 2
Reading WISE tile 0947m621 band 3
Reading WISE tile 0947m621 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 1011 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 175 MB, maxrss: 0.186996 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 783 MB, VmSize: 783 MB, VmRSS: 133 MB, VmData: 169 MB, maxrss: 0.19214 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 783 MB, VmSize: 783 MB, VmRSS: 133 MB, VmData: 169 MB, maxrss: 0.191908 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 784 MB, VmSize: 784 MB, VmRSS: 135 MB, VmData: 170 MB, maxrss: 0.193948 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 11.00 s, CPU: 0.41 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.252224 MB
Stage wise_forced finished: 2020-07-16T04:08:54.699034
Resources for stage wise_forced : 3.026 s worker CPU, 4.166 s worker Wall, Wall: 11.005 s, Cores in use: 0.31, Total efficiency (on 32 cores): 1.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-16T04:08:54.715138
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor-i/cus/tractor-custom-093434m61835.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/tractor-custom-093434m61835.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/brick-custom-093434m61835.sha256sum
Stage writecat : Wall: 0.97 s, CPU: 0.36 s, VmPeak: 1201 MB, VmSize: 1073 MB, VmRSS: 248 MB, VmData: 272 MB, maxrss: 0.384772 MB
Stage writecat finished: 2020-07-16T04:08:55.689101
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.977 s, Cores in use: 0.38, Total efficiency (on 32 cores): 1.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-writecat.p
All done: 42.226 s worker CPU, 49.010 s worker Wall, Wall: 64.638 s, Cores in use: 0.77, Total efficiency (on 32 cores): 2.4 %
Finished galaxy PGC351959 in 1.173 minutes.
Started working on galaxy PGC351959 at Thu Jul 16 05:42:11 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-16T05:42:12.371403
legacypipe git version: DR9.5.4-57-g2fd66136
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.4345005', '-61.8353889', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.4345005 -61.8353889
Starting process 46587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05884 MB
Starting process 46589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05884 MB
Starting process 46591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058844 MB
Starting process 46593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB
Starting process 46595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058944 MB
Starting process 46597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058944 MB
Starting process 46599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 46601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 46602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 46604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 46607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 46609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 46611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 46613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 46615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 46619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-16T05:42:12.811874
Keeping 3 CCDs:
   c4d_171207_070447_ooi_z_v1.fits.fz c4d_171207_070447_ooi_z_v1-N31 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58094.295 object DES survey hex 908-613 tiling 7
   c4d_171212_064552_ooi_r_v1.fits.fz c4d_171212_064552_ooi_r_v1-N31 r exptime 90.0 propid 2012B-0001 seeing 1.35 MJD 58099.282 object DES survey hex 908-613 tiling 7
   c4d_171214_073326_ooi_g_v1.fits.fz c4d_171214_073326_ooi_g_v1-N31 g exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 58101.315 object DES survey hex 908-613 tiling 7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE
Stage tims : Wall: 8.98 s, CPU: 0.81 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 167 MB, VmData: 201 MB, maxrss: 0.171272 MB
Stage tims finished: 2020-07-16T05:42:21.787847
Zeroing out 3760 weight-map pixels below quantization error (= median 0.000246)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 3760 weight-map pixels below quantization error (= median 7.36e-05)
Zeroing out 3760 weight-map pixels below quantization error (= median 2.65e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 1.591 s worker CPU, 21.005 s worker Wall, Wall: 8.978 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-16T05:42:21.804943
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11547.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11622.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/reference-custom-093434m61835.fits
Stage refs : Wall: 8.63 s, CPU: 4.39 s, VmPeak: 1064 MB, VmSize: 1059 MB, VmRSS: 232 MB, VmData: 264 MB, maxrss: 0.237648 MB
Stage refs finished: 2020-07-16T05:42:30.434773
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.631 s, Cores in use: 0.51, Total efficiency (on 16 cores): 3.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-16T05:42:30.506891
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-pre-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-post-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-pos-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-neg-custom-093434m61835.jpg
Stage outliers : Wall: 2.11 s, CPU: 1.01 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 238 MB, VmData: 267 MB, maxrss: 0.2434 MB
Stage outliers finished: 2020-07-16T05:42:32.618531
Resources for stage outliers : 0.140 s worker CPU, 0.368 s worker Wall, Wall: 2.113 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-16T05:42:32.630526
Stage halos : Wall: 0.50 s, CPU: 0.38 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 238 MB, VmData: 267 MB, maxrss: 0.243524 MB
Stage halos finished: 2020-07-16T05:42:33.127753
Resources for stage halos : 0.129 s worker CPU, 0.288 s worker Wall, Wall: 0.499 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-16T05:42:34.246944
PSF sigmas in coadd pixels: ['2.15']
Using average PSF sigma 2.1505686572466653
Gaussian PSF norm 0.1311721859347839 vs pixelized 0.10551156
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.19']
Using average PSF sigma 2.1949162453191624
Gaussian PSF norm 0.12852189343236595 vs pixelized 0.1050483
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.70']
Using average PSF sigma 1.7016829164034006
Gaussian PSF norm 0.16577400469536407 vs pixelized 0.12940602
average tim pixel scale / coadd scale: 1.001046076932396
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.07 s, CPU: 0.05 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.244996 MB
Stage fit_on_coadds finished: 2020-07-16T05:42:34.317046
Resources for stage fit_on_coadds : 0.019 s worker CPU, 0.019 s worker Wall, Wall: 0.071 s, Cores in use: 0.92, Total efficiency (on 16 cores): 5.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-16T05:42:34.327956
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22492 potential peaks
Of 22492 potential peaks: 22489 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED z : 2 new peaks
Found 21619 potential peaks
Of 21619 potential peaks: 21614 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 22449 potential peaks
Of 22449 potential peaks: 22448 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21618 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21619 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 6 new sources
Median coadd sky for g : -0.00018060706
Median coadd sky for r : -6.436036e-05
Median coadd sky for z : 0.00032627623
Stage srcs : Wall: 1.07 s, CPU: 0.54 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 241 MB, VmData: 268 MB, maxrss: 0.246716 MB
Stage srcs finished: 2020-07-16T05:42:35.401121
Resources for stage srcs : 1.496 s worker CPU, 1.500 s worker Wall, Wall: 1.075 s, Cores in use: 1.90, Total efficiency (on 16 cores): 11.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-16T05:42:35.564929
Blob 1 of 6, id: 0, sources: 7, size: 233x178, npix 33615, brick X: 0,233, Y: 0,178, one pixel: 0 0
Blob 2 of 6, id: 4, sources: 2, size: 55x28, npix 1014, brick X: 59,114, Y: 205,233, one pixel: 80 205
Blob 3 of 6, id: 3, sources: 1, size: 37x28, npix 798, brick X: 0,37, Y: 205,233, one pixel: 16 205
Blob 4 of 6, id: 2, sources: 1, size: 30x30, npix 605, brick X: 163,193, Y: 184,214, one pixel: 176 184
Blob 5 of 6, id: 1, sources: 1, size: 23x24, npix 358, brick X: 199,222, Y: 156,180, one pixel: 209 156
Blob 6 of 6, id: 5, sources: 1, size: 20x20, npix 220, brick X: 110,130, Y: 206,226, one pixel: 119 206
Blob 5 finished, total: Wall: 0.32 s, CPU: 0.25 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091296 MB
Blob 6 finished, total: Wall: 0.33 s, CPU: 0.27 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.09114 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43894, -61.82628), pm (2.2, 27.4), parallax 1.883 with NanoMaggies: g=15.6, r=14.9, z=14.7
Reset brightness to NanoMaggies: g=16, r=15.1, z=14.6
Blob 2 finished, total: Wall: 0.43 s, CPU: 0.37 s, VmPeak: 1008 MB, VmSize: 719 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143276 MB
Blob 4 finished, total: Wall: 0.80 s, CPU: 0.74 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 91 MB, VmData: 140 MB, maxrss: 0.093476 MB
Blob 3 finished, total: Wall: 1.22 s, CPU: 1.16 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 108 MB, VmData: 164 MB, maxrss: 0.110612 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45319, -61.88160), pm (3.2, -1.4), parallax 0.621 with NanoMaggies: g=11.9, r=11.1, z=10.8
Reset brightness to NanoMaggies: g=11.9, r=11.1, z=10.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43063, -61.83646), pm (5.0, 10.3), parallax 0.853 with NanoMaggies: g=(flux -319), r=15.1, z=15.1
Reset brightness to NanoMaggies: g=16.4, r=15.7, z=15.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45189, -61.83766), pm (-3.5, -4.8), parallax 0.489 with NanoMaggies: g=18.4, r=17.5, z=17.1
Reset brightness to NanoMaggies: g=18.4, r=17.5, z=17.1
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.37992, ee1=-0.150687, ee2=0.757993
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.44133, -61.84292), pm (-0.5, 4.2), parallax 0.099 with NanoMaggies: g=19.4, r=18.8, z=18.6
Reset brightness to NanoMaggies: g=19.4, r=18.8, z=18.6
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 3.15 s, CPU: 3.12 s, VmPeak: 1011 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14982 MB
Old catalog: 16
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/blobs-custom-093434m61835.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/all-models-custom-093434m61835.fits
Stage fitblobs : Wall: 4.06 s, CPU: 0.64 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 242 MB, VmData: 269 MB, maxrss: 0.248216 MB
Stage fitblobs finished: 2020-07-16T05:42:39.620394
Resources for stage fitblobs : 6.015 s worker CPU, 6.513 s worker Wall, Wall: 4.057 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.3 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-16T05:42:39.632569
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-resid.jpg
Stage coadds : Wall: 4.64 s, CPU: 0.56 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.251632 MB
Stage coadds finished: 2020-07-16T05:42:44.269752
Resources for stage coadds : 16.602 s worker CPU, 17.459 s worker Wall, Wall: 4.639 s, Cores in use: 3.70, Total efficiency (on 16 cores): 23.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-16T05:42:44.312730
Cut to 1 unWISE tiles
Reading WISE tile 0947m621 band 1
Reading WISE tile 0947m621 band 2
Reading WISE tile 0947m621 band 4
Reading WISE tile 0947m621 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.20 s, CPU: 0.06 s, VmPeak: 1008 MB, VmSize: 796 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.206332 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.20 s, CPU: 0.06 s, VmPeak: 795 MB, VmSize: 795 MB, VmRSS: 144 MB, VmData: 175 MB, maxrss: 0.184312 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 1011 MB, VmSize: 796 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.211692 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 179 MB, maxrss: 0.202972 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.34 s, CPU: 0.38 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.252148 MB
Stage wise_forced finished: 2020-07-16T05:42:46.652834
Resources for stage wise_forced : 3.256 s worker CPU, 4.664 s worker Wall, Wall: 2.342 s, Cores in use: 1.55, Total efficiency (on 16 cores): 9.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-16T05:42:46.699701
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor-i/cus/tractor-custom-093434m61835.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/tractor-custom-093434m61835.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/brick-custom-093434m61835.sha256sum
Stage writecat : Wall: 1.92 s, CPU: 1.47 s, VmPeak: 1201 MB, VmSize: 1073 MB, VmRSS: 248 MB, VmData: 272 MB, maxrss: 0.384648 MB
Stage writecat finished: 2020-07-16T05:42:48.618512
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.920 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-writecat.p
All done: 29.251 s worker CPU, 51.819 s worker Wall, Wall: 35.840 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 %
Finished galaxy PGC351959 in 0.644 minutes.
Started working on galaxy PGC351959 at Sat Jul 18 19:24:27 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T19:24:28.161306
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.4345005', '-61.8353889', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.4345005 -61.8353889 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.4345005 -61.8353889
Starting process 1227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 1228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 1229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 1230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB
Starting process 1231 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058952 MB
Starting process 1232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058952 MB
Starting process 1233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 1234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 1235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 1236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 1237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 1238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 1239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 1240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 1241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 1242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 1243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 1244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 1245 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 1246 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 1247 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 1248 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 1249 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 1250 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 1251 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 1252 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 1253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 1254 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 1255 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 1256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 1257 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 1258 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T19:24:28.941100
Keeping 3 CCDs:
   c4d_171207_070447_ooi_z_v1.fits.fz c4d_171207_070447_ooi_z_v1-N31 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 58094.295 object DES survey hex 908-613 tiling 7
   c4d_171212_064552_ooi_r_v1.fits.fz c4d_171212_064552_ooi_r_v1-N31 r exptime 90.0 propid 2012B-0001 seeing 1.35 MJD 58099.282 object DES survey hex 908-613 tiling 7
   c4d_171214_073326_ooi_g_v1.fits.fz c4d_171214_073326_ooi_g_v1-N31 g exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 58101.315 object DES survey hex 908-613 tiling 7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE
Stage tims : Wall: 4.02 s, CPU: 1.02 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 167 MB, VmData: 201 MB, maxrss: 0.171404 MB
Stage tims finished: 2020-07-18T19:24:32.957981
Zeroing out 3760 weight-map pixels below quantization error (= median 0.000246)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171212_905e4e2-g-20171214T073326_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Zeroing out 3760 weight-map pixels below quantization error (= median 7.36e-05)
Zeroing out 3760 weight-map pixels below quantization error (= median 2.65e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171208_904ccf3-r-20171212T064552_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171204_904491c-z-20171207T070447_oi[N31,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 1.439 s worker CPU, 6.966 s worker Wall, Wall: 4.019 s, Cores in use: 0.61, Total efficiency (on 32 cores): 1.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-18T19:24:33.193144
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11547.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11622.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/reference-custom-093434m61835.fits
Stage refs : Wall: 9.04 s, CPU: 4.58 s, VmPeak: 1064 MB, VmSize: 1059 MB, VmRSS: 232 MB, VmData: 264 MB, maxrss: 0.237804 MB
Stage refs finished: 2020-07-18T19:24:42.236153
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 9.046 s, Cores in use: 0.51, Total efficiency (on 32 cores): 1.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-18T19:24:42.376003
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-pre-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outlier-mask-custom-093434m61835.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-post-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-pos-custom-093434m61835.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/outliers-masked-neg-custom-093434m61835.jpg
Stage outliers : Wall: 1.07 s, CPU: 0.63 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 238 MB, VmData: 267 MB, maxrss: 0.243392 MB
Stage outliers finished: 2020-07-18T19:24:43.442699
Resources for stage outliers : 0.168 s worker CPU, 0.226 s worker Wall, Wall: 1.069 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T19:24:43.479054
Stage halos : Wall: 0.67 s, CPU: 0.50 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 238 MB, VmData: 267 MB, maxrss: 0.243576 MB
Stage halos finished: 2020-07-18T19:24:44.151490
Resources for stage halos : 0.125 s worker CPU, 0.380 s worker Wall, Wall: 0.675 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-18T19:24:44.168765
PSF sigmas in coadd pixels: ['2.15']
Using average PSF sigma 2.1505686572466653
Gaussian PSF norm 0.1311721859347839 vs pixelized 0.10551156
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.19']
Using average PSF sigma 2.1949162453191624
Gaussian PSF norm 0.12852189343236595 vs pixelized 0.1050483
average tim pixel scale / coadd scale: 1.0011063618514373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.70']
Using average PSF sigma 1.7016829164034006
Gaussian PSF norm 0.16577400469536407 vs pixelized 0.12940602
average tim pixel scale / coadd scale: 1.001046076932396
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.09 s, CPU: 0.05 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.245056 MB
Stage fit_on_coadds finished: 2020-07-18T19:24:44.258741
Resources for stage fit_on_coadds : 0.028 s worker CPU, 0.042 s worker Wall, Wall: 0.092 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T19:24:44.302255
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 22492 potential peaks
Of 22492 potential peaks: 22489 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED z : 2 new peaks
Found 21619 potential peaks
Of 21619 potential peaks: 21614 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 22449 potential peaks
Of 22449 potential peaks: 22448 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21618 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 21621 potential peaks
Of 21621 potential peaks: 21619 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 6 new sources
Median coadd sky for g : -0.00018060706
Median coadd sky for r : -6.436036e-05
Median coadd sky for z : 0.00032627623
Stage srcs : Wall: 1.38 s, CPU: 0.84 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 241 MB, VmData: 268 MB, maxrss: 0.246724 MB
Stage srcs finished: 2020-07-18T19:24:45.683267
Resources for stage srcs : 1.498 s worker CPU, 1.540 s worker Wall, Wall: 1.384 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T19:24:45.695714
Blob 1 of 6, id: 0, sources: 7, size: 233x178, npix 33615, brick X: 0,233, Y: 0,178, one pixel: 0 0
Blob 2 of 6, id: 4, sources: 2, size: 55x28, npix 1014, brick X: 59,114, Y: 205,233, one pixel: 80 205
Blob 3 of 6, id: 3, sources: 1, size: 37x28, npix 798, brick X: 0,37, Y: 205,233, one pixel: 16 205
Blob 4 of 6, id: 2, sources: 1, size: 30x30, npix 605, brick X: 163,193, Y: 184,214, one pixel: 176 184
Blob 5 of 6, id: 1, sources: 1, size: 23x24, npix 358, brick X: 199,222, Y: 156,180, one pixel: 209 156
Blob 6 of 6, id: 5, sources: 1, size: 20x20, npix 220, brick X: 110,130, Y: 206,226, one pixel: 119 206
Blob 5 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091548 MB
Blob 6 finished, total: Wall: 0.28 s, CPU: 0.26 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090144 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43894, -61.82628), pm (2.2, 27.4), parallax 1.883 with NanoMaggies: g=15.6, r=14.9, z=14.7
Reset brightness to NanoMaggies: g=16, r=15.1, z=14.6
Blob 2 finished, total: Wall: 0.40 s, CPU: 0.37 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091 MB
Blob 4 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 1011 MB, VmSize: 719 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141356 MB
Blob 3 finished, total: Wall: 1.21 s, CPU: 1.18 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.090752 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45319, -61.88160), pm (3.2, -1.4), parallax 0.621 with NanoMaggies: g=11.9, r=11.1, z=10.8
Reset brightness to NanoMaggies: g=11.9, r=11.1, z=10.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.43063, -61.83646), pm (5.0, 10.3), parallax 0.853 with NanoMaggies: g=(flux -319), r=15.1, z=15.1
Reset brightness to NanoMaggies: g=16.4, r=15.7, z=15.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45189, -61.83766), pm (-3.5, -4.8), parallax 0.489 with NanoMaggies: g=18.4, r=17.5, z=17.1
Reset brightness to NanoMaggies: g=18.4, r=17.5, z=17.1
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.37992, ee1=-0.150687, ee2=0.757993
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.44133, -61.84292), pm (-0.5, 4.2), parallax 0.099 with NanoMaggies: g=19.4, r=18.8, z=18.6
Reset brightness to NanoMaggies: g=19.4, r=18.8, z=18.6
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 3.24 s, CPU: 3.18 s, VmPeak: 685 MB, VmSize: 680 MB, VmRSS: 118 MB, VmData: 158 MB, maxrss: 0.12696 MB
Old catalog: 16
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/blobs-custom-093434m61835.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/metrics/cus/all-models-custom-093434m61835.fits
Stage fitblobs : Wall: 4.03 s, CPU: 0.70 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 242 MB, VmData: 269 MB, maxrss: 0.248276 MB
Stage fitblobs finished: 2020-07-18T19:24:49.722502
Resources for stage fitblobs : 6.028 s worker CPU, 6.196 s worker Wall, Wall: 4.029 s, Cores in use: 1.67, Total efficiency (on 32 cores): 5.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T19:24:49.734692
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-resid.jpg
Stage coadds : Wall: 3.76 s, CPU: 0.67 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.251696 MB
Stage coadds finished: 2020-07-18T19:24:53.495800
Resources for stage coadds : 48.922 s worker CPU, 61.253 s worker Wall, Wall: 3.763 s, Cores in use: 13.18, Total efficiency (on 32 cores): 41.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T19:24:53.508279
Cut to 1 unWISE tiles
Reading WISE tile 0947m621 band 1
Reading WISE tile 0947m621 band 2
Reading WISE tile 0947m621 band 3
Reading WISE tile 0947m621 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 1006 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.186812 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 785 MB, VmSize: 785 MB, VmRSS: 135 MB, VmData: 169 MB, maxrss: 0.193352 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 1008 MB, VmSize: 791 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.201948 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/094/0947m621/unwise-0947m621-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 794 MB, VmSize: 794 MB, VmRSS: 143 MB, VmData: 178 MB, maxrss: 0.195124 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/tmp-legacysurvey-custom-093434m61835-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.13 s, CPU: 0.55 s, VmPeak: 1069 MB, VmSize: 1069 MB, VmRSS: 246 MB, VmData: 272 MB, maxrss: 0.252208 MB
Stage wise_forced finished: 2020-07-18T19:24:55.640907
Resources for stage wise_forced : 3.104 s worker CPU, 4.239 s worker Wall, Wall: 2.135 s, Cores in use: 1.71, Total efficiency (on 32 cores): 5.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T19:24:55.654349
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/coadd/cus/custom-093434m61835/legacysurvey-custom-093434m61835-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor-i/cus/tractor-custom-093434m61835.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/tractor-custom-093434m61835.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/tractor/cus/brick-custom-093434m61835.sha256sum
Stage writecat : Wall: 0.68 s, CPU: 0.55 s, VmPeak: 1201 MB, VmSize: 1073 MB, VmRSS: 248 MB, VmData: 272 MB, maxrss: 0.384756 MB
Stage writecat finished: 2020-07-18T19:24:56.332682
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.681 s, Cores in use: 0.81, Total efficiency (on 32 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC351959/PGC351959-largegalaxy-writecat.p
All done: 61.317 s worker CPU, 80.849 s worker Wall, Wall: 27.627 s, Cores in use: 2.59, Total efficiency (on 32 cores): 8.1 %
Finished galaxy PGC351959 in 0.510 minutes.