Started working on galaxy PGC649027 at Sat Jun  6 16:04:25 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.257958 -35.4291667 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T16:04:26.787224
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.257958', '-35.4291667', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.257958 -35.4291667 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.257958 -35.4291667
Starting process 31633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 31634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 31635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 31636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T16:04:27.071558
Keeping 7 CCDs:
   c4d_180122_043141_ooi_g_v1.fits.fz c4d_180122_043141_ooi_g_v1-N19 g exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 58140.189 object DES survey hex 928-349 tiling 8
   c4d_171129_081225_ooi_z_v1.fits.fz c4d_171129_081225_ooi_z_v1-N19 z exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 58086.342 object DES survey hex 928-349 tiling 8
   c4d_170216_024924_ooi_z_ls9.fits.fz c4d_170216_024924_ooi_z_ls9-S7 z exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57800.116 object DES survey hex 910-359 tiling 7
   c4d_170128_045649_ooi_g_ls9.fits.fz c4d_170128_045649_ooi_g_ls9-S7 g exptime 90.0 propid 2012B-0001 seeing 1.31 MJD 57781.205 object DES survey hex 910-359 tiling 7
   c4d_170128_044803_ooi_r_ls9.fits.fz c4d_170128_044803_ooi_r_ls9-S7 r exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57781.198 object DES survey hex 910-359 tiling 7
   c4d_180218_025409_ooi_r_v1.fits.fz c4d_180218_025409_ooi_r_v1-S7 r exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58167.121 object DES survey hex 910-359 tiling 9
   c4d_180223_005147_ooi_z_v1.fits.fz c4d_180223_005147_ooi_z_v1-S7 z exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58172.036 object DES survey hex 910-359 tiling 9
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-g-20180122T043141_oi[N19,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171129T081225_oi[N19,noinherit][2046,4094][real]: DE
Stage tims : Wall: 64.53 s, CPU: 0.72 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 167 MB, VmData: 201 MB, maxrss: 0.454648 MB
Stage tims finished: 2020-06-06T16:05:31.598507
Zeroing out 1102 weight-map pixels below quantization error (= median 0.000283)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-g-20180122T043141_oi[N19,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 1.909 s worker CPU, 149.654 s worker Wall, Wall: 64.528 s, Cores in use: 0.04, Total efficiency (on 4 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-tims.p
Running stage refs
Zeroing out 3178 weight-map pixels below quantization error (= median 4.31e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171129T081225_oi[N19,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Running stage refs at 2020-06-06T16:05:31.607536
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09696.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09697.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09569.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09825.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/reference-custom-093257m35429.fits
Stage refs : Wall: 7.62 s, CPU: 4.58 s, VmPeak: 1052 MB, VmSize: 1046 MB, VmRSS: 222 MB, VmData: 253 MB, maxrss: 0.454648 MB
Stage refs finished: 2020-06-06T16:05:39.230169
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.623 s, Cores in use: 0.60, Total efficiency (on 4 cores): 15.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T16:05:39.231450
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outlier-mask-custom-093257m35429.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-pre-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outlier-mask-custom-093257m35429.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-post-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-masked-pos-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-masked-neg-custom-093257m35429.jpg
Stage outliers : Wall: 2.24 s, CPU: 1.96 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 233 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage outliers finished: 2020-06-06T16:05:41.474037
Resources for stage outliers : 0.170 s worker CPU, 0.260 s worker Wall, Wall: 2.243 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T16:05:41.475354
Stage halos : Wall: 7.04 s, CPU: 3.63 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 233 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage halos finished: 2020-06-06T16:05:48.511482
Resources for stage halos : 0.095 s worker CPU, 6.742 s worker Wall, Wall: 7.037 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T16:05:48.513237
PSF sigmas in coadd pixels: ['2.30']
Using average PSF sigma 2.300226976360587
Gaussian PSF norm 0.12263780690904155 vs pixelized 0.10134491
average tim pixel scale / coadd scale: 1.0010376790332258
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.68']
Using average PSF sigma 1.6770512847185948
Gaussian PSF norm 0.16820880455138434 vs pixelized 0.13989106
average tim pixel scale / coadd scale: 1.0010448772325145
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.07 s, CPU: 0.05 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 234 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage fit_on_coadds finished: 2020-06-06T16:05:48.583452
Resources for stage fit_on_coadds : 0.035 s worker CPU, 0.035 s worker Wall, Wall: 0.071 s, Cores in use: 1.18, Total efficiency (on 4 cores): 29.4 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T16:05:48.584965
SED-matched filters: [('z', array([0., 1.])), ('g', array([1., 0.])), ('Flat', [1.0, 1.0]), ('Red', [2.5, 0.4])]
Found 47 potential peaks
Of 47 potential peaks: 33 in veto map, 6 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 21 potential peaks
Of 21 potential peaks: 13 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 33 potential peaks
Of 33 potential peaks: 28 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 42 potential peaks
Of 42 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 10 new sources
Median coadd sky for g : -3.05929e-06
Median coadd sky for z : 0.0004621406
Stage srcs : Wall: 2.53 s, CPU: 2.47 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage srcs finished: 2020-06-06T16:05:51.113462
Resources for stage srcs : 0.081 s worker CPU, 0.081 s worker Wall, Wall: 2.529 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T16:05:51.123828
Blob 1 of 7, id: 0, sources: 8, size: 229x193, npix 20774, brick X: 46,275, Y: 0,193, one pixel: 136 0
Blob 2 of 7, id: 2, sources: 1, size: 56x73, npix 2520, brick X: 13,69, Y: 120,193, one pixel: 30 120
Blob 3 of 7, id: 4, sources: 1, size: 50x49, npix 1759, brick X: 43,93, Y: 193,242, one pixel: 66 193
Blob 4 of 7, id: 5, sources: 2, size: 36x43, npix 925, brick X: 129,165, Y: 208,251, one pixel: 139 208
Blob 5 of 7, id: 1, sources: 2, size: 33x44, npix 914, brick X: 0,33, Y: 22,66, one pixel: 15 22
Blob 3 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 681 MB, VmSize: 681 MB, VmRSS: 110 MB, VmData: 158 MB, maxrss: 0.11276 MB
Blob 6 of 7, id: 3, sources: 1, size: 28x26, npix 465, brick X: 237,265, Y: 131,157, one pixel: 251 131
Blob 7 of 7, id: 6, sources: 1, size: 24x19, npix 323, brick X: 98,122, Y: 256,275, one pixel: 109 256
Blob 5 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 681 MB, VmSize: 681 MB, VmRSS: 115 MB, VmData: 158 MB, maxrss: 0.117356 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 1007 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144864 MB
Blob 6 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 681 MB, VmSize: 681 MB, VmRSS: 115 MB, VmData: 158 MB, maxrss: 0.117356 MB
Blob 2 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 1001 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148532 MB
Blob 7 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 1007 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14714 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.24092, -35.43515), pm (-6.1, 6.6), parallax 1.147 with NanoMaggies: g=13.2, z=12.9
Reset brightness to NanoMaggies: g=13.2, z=12.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39198, ee1=0.274265, ee2=-0.16171
Blob 1 finished, total: Wall: 4.80 s, CPU: 4.80 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 138 MB, VmData: 172 MB, maxrss: 0.140828 MB
Old catalog: 20
New catalog: 17
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/blobs-custom-093257m35429.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/all-models-custom-093257m35429.fits
Stage fitblobs : Wall: 8.66 s, CPU: 3.70 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage fitblobs finished: 2020-06-06T16:05:59.788419
Resources for stage fitblobs : 8.874 s worker CPU, 8.890 s worker Wall, Wall: 8.666 s, Cores in use: 1.45, Total efficiency (on 4 cores): 36.3 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T16:05:59.789860
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-resid.jpg
Stage coadds : Wall: 24.05 s, CPU: 23.14 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 236 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage coadds finished: 2020-06-06T16:06:23.843427
Resources for stage coadds : 2.330 s worker CPU, 2.672 s worker Wall, Wall: 24.054 s, Cores in use: 1.06, Total efficiency (on 4 cores): 26.5 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T16:06:23.844666
Cut to 1 unWISE tiles
Reading WISE tile 0931m349 band 1
Reading WISE tile 0931m349 band 2
Reading WISE tile 0931m349 band 3
Reading WISE tile 0931m349 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 1007 MB, VmSize: 795 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20698 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 793 MB, VmSize: 793 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.186736 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 791 MB, VmSize: 789 MB, VmRSS: 145 MB, VmData: 170 MB, maxrss: 0.209944 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 1001 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.209104 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 20.81 s, CPU: 12.88 s, VmPeak: 1056 MB, VmSize: 1056 MB, VmRSS: 237 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage wise_forced finished: 2020-06-06T16:06:44.657534
Resources for stage wise_forced : 2.953 s worker CPU, 22.897 s worker Wall, Wall: 20.814 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.0 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T16:06:44.659339
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor-i/cus/tractor-custom-093257m35429.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor/cus/tractor-custom-093257m35429.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor/cus/brick-custom-093257m35429.sha256sum
Stage writecat : Wall: 2.15 s, CPU: 1.46 s, VmPeak: 1188 MB, VmSize: 1060 MB, VmRSS: 239 MB, VmData: 262 MB, maxrss: 0.454648 MB
Stage writecat finished: 2020-06-06T16:06:46.807993
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.150 s, Cores in use: 0.68, Total efficiency (on 4 cores): 16.9 %
Stage writecat finished
All done: 16.447 s worker CPU, 191.233 s worker Wall, Wall: 139.741 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.7 %
Missing file /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth-r.fits.fz; please check the logfile.
ERROR: galaxy PGC649027; please check the logfile.
Finished galaxy PGC649027 in 2.363 minutes.
Started working on galaxy PGC649027 at Thu Jun 25 03:20:43 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.257958 -35.4291667 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-25T03:20:44.626659
legacypipe git version: DR9.5.2-150-g3ed0fdf5
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.257958', '-35.4291667', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.257958 -35.4291667 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.257958 -35.4291667
Starting process 26896 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.05776 MB
Starting process 26897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.05776 MB
Starting process 26898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057764 MB
Starting process 26899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057776 MB
Starting process 26900 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057776 MB
Starting process 26901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.05778 MB
Starting process 26902 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05778 MB
Starting process 26903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.05778 MB
Starting process 26904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057784 MB
Starting process 26905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057784 MB
Starting process 26906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057784 MB
Starting process 26907 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057784 MB
Starting process 26908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057784 MB
Starting process 26909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057792 MB
Starting process 26910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057792 MB
Starting process 26911 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057796 MB
Starting process 26912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.0578 MB
Starting process 26913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057804 MB
Starting process 26914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057804 MB
Starting process 26915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057808 MB
Starting process 26916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057808 MB
Starting process 26917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057812 MB
Starting process 26918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057812 MB
Starting process 26919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057812 MB
Starting process 26920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057816 MB
Starting process 26921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057816 MB
Starting process 26922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057816 MB
Starting process 26923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.05782 MB
Starting process 26924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057824 MB
Starting process 26926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057828 MB
Starting process 26927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057828 MB
Starting process 26925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 57 MB, VmData: 127 MB, maxrss: 0.057828 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-srcs.p and forcing stage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-tims.p and forcing stage tims
Running stage tims
Running stage tims at 2020-06-25T03:20:45.157862
Keeping 7 CCDs:
   c4d_180122_043141_ooi_g_v1.fits.fz c4d_180122_043141_ooi_g_v1-N19 g exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 58140.189 object DES survey hex 928-349 tiling 8
   c4d_171129_081225_ooi_z_v1.fits.fz c4d_171129_081225_ooi_z_v1-N19 z exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 58086.342 object DES survey hex 928-349 tiling 8
   c4d_170216_024924_ooi_z_ls9.fits.fz c4d_170216_024924_ooi_z_ls9-S7 z exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57800.116 object DES survey hex 910-359 tiling 7
   c4d_170128_045649_ooi_g_ls9.fits.fz c4d_170128_045649_ooi_g_ls9-S7 g exptime 90.0 propid 2012B-0001 seeing 1.31 MJD 57781.205 object DES survey hex 910-359 tiling 7
   c4d_170128_044803_ooi_r_ls9.fits.fz c4d_170128_044803_ooi_r_ls9-S7 r exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57781.198 object DES survey hex 910-359 tiling 7
   c4d_180218_025409_ooi_r_v1.fits.fz c4d_180218_025409_ooi_r_v1-S7 r exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58167.121 object DES survey hex 910-359 tiling 9
   c4d_180223_005147_ooi_z_v1.fits.fz c4d_180223_005147_ooi_z_v1-S7 z exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58172.036 object DES survey hex 910-359 tiling 9
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171129T081225_oi[N19,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-g-20180122T043141_oi[N19,noinherit][2046,4094][real]: DE
Stage tims : Wall: 3.18 s, CPU: 0.77 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 168 MB, VmData: 201 MB, maxrss: 0.171628 MB
Stage tims finished: 2020-06-25T03:20:48.335722
Zeroing out 1102 weight-map pixels below quantization error (= median 0.000283)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-g-20180122T043141_oi[N19,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 2.060 s worker CPU, 9.230 s worker Wall, Wall: 3.183 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-25T03:20:48.357493
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09696.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09697.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09569.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09825.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/reference-custom-093257m35429.fits
Stage refs : Wall: 4.33 s, CPU: 3.87 s, VmPeak: 1053 MB, VmSize: 1047 MB, VmRSS: 224 MB, VmData: 255 MB, maxrss: 0.228904 MB
Stage refs finished: 2020-06-25T03:20:52.690664
Zeroing out 3178 weight-map pixels below quantization error (= median 4.31e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171129T081225_oi[N19,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.336 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-06-25T03:20:52.702789
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outlier-mask-custom-093257m35429.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-pre-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outlier-mask-custom-093257m35429.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-post-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-masked-pos-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-masked-neg-custom-093257m35429.jpg
Stage outliers : Wall: 0.66 s, CPU: 0.37 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 234 MB, VmData: 263 MB, maxrss: 0.23994 MB
Stage outliers finished: 2020-06-25T03:20:53.358845
Resources for stage outliers : 0.205 s worker CPU, 0.260 s worker Wall, Wall: 0.659 s, Cores in use: 0.88, Total efficiency (on 32 cores): 2.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-06-25T03:20:53.378570
Stage halos : Wall: 0.35 s, CPU: 0.19 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 234 MB, VmData: 263 MB, maxrss: 0.239988 MB
Stage halos finished: 2020-06-25T03:20:53.726729
Resources for stage halos : 0.139 s worker CPU, 0.257 s worker Wall, Wall: 0.351 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-25T03:20:53.739769
PSF sigmas in coadd pixels: ['2.30']
Using average PSF sigma 2.300226976360587
Gaussian PSF norm 0.12263780690904155 vs pixelized 0.10134491
average tim pixel scale / coadd scale: 1.0010376790332258
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.68']
Using average PSF sigma 1.6770512847185948
Gaussian PSF norm 0.16820880455138434 vs pixelized 0.13989106
average tim pixel scale / coadd scale: 1.0010448772325145
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.05 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 236 MB, VmData: 263 MB, maxrss: 0.241352 MB
Stage fit_on_coadds finished: 2020-06-25T03:20:53.855744
Resources for stage fit_on_coadds : 0.052 s worker CPU, 0.067 s worker Wall, Wall: 0.118 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-06-25T03:20:53.867129
SED-matched filters: [('z', array([0., 1.])), ('g', array([1., 0.])), ('Flat', [1.0, 1.0]), ('Red', [2.5, 0.4])]
Found 47 potential peaks
Of 47 potential peaks: 33 in veto map, 6 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 21 potential peaks
Of 21 potential peaks: 13 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 33 potential peaks
Of 33 potential peaks: 28 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 42 potential peaks
Of 42 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 10 new sources
Median coadd sky for g : -3.05929e-06
Median coadd sky for z : 0.0004621406
Stage srcs : Wall: 0.49 s, CPU: 0.43 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 236 MB, VmData: 263 MB, maxrss: 0.241944 MB
Stage srcs finished: 2020-06-25T03:20:54.357661
Resources for stage srcs : 0.086 s worker CPU, 0.091 s worker Wall, Wall: 0.493 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-25T03:20:54.374966
Blob 1 of 7, id: 0, sources: 8, size: 229x193, npix 20774, brick X: 46,275, Y: 0,193, one pixel: 136 0
Blob 2 of 7, id: 2, sources: 1, size: 56x73, npix 2520, brick X: 13,69, Y: 120,193, one pixel: 30 120
Blob 3 of 7, id: 4, sources: 1, size: 50x49, npix 1759, brick X: 43,93, Y: 193,242, one pixel: 66 193
Blob 4 of 7, id: 5, sources: 2, size: 36x43, npix 925, brick X: 129,165, Y: 208,251, one pixel: 139 208
Blob 5 of 7, id: 1, sources: 2, size: 33x44, npix 914, brick X: 0,33, Y: 22,66, one pixel: 15 22
Blob 6 of 7, id: 3, sources: 1, size: 28x26, npix 465, brick X: 237,265, Y: 131,157, one pixel: 251 131
Blob 7 of 7, id: 6, sources: 1, size: 24x19, npix 323, brick X: 98,122, Y: 256,275, one pixel: 109 256
Blob 3 finished, total: Wall: 0.10 s, CPU: 0.07 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 82 MB, VmData: 136 MB, maxrss: 0.083944 MB
Blob 6 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092044 MB
Blob 7 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092048 MB
Blob 4 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.0952 MB
Blob 5 finished, total: Wall: 0.74 s, CPU: 0.71 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 87 MB, VmData: 136 MB, maxrss: 0.088736 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 0.92 s, CPU: 0.88 s, VmPeak: 660 MB, VmSize: 659 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09368 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.24092, -35.43515), pm (-6.1, 6.6), parallax 1.147 with NanoMaggies: g=13.2, z=12.9
Reset brightness to NanoMaggies: g=13.2, z=12.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39198, ee1=0.274265, ee2=-0.16171
Blob 1 finished, total: Wall: 3.67 s, CPU: 3.66 s, VmPeak: 676 MB, VmSize: 674 MB, VmRSS: 114 MB, VmData: 153 MB, maxrss: 0.1177 MB
Old catalog: 20
New catalog: 17
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/blobs-custom-093257m35429.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/all-models-custom-093257m35429.fits
Stage fitblobs : Wall: 4.89 s, CPU: 0.29 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 236 MB, VmData: 263 MB, maxrss: 0.242176 MB
Stage fitblobs finished: 2020-06-25T03:20:59.268061
Resources for stage fitblobs : 6.665 s worker CPU, 6.820 s worker Wall, Wall: 4.896 s, Cores in use: 1.42, Total efficiency (on 32 cores): 4.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-06-25T03:20:59.295597
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-resid.jpg
Stage coadds : Wall: 2.10 s, CPU: 0.49 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 237 MB, VmData: 263 MB, maxrss: 0.243024 MB
Stage coadds finished: 2020-06-25T03:21:01.395755
Resources for stage coadds : 22.963 s worker CPU, 36.780 s worker Wall, Wall: 2.103 s, Cores in use: 11.16, Total efficiency (on 32 cores): 34.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-06-25T03:21:01.414395
Cut to 1 unWISE tiles
Reading WISE tile 0931m349 band 1
Reading WISE tile 0931m349 band 2
Reading WISE tile 0931m349 band 3
Reading WISE tile 0931m349 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 1002 MB, VmSize: 791 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.182648 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 781 MB, VmSize: 781 MB, VmRSS: 133 MB, VmData: 169 MB, maxrss: 0.192908 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 845 MB, VmSize: 845 MB, VmRSS: 196 MB, VmData: 233 MB, maxrss: 0.201 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 790 MB, VmSize: 789 MB, VmRSS: 144 MB, VmData: 177 MB, maxrss: 0.194868 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.87 s, CPU: 0.40 s, VmPeak: 1057 MB, VmSize: 1057 MB, VmRSS: 238 MB, VmData: 263 MB, maxrss: 0.24354 MB
Stage wise_forced finished: 2020-06-25T03:21:03.287757
Resources for stage wise_forced : 3.013 s worker CPU, 4.506 s worker Wall, Wall: 1.876 s, Cores in use: 1.82, Total efficiency (on 32 cores): 5.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-06-25T03:21:03.301360
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor-i/cus/tractor-custom-093257m35429.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor/cus/tractor-custom-093257m35429.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor/cus/brick-custom-093257m35429.sha256sum
Stage writecat : Wall: 1.80 s, CPU: 0.43 s, VmPeak: 1189 MB, VmSize: 1061 MB, VmRSS: 239 MB, VmData: 263 MB, maxrss: 0.376316 MB
Stage writecat finished: 2020-06-25T03:21:05.101652
Resources for stage writecat : 0.001 s worker CPU, 0.002 s worker Wall, Wall: 1.804 s, Cores in use: 0.24, Total efficiency (on 32 cores): 0.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-writecat.p
All done: 35.193 s worker CPU, 58.024 s worker Wall, Wall: 20.028 s, Cores in use: 2.13, Total efficiency (on 32 cores): 6.6 %
Lost grz coverage and require_grz=True.
Finished galaxy PGC649027 in 0.363 minutes.
Started working on galaxy PGC649027 at Sat Jul 18 20:07:07 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.257958 -35.4291667 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T20:07:07.869420
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.257958', '-35.4291667', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.257958 -35.4291667 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.257958 -35.4291667
Starting process 63059 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 63060 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 63061 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 63062 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB
Starting process 63063 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059152 MB
Starting process 63064 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059152 MB
Starting process 63065 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 63066 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 63067 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 63068 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 63069 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 63070 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 63071 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 63072 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 63073 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 63074 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 63075 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 63076 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 63077 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 63078 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 63079 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 63080 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 63081 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 63082 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 63083 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 63084 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 63085 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 63086 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 63087 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 63088 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 63089 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 63090 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T20:07:08.515371
Keeping 7 CCDs:
   c4d_180122_043141_ooi_g_v1.fits.fz c4d_180122_043141_ooi_g_v1-N19 g exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 58140.189 object DES survey hex 928-349 tiling 8
   c4d_171129_081225_ooi_z_v1.fits.fz c4d_171129_081225_ooi_z_v1-N19 z exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 58086.342 object DES survey hex 928-349 tiling 8
   c4d_170216_024924_ooi_z_ls9.fits.fz c4d_170216_024924_ooi_z_ls9-S7 z exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57800.116 object DES survey hex 910-359 tiling 7
   c4d_170128_045649_ooi_g_ls9.fits.fz c4d_170128_045649_ooi_g_ls9-S7 g exptime 90.0 propid 2012B-0001 seeing 1.31 MJD 57781.205 object DES survey hex 910-359 tiling 7
   c4d_170128_044803_ooi_r_ls9.fits.fz c4d_170128_044803_ooi_r_ls9-S7 r exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57781.198 object DES survey hex 910-359 tiling 7
   c4d_180218_025409_ooi_r_v1.fits.fz c4d_180218_025409_ooi_r_v1-S7 r exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58167.121 object DES survey hex 910-359 tiling 9
   c4d_180223_005147_ooi_z_v1.fits.fz c4d_180223_005147_ooi_z_v1-S7 z exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58172.036 object DES survey hex 910-359 tiling 9
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-g-20180122T043141_oi[N19,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171129T081225_oi[N19,noinherit][2046,4094][real]: DE
Stage tims : Wall: 2.98 s, CPU: 0.93 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 168 MB, VmData: 202 MB, maxrss: 0.172276 MB
Stage tims finished: 2020-07-18T20:07:11.497659
Zeroing out 1102 weight-map pixels below quantization error (= median 0.000283)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-g-20180122T043141_oi[N19,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 2.004 s worker CPU, 8.149 s worker Wall, Wall: 2.985 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-18T20:07:11.518712
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09696.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09697.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09569.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09825.fits
Matched 4 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/reference-custom-093257m35429.fits
Stage refs : Wall: 5.17 s, CPU: 4.23 s, VmPeak: 1055 MB, VmSize: 1050 MB, VmRSS: 224 MB, VmData: 256 MB, maxrss: 0.229468 MB
Stage refs finished: 2020-07-18T20:07:16.687332
Zeroing out 3178 weight-map pixels below quantization error (= median 4.31e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171125_9031971-z-20171129T081225_oi[N19,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 5.172 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-18T20:07:19.502528
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outlier-mask-custom-093257m35429.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-pre-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outlier-mask-custom-093257m35429.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-post-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-masked-pos-custom-093257m35429.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/outliers-masked-neg-custom-093257m35429.jpg
Stage outliers : Wall: 5.03 s, CPU: 0.53 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.240928 MB
Stage outliers finished: 2020-07-18T20:07:24.527521
Resources for stage outliers : 0.208 s worker CPU, 0.251 s worker Wall, Wall: 5.028 s, Cores in use: 0.15, Total efficiency (on 32 cores): 0.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T20:07:27.826678
Stage halos : Wall: 0.61 s, CPU: 0.47 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.241068 MB
Stage halos finished: 2020-07-18T20:07:28.439697
Resources for stage halos : 0.120 s worker CPU, 0.222 s worker Wall, Wall: 0.616 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-18T20:07:28.500718
PSF sigmas in coadd pixels: ['2.30']
Using average PSF sigma 2.300226976360587
Gaussian PSF norm 0.12263780690904155 vs pixelized 0.10134491
average tim pixel scale / coadd scale: 1.0010376790332258
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.68']
Using average PSF sigma 1.6770512847185948
Gaussian PSF norm 0.16820880455138434 vs pixelized 0.13989106
average tim pixel scale / coadd scale: 1.0010448772325145
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.10 s, CPU: 0.05 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 237 MB, VmData: 265 MB, maxrss: 0.242564 MB
Stage fit_on_coadds finished: 2020-07-18T20:07:28.599155
Resources for stage fit_on_coadds : 0.044 s worker CPU, 0.055 s worker Wall, Wall: 0.101 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T20:07:28.618069
SED-matched filters: [('z', array([0., 1.])), ('g', array([1., 0.])), ('Flat', [1.0, 1.0]), ('Red', [2.5, 0.4])]
Found 226 potential peaks
Of 226 potential peaks: 213 in veto map, 6 cut by saddle test, 0 cut by aper test, 7 kept
SED z : 7 new peaks
Found 19 potential peaks
Of 19 potential peaks: 13 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 28 potential peaks
Of 28 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 37 potential peaks
Of 37 potential peaks: 33 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 9 new sources
Median coadd sky for g : -3.823193e-06
Median coadd sky for z : 0.00043836364
Stage srcs : Wall: 0.63 s, CPU: 0.57 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 237 MB, VmData: 265 MB, maxrss: 0.2431 MB
Stage srcs finished: 2020-07-18T20:07:29.245417
Resources for stage srcs : 0.089 s worker CPU, 0.099 s worker Wall, Wall: 0.630 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T20:07:29.326879
Blob 1 of 7, id: 0, sources: 7, size: 231x193, npix 21712, brick X: 44,275, Y: 0,193, one pixel: 136 0
Blob 2 of 7, id: 2, sources: 1, size: 56x73, npix 2520, brick X: 13,69, Y: 120,193, one pixel: 30 120
Blob 3 of 7, id: 4, sources: 1, size: 50x49, npix 1759, brick X: 43,93, Y: 193,242, one pixel: 66 193
Blob 4 of 7, id: 5, sources: 2, size: 36x43, npix 925, brick X: 129,165, Y: 208,251, one pixel: 139 208
Blob 5 of 7, id: 1, sources: 2, size: 33x44, npix 914, brick X: 0,33, Y: 22,66, one pixel: 15 22
Blob 6 of 7, id: 3, sources: 1, size: 28x26, npix 465, brick X: 237,265, Y: 131,157, one pixel: 251 131
Blob 7 of 7, id: 6, sources: 1, size: 24x19, npix 323, brick X: 98,122, Y: 256,275, one pixel: 109 256
Blob 3 finished, total: Wall: 0.09 s, CPU: 0.07 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 83 MB, VmData: 137 MB, maxrss: 0.085296 MB
Blob 6 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 664 MB, VmSize: 664 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097696 MB
Blob 7 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09356 MB
Blob 5 finished, total: Wall: 0.75 s, CPU: 0.73 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090356 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 664 MB, VmSize: 664 MB, VmRSS: 96 MB, VmData: 141 MB, maxrss: 0.098012 MB
Blob 2 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 663 MB, VmSize: 663 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09576 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.24092, -35.43515), pm (-6.1, 6.6), parallax 1.147 with NanoMaggies: g=13.2, z=12.9
Reset brightness to NanoMaggies: g=13.2, z=12.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.39215, ee1=0.274269, ee2=-0.161702
Blob 1 finished, total: Wall: 3.60 s, CPU: 3.57 s, VmPeak: 678 MB, VmSize: 676 MB, VmRSS: 115 MB, VmData: 154 MB, maxrss: 0.119172 MB
Old catalog: 19
New catalog: 16
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/blobs-custom-093257m35429.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/metrics/cus/all-models-custom-093257m35429.fits
Stage fitblobs : Wall: 4.09 s, CPU: 0.45 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 238 MB, VmData: 265 MB, maxrss: 0.243412 MB
Stage fitblobs finished: 2020-07-18T20:07:33.418413
Resources for stage fitblobs : 6.743 s worker CPU, 6.825 s worker Wall, Wall: 4.094 s, Cores in use: 1.76, Total efficiency (on 32 cores): 5.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T20:07:33.458089
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-resid.jpg
Stage coadds : Wall: 3.28 s, CPU: 0.71 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 239 MB, VmData: 265 MB, maxrss: 0.24426 MB
Stage coadds finished: 2020-07-18T20:07:36.737071
Resources for stage coadds : 45.438 s worker CPU, 56.665 s worker Wall, Wall: 3.281 s, Cores in use: 14.07, Total efficiency (on 32 cores): 44.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T20:07:36.772477
Cut to 1 unWISE tiles
Reading WISE tile 0931m349 band 1
Reading WISE tile 0931m349 band 2
Reading WISE tile 0931m349 band 3
Reading WISE tile 0931m349 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 789 MB, VmSize: 789 MB, VmRSS: 139 MB, VmData: 174 MB, maxrss: 0.181784 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 849 MB, VmSize: 849 MB, VmRSS: 200 MB, VmData: 234 MB, maxrss: 0.205244 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 785 MB, VmSize: 785 MB, VmRSS: 134 MB, VmData: 169 MB, maxrss: 0.192164 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/093/0931m349/unwise-0931m349-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 787 MB, VmSize: 787 MB, VmRSS: 137 MB, VmData: 171 MB, maxrss: 0.194776 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/tmp-legacysurvey-custom-093257m35429-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.97 s, CPU: 0.62 s, VmPeak: 1060 MB, VmSize: 1060 MB, VmRSS: 239 MB, VmData: 265 MB, maxrss: 0.244776 MB
Stage wise_forced finished: 2020-07-18T20:07:38.742373
Resources for stage wise_forced : 3.120 s worker CPU, 4.232 s worker Wall, Wall: 1.973 s, Cores in use: 1.90, Total efficiency (on 32 cores): 5.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T20:07:38.777743
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/coadd/cus/custom-093257m35429/legacysurvey-custom-093257m35429-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor-i/cus/tractor-custom-093257m35429.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor/cus/tractor-custom-093257m35429.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/tractor/cus/brick-custom-093257m35429.sha256sum
Stage writecat : Wall: 0.78 s, CPU: 0.63 s, VmPeak: 1192 MB, VmSize: 1064 MB, VmRSS: 241 MB, VmData: 265 MB, maxrss: 0.377572 MB
Stage writecat finished: 2020-07-18T20:07:39.560051
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.785 s, Cores in use: 0.80, Total efficiency (on 32 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC649027/PGC649027-largegalaxy-writecat.p
All done: 57.774 s worker CPU, 76.506 s worker Wall, Wall: 31.063 s, Cores in use: 2.16, Total efficiency (on 32 cores): 6.7 %
Lost grz coverage and require_grz=True.
Finished galaxy PGC649027 in 0.546 minutes.