Started working on galaxy PGC085328 at Sat Jun  6 17:26:49 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.24873799999995 3.5833098 --width 249 --height 249 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-06T17:26:50.429670
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.24873799999995', '3.5833098', '--width', '249', '--height', '249', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.24873799999995 3.5833098 --width 249 --height 249 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 343.24873799999995 3.5833098
Starting process 49473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB
Starting process 49474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 49475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 49476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-06T17:26:56.311726
Keeping 12 CCDs:
   c4d_180918_011407_ooi_z_ls9.fits.fz c4d_180918_011407_ooi_z_ls9-S17 z exptime 122.0 propid 2014B-0404 seeing 1.29 MJD 58379.051 object DECaLS_39693_z
   c4d_170822_040441_ooi_r_ls9.fits.fz c4d_170822_040441_ooi_r_ls9-N29 r exptime 41.0 propid 2014B-0404 seeing 0.92 MJD 57987.170 object DECaLS_7942_r
   c4d_170822_040251_ooi_g_ls9.fits.fz c4d_170822_040251_ooi_g_ls9-N29 g exptime 81.0 propid 2014B-0404 seeing 1.03 MJD 57987.169 object DECaLS_7942_g
   c4d_160812_052003_ooi_z_ls9.fits.fz c4d_160812_052003_ooi_z_ls9-N29 z exptime 80.0 propid 2014B-0404 seeing 0.99 MJD 57612.221 object DECaLS_7942_z
   c4d_160811_053359_ooi_g_ls9.fits.fz c4d_160811_053359_ooi_g_ls9-S23 g exptime 92.0 propid 2014B-0404 seeing 1.49 MJD 57611.230 object DECaLS_23821_g
   c4d_170821_040958_ooi_r_ls9.fits.fz c4d_170821_040958_ooi_r_ls9-S23 r exptime 115.0 propid 2014B-0404 seeing 1.47 MJD 57986.174 object DECaLS_23821_r
   c4d_160813_045955_ooi_z_ls9.fits.fz c4d_160813_045955_ooi_z_ls9-S23 z exptime 93.0 propid 2014B-0404 seeing 0.88 MJD 57613.207 object DECaLS_23821_z
   c4d_170822_040551_ooi_r_ls9.fits.fz c4d_170822_040551_ooi_r_ls9-S24 r exptime 40.0 propid 2014B-0404 seeing 0.83 MJD 57987.171 object DECaLS_7949_r
   c4d_170726_053700_ooi_g_ls9.fits.fz c4d_170726_053700_ooi_g_ls9-S24 g exptime 149.0 propid 2014B-0404 seeing 1.32 MJD 57960.232 object DECaLS_7949_g
   c4d_160812_052345_ooi_z_ls9.fits.fz c4d_160812_052345_ooi_z_ls9-S24 z exptime 80.0 propid 2014B-0404 seeing 0.97 MJD 57612.223 object DECaLS_7949_z
   c4d_180914_031422_ooi_g_ls9.fits.fz c4d_180914_031422_ooi_g_ls9-S17 g exptime 99.0 propid 2014B-0404 seeing 1.29 MJD 58375.135 object DECaLS_39693_g
   c4d_170719_063922_ooi_r_ls9.fits.fz c4d_170719_063922_ooi_r_ls9-S17 r exptime 102.0 propid 2014B-0404 seeing 1.92 MJD 57953.276 object DECaLS_39693_r
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040441_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170822T040251_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T011407_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T051756_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95624c3-g-20160811T053137_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95217b0-r-20170821T040958_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040551_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T045732_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95203e2-g-20170726T053334_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T052134_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T031422_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T063648_oi[S17,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 104.98 s, CPU: 5.78 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.45466 MB
Stage tims finished: 2020-06-06T17:28:41.290261
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040441_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95624c3-g-20160811T053137_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95203e2-g-20170726T053334_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170822T040251_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95217b0-r-20170821T040958_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T052134_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T051756_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040551_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T031422_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T011407_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T045732_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T063648_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.472 s worker CPU, 338.711 s worker Wall, Wall: 104.980 s, Cores in use: 0.10, Total efficiency (on 4 cores): 2.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-06T17:28:41.464583
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05818.fits
Matched 7 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/reference-custom-343248p03583.fits
Stage refs : Wall: 6.27 s, CPU: 6.03 s, VmPeak: 1026 MB, VmSize: 1013 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.45466 MB
Stage refs finished: 2020-06-06T17:28:47.738542
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.275 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-06T17:28:47.739990
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outlier-mask-custom-343248p03583.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-pre-custom-343248p03583.jpg
Image c4d_170726_053700_ooi_g_ls9-S24 g : masking 141 positive outlier pixels and 0 negative outlier pixels
Image c4d_180914_031422_ooi_g_ls9-S17 g : masking 92 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outlier-mask-custom-343248p03583.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-post-custom-343248p03583.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-masked-pos-custom-343248p03583.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-masked-neg-custom-343248p03583.jpg
Stage outliers : Wall: 7.98 s, CPU: 7.79 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 205 MB, VmData: 236 MB, maxrss: 0.45466 MB
Stage outliers finished: 2020-06-06T17:28:55.720029
Resources for stage outliers : 0.994 s worker CPU, 1.000 s worker Wall, Wall: 7.981 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-06T17:28:55.721618
Stage halos : Wall: 10.07 s, CPU: 7.07 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.45466 MB
Stage halos finished: 2020-06-06T17:29:05.792084
Resources for stage halos : 0.339 s worker CPU, 11.449 s worker Wall, Wall: 10.072 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-06T17:29:05.794153
PSF sigmas in coadd pixels: ['1.67', '2.43', '2.14', '2.09']
Using average PSF sigma 2.080906926159848
Gaussian PSF norm 0.13556338739977292 vs pixelized 0.117391944
average tim pixel scale / coadd scale: 1.0011449272038755
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.50', '2.39', '1.35', '3.12']
Using average PSF sigma 2.090428033142185
Gaussian PSF norm 0.13494594757699122 vs pixelized 0.105633825
average tim pixel scale / coadd scale: 1.0011696960076775
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.10', '1.60', '1.43', '1.58']
Using average PSF sigma 1.6780000758573224
Gaussian PSF norm 0.1681136942915515 vs pixelized 0.1429105
average tim pixel scale / coadd scale: 1.0011008632269809
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.20 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.45466 MB
Stage fit_on_coadds finished: 2020-06-06T17:29:06.044235
Resources for stage fit_on_coadds : 0.227 s worker CPU, 0.243 s worker Wall, Wall: 0.251 s, Cores in use: 1.72, Total efficiency (on 4 cores): 42.9 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-06T17:29:06.046975
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 89 potential peaks
Of 89 potential peaks: 67 in veto map, 6 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 71 potential peaks
Of 71 potential peaks: 64 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 74 potential peaks
Of 74 potential peaks: 61 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 89 potential peaks
Of 89 potential peaks: 75 in veto map, 12 cut by saddle test, 1 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 97 potential peaks
Of 97 potential peaks: 87 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : 0.00019220989
Median coadd sky for r : 0.00046101003
Median coadd sky for z : 0.000944437
Stage srcs : Wall: 6.73 s, CPU: 6.68 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.45466 MB
Stage srcs finished: 2020-06-06T17:29:12.772312
Resources for stage srcs : 0.102 s worker CPU, 0.103 s worker Wall, Wall: 6.726 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-06T17:29:12.785380
Blob 1 of 9, id: 2, sources: 14, size: 204x213, npix 29913, brick X: 45,249, Y: 14,227, one pixel: 108 14
Blob 2 of 9, id: 4, sources: 1, size: 37x43, npix 881, brick X: 212,249, Y: 126,169, one pixel: 221 126
Blob 3 of 9, id: 8, sources: 1, size: 30x29, npix 591, brick X: 198,228, Y: 216,245, one pixel: 212 216
Blob 4 of 9, id: 7, sources: 1, size: 27x33, npix 522, brick X: 4,31, Y: 201,234, one pixel: 15 201
Blob 5 of 9, id: 0, sources: 1, size: 28x20, npix 406, brick X: 16,44, Y: 0,20, one pixel: 21 0
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146272 MB
Blob 6 of 9, id: 5, sources: 1, size: 24x26, npix 384, brick X: 10,34, Y: 148,174, one pixel: 21 148
Blob 2 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14662 MB
Blob 7 of 9, id: 3, sources: 1, size: 24x23, npix 330, brick X: 21,45, Y: 28,51, one pixel: 33 28
Blob 6 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14662 MB
Blob 8 of 9, id: 1, sources: 1, size: 22x16, npix 226, brick X: 123,145, Y: 0,16, one pixel: 127 0
Blob 5 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146272 MB
Blob 9 of 9, id: 6, sources: 1, size: 19x19, npix 199, brick X: 206,225, Y: 162,181, one pixel: 215 162
Blob 8 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146272 MB
Blob 7 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14662 MB
Blob 3 finished, total: Wall: 2.69 s, CPU: 2.69 s, VmPeak: 960 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148724 MB
Blob 9 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146272 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.91223, ee1=0.227276, ee2=-0.243979
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.23847, 3.58045), pm (-5.2, -7.5), parallax 1.006 with NanoMaggies: g=16.4, r=15.7, z=15.1
Reset brightness to NanoMaggies: g=21.3, r=19.8, z=18.6
Measuring 16 iterative sources
Blob 1 finished, total: Wall: 30.10 s, CPU: 30.10 s, VmPeak: 960 MB, VmSize: 727 MB, VmRSS: 159 MB, VmData: 190 MB, maxrss: 0.162556 MB
Old catalog: 26
New catalog: 36
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/blobs-custom-343248p03583.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/all-models-custom-343248p03583.fits
Stage fitblobs : Wall: 36.82 s, CPU: 6.23 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.45466 MB
Stage fitblobs finished: 2020-06-06T17:29:49.606945
Resources for stage fitblobs : 38.016 s worker CPU, 38.043 s worker Wall, Wall: 36.823 s, Cores in use: 1.20, Total efficiency (on 4 cores): 30.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-06T17:29:49.609003
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-resid.jpg
Stage coadds : Wall: 7.13 s, CPU: 6.19 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.45466 MB
Stage coadds finished: 2020-06-06T17:29:56.741663
Resources for stage coadds : 2.894 s worker CPU, 3.093 s worker Wall, Wall: 7.134 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.9 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-06T17:29:56.743414
Cut to 1 unWISE tiles
Reading WISE tile 3433p030 band 1
Reading WISE tile 3433p030 band 2
Reading WISE tile 3433p030 band 3
Reading WISE tile 3433p030 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.191312 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206452 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 960 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21044 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 960 MB, VmSize: 800 MB, VmRSS: 155 MB, VmData: 179 MB, maxrss: 0.219828 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 8.95 s, CPU: 4.88 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.45466 MB
Stage wise_forced finished: 2020-06-06T17:30:05.697595
Resources for stage wise_forced : 3.574 s worker CPU, 11.050 s worker Wall, Wall: 8.955 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.6 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-06T17:30:05.699412
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/tractor-i/cus/tractor-custom-343248p03583.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/tractor/cus/tractor-custom-343248p03583.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/tractor/cus/brick-custom-343248p03583.sha256sum
Stage writecat : Wall: 4.91 s, CPU: 4.76 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 213 MB, VmData: 238 MB, maxrss: 0.45466 MB
Stage writecat finished: 2020-06-06T17:30:10.605329
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.907 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 %
Stage writecat finished
All done: 50.620 s worker CPU, 403.694 s worker Wall, Wall: 194.298 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.7 %
Finished galaxy PGC085328 in 3.363 minutes.
Started working on galaxy PGC085328 at Thu Jul 23 04:21:30 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.24873799999995 3.5833098 --width 249 --height 249 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-23T04:21:31.924011
legacypipe git version: DR9.5.5-21-g66b1aacb
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.24873799999995', '3.5833098', '--width', '249', '--height', '249', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.24873799999995 3.5833098 --width 249 --height 249 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 343.24873799999995 3.5833098
Starting process 30229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 30230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 30232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 30233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059152 MB
Starting process 30234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB
Starting process 30235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB
Starting process 30237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 30238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 30239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 30240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 30241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 30242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 30243 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 30244 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 30245 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 30246 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-23T04:21:33.044972
Keeping 12 CCDs:
   c4d_180918_011407_ooi_z_ls9.fits.fz c4d_180918_011407_ooi_z_ls9-S17 z exptime 122.0 propid 2014B-0404 seeing 1.29 MJD 58379.051 object DECaLS_39693_z
   c4d_170822_040441_ooi_r_ls9.fits.fz c4d_170822_040441_ooi_r_ls9-N29 r exptime 41.0 propid 2014B-0404 seeing 0.92 MJD 57987.170 object DECaLS_7942_r
   c4d_170822_040251_ooi_g_ls9.fits.fz c4d_170822_040251_ooi_g_ls9-N29 g exptime 81.0 propid 2014B-0404 seeing 1.03 MJD 57987.169 object DECaLS_7942_g
   c4d_160812_052003_ooi_z_ls9.fits.fz c4d_160812_052003_ooi_z_ls9-N29 z exptime 80.0 propid 2014B-0404 seeing 0.99 MJD 57612.221 object DECaLS_7942_z
   c4d_160811_053359_ooi_g_ls9.fits.fz c4d_160811_053359_ooi_g_ls9-S23 g exptime 92.0 propid 2014B-0404 seeing 1.49 MJD 57611.230 object DECaLS_23821_g
   c4d_170821_040958_ooi_r_ls9.fits.fz c4d_170821_040958_ooi_r_ls9-S23 r exptime 115.0 propid 2014B-0404 seeing 1.47 MJD 57986.174 object DECaLS_23821_r
   c4d_160813_045955_ooi_z_ls9.fits.fz c4d_160813_045955_ooi_z_ls9-S23 z exptime 93.0 propid 2014B-0404 seeing 0.88 MJD 57613.207 object DECaLS_23821_z
   c4d_170822_040551_ooi_r_ls9.fits.fz c4d_170822_040551_ooi_r_ls9-S24 r exptime 40.0 propid 2014B-0404 seeing 0.83 MJD 57987.171 object DECaLS_7949_r
   c4d_170726_053700_ooi_g_ls9.fits.fz c4d_170726_053700_ooi_g_ls9-S24 g exptime 149.0 propid 2014B-0404 seeing 1.32 MJD 57960.232 object DECaLS_7949_g
   c4d_160812_052345_ooi_z_ls9.fits.fz c4d_160812_052345_ooi_z_ls9-S24 z exptime 80.0 propid 2014B-0404 seeing 0.97 MJD 57612.223 object DECaLS_7949_z
   c4d_180914_031422_ooi_g_ls9.fits.fz c4d_180914_031422_ooi_g_ls9-S17 g exptime 99.0 propid 2014B-0404 seeing 1.29 MJD 58375.135 object DECaLS_39693_g
   c4d_170719_063922_ooi_r_ls9.fits.fz c4d_170719_063922_ooi_r_ls9-S17 r exptime 102.0 propid 2014B-0404 seeing 1.92 MJD 57953.276 object DECaLS_39693_r
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95624c3-g-20160811T053137_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T052134_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T045732_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95203e2-g-20170726T053334_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T063648_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040551_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T011407_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T051756_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95217b0-r-20170821T040958_oi[S23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T031422_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170822T040251_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040441_oi[N29,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 50.71 s, CPU: 1.44 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.18176 MB
Stage tims finished: 2020-07-23T04:22:23.751265
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95624c3-g-20160811T053137_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T052134_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T045732_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95203e2-g-20170726T053334_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040551_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T063648_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T011407_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T051756_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95217b0-r-20170821T040958_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536616-g-20180914T031422_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522b69-g-20170822T040251_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T040441_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 7.110 s worker CPU, 354.533 s worker Wall, Wall: 50.708 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-23T04:22:23.815261
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05818.fits
Matched 7 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/reference-custom-343248p03583.fits
Stage refs : Wall: 5.28 s, CPU: 1.88 s, VmPeak: 1030 MB, VmSize: 1017 MB, VmRSS: 196 MB, VmData: 230 MB, maxrss: 0.201156 MB
Stage refs finished: 2020-07-23T04:22:29.098396
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.285 s, Cores in use: 0.36, Total efficiency (on 16 cores): 2.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-23T04:22:29.299401
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outlier-mask-custom-343248p03583.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-pre-custom-343248p03583.jpg
Image c4d_170726_053700_ooi_g_ls9-S24 g : masking 141 positive outlier pixels and 0 negative outlier pixels
Image c4d_180914_031422_ooi_g_ls9-S17 g : masking 92 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outlier-mask-custom-343248p03583.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-post-custom-343248p03583.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-masked-pos-custom-343248p03583.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/outliers-masked-neg-custom-343248p03583.jpg
Stage outliers : Wall: 1.10 s, CPU: 0.89 s, VmPeak: 1030 MB, VmSize: 1013 MB, VmRSS: 199 MB, VmData: 231 MB, maxrss: 0.215348 MB
Stage outliers finished: 2020-07-23T04:22:30.402364
Resources for stage outliers : 0.902 s worker CPU, 0.983 s worker Wall, Wall: 1.104 s, Cores in use: 1.62, Total efficiency (on 16 cores): 10.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-23T04:22:30.546467
Stage halos : Wall: 0.24 s, CPU: 0.17 s, VmPeak: 1030 MB, VmSize: 1013 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.215348 MB
Stage halos finished: 2020-07-23T04:22:30.789391
Resources for stage halos : 0.513 s worker CPU, 0.720 s worker Wall, Wall: 0.245 s, Cores in use: 2.80, Total efficiency (on 16 cores): 17.5 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-23T04:22:30.819564
PSF sigmas in coadd pixels: ['1.67', '2.43', '2.14', '2.09']
Using average PSF sigma 2.080906926159848
Gaussian PSF norm 0.13556338739977292 vs pixelized 0.117391944
average tim pixel scale / coadd scale: 1.0011449272038755
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.50', '2.39', '1.35', '3.12']
Using average PSF sigma 2.090428033142185
Gaussian PSF norm 0.13494594757699122 vs pixelized 0.105633825
average tim pixel scale / coadd scale: 1.0011696960076775
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.10', '1.60', '1.43', '1.58']
Using average PSF sigma 1.6780000758573224
Gaussian PSF norm 0.1681136942915515 vs pixelized 0.1429105
average tim pixel scale / coadd scale: 1.0011008632269809
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1030 MB, VmSize: 1013 MB, VmRSS: 201 MB, VmData: 231 MB, maxrss: 0.215348 MB
Stage fit_on_coadds finished: 2020-07-23T04:22:30.998219
Resources for stage fit_on_coadds : 0.204 s worker CPU, 0.204 s worker Wall, Wall: 0.180 s, Cores in use: 2.09, Total efficiency (on 16 cores): 13.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-23T04:22:31.009794
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 89 potential peaks
Of 89 potential peaks: 67 in veto map, 6 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 71 potential peaks
Of 71 potential peaks: 64 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 74 potential peaks
Of 74 potential peaks: 61 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 89 potential peaks
Of 89 potential peaks: 75 in veto map, 12 cut by saddle test, 1 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 97 potential peaks
Of 97 potential peaks: 87 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 20 new sources
Median coadd sky for g : 0.00019220998
Median coadd sky for r : 0.00046101003
Median coadd sky for z : 0.0009444369
Stage srcs : Wall: 0.48 s, CPU: 0.45 s, VmPeak: 1030 MB, VmSize: 1013 MB, VmRSS: 201 MB, VmData: 231 MB, maxrss: 0.215348 MB
Stage srcs finished: 2020-07-23T04:22:31.486235
Resources for stage srcs : 0.066 s worker CPU, 0.066 s worker Wall, Wall: 0.478 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-23T04:22:31.497150
Blob 1 of 9, id: 2, sources: 14, size: 204x213, npix 29913, brick X: 45,249, Y: 14,227, one pixel: 108 14
Blob 2 of 9, id: 4, sources: 1, size: 37x43, npix 881, brick X: 212,249, Y: 126,169, one pixel: 221 126
Blob 3 of 9, id: 8, sources: 1, size: 30x29, npix 591, brick X: 198,228, Y: 216,245, one pixel: 212 216
Blob 4 of 9, id: 7, sources: 1, size: 27x33, npix 522, brick X: 4,31, Y: 201,234, one pixel: 15 201
Blob 5 of 9, id: 0, sources: 1, size: 28x20, npix 406, brick X: 16,44, Y: 0,20, one pixel: 21 0
Blob 6 of 9, id: 5, sources: 1, size: 24x26, npix 384, brick X: 10,34, Y: 148,174, one pixel: 21 148
Blob 7 of 9, id: 3, sources: 1, size: 24x23, npix 330, brick X: 21,45, Y: 28,51, one pixel: 33 28
Blob 8 of 9, id: 1, sources: 1, size: 22x16, npix 226, brick X: 123,145, Y: 0,16, one pixel: 127 0
Blob 9 of 9, id: 6, sources: 1, size: 19x19, npix 199, brick X: 206,225, Y: 162,181, one pixel: 215 162
Blob 9 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144944 MB
Blob 8 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 932 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144312 MB
Blob 7 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144956 MB
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 112 MB, VmData: 165 MB, maxrss: 0.11506 MB
Blob 4 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 935 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146484 MB
Blob 5 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 937 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 186 MB, maxrss: 0.151428 MB
Blob 2 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146628 MB
Blob 3 finished, total: Wall: 1.21 s, CPU: 1.20 s, VmPeak: 936 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.1452 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.91223, ee1=0.227276, ee2=-0.243979
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.23847, 3.58045), pm (-5.2, -7.5), parallax 1.006 with NanoMaggies: g=16.4, r=15.7, z=15.1
Reset brightness to NanoMaggies: g=21.3, r=19.8, z=18.6
Measuring 16 iterative sources
Blob 1 finished, total: Wall: 26.30 s, CPU: 26.30 s, VmPeak: 952 MB, VmSize: 731 MB, VmRSS: 160 MB, VmData: 192 MB, maxrss: 0.163876 MB
Old catalog: 26
New catalog: 36
T_dup:
tabledata object with 1 rows and 62 columns:
   a_g_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise_sig (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_n_good_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_n_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_params_solved (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   astrometric_sigma5d_max (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_weight_al (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ba (<class 'numpy.ndarray'>) shape (1,) dtype float32
   dec (<class 'numpy.ndarray'>) shape (1,) dtype float64
   dec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_g (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_r (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_z (<class 'numpy.ndarray'>) shape (1,) dtype float32
   donotfit (<class 'numpy.ndarray'>) shape (1,) dtype bool
   duplicated_source (<class 'numpy.ndarray'>) shape (1,) dtype bool
   e_bp_min_rp_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   freezeparams (<class 'numpy.ndarray'>) shape (1,) dtype bool
   hmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ibx (<class 'numpy.ndarray'>) shape (1,) dtype int32
   iby (<class 'numpy.ndarray'>) shape (1,) dtype int32
   in_bounds (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isbright (<class 'numpy.ndarray'>) shape (1,) dtype bool
   iscluster (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgaia (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgalaxy (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   islargegalaxy (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ismedium (<class 'numpy.ndarray'>) shape (1,) dtype bool
   istycho (<class 'numpy.ndarray'>) shape (1,) dtype bool
   jmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   keep_radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   kmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mask_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pa (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_bp_rp_excess_factor (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_rp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_variable_flag (<class 'numpy.ndarray'>) shape (1,) dtype bool
   pmdec (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmdec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pointsource (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ra (<class 'numpy.ndarray'>) shape (1,) dtype float64
   ra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius_pix (<class 'numpy.ndarray'>) shape (1,) dtype int64
   ref_cat (<class 'numpy.ndarray'>) shape (1,) dtype <U2
   ref_epoch (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ref_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   source_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   zguess (<class 'numpy.ndarray'>) shape (1,) dtype float32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/blobs-custom-343248p03583.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/metrics/cus/all-models-custom-343248p03583.fits
Stage fitblobs : Wall: 26.59 s, CPU: 0.26 s, VmPeak: 1030 MB, VmSize: 1013 MB, VmRSS: 202 MB, VmData: 231 MB, maxrss: 0.215348 MB
Stage fitblobs finished: 2020-07-23T04:22:58.092051
Resources for stage fitblobs : 31.467 s worker CPU, 31.578 s worker Wall, Wall: 26.597 s, Cores in use: 1.19, Total efficiency (on 16 cores): 7.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-23T04:22:58.115002
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-resid.jpg
Stage coadds : Wall: 1.77 s, CPU: 0.55 s, VmPeak: 1030 MB, VmSize: 1013 MB, VmRSS: 203 MB, VmData: 231 MB, maxrss: 0.215348 MB
Stage coadds finished: 2020-07-23T04:22:59.889487
Resources for stage coadds : 9.610 s worker CPU, 10.361 s worker Wall, Wall: 1.776 s, Cores in use: 5.72, Total efficiency (on 16 cores): 35.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-23T04:22:59.908650
Cut to 1 unWISE tiles
Reading WISE tile 3433p030 band 1
Reading WISE tile 3433p030 band 2
Reading WISE tile 3433p030 band 4
Reading WISE tile 3433p030 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 806 MB, VmRSS: 159 MB, VmData: 184 MB, maxrss: 0.205836 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 937 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20804 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 937 MB, VmSize: 797 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20772 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 936 MB, VmSize: 797 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208284 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/tmp-legacysurvey-custom-343248p03583-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.49 s, CPU: 0.87 s, VmPeak: 1030 MB, VmSize: 1013 MB, VmRSS: 204 MB, VmData: 231 MB, maxrss: 0.215348 MB
Stage wise_forced finished: 2020-07-23T04:23:02.400592
Resources for stage wise_forced : 3.241 s worker CPU, 4.291 s worker Wall, Wall: 2.494 s, Cores in use: 1.65, Total efficiency (on 16 cores): 10.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-23T04:23:02.433859
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/coadd/cus/custom-343248p03583/legacysurvey-custom-343248p03583-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/tractor-i/cus/tractor-custom-343248p03583.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/tractor/cus/tractor-custom-343248p03583.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/tractor/cus/brick-custom-343248p03583.sha256sum
Stage writecat : Wall: 2.48 s, CPU: 1.73 s, VmPeak: 1146 MB, VmSize: 1018 MB, VmRSS: 205 MB, VmData: 231 MB, maxrss: 0.341376 MB
Stage writecat finished: 2020-07-23T04:23:04.918385
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.486 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC085328/PGC085328-largegalaxy-writecat.p
All done: 53.116 s worker CPU, 402.739 s worker Wall, Wall: 91.899 s, Cores in use: 0.67, Total efficiency (on 16 cores): 4.2 %
Finished galaxy PGC085328 in 1.627 minutes.