Started working on galaxy PGC409825 at Fri Jun  5 09:24:32 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.24235 -55.394402 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T09:24:34.459618
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.24235', '-55.394402', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.24235 -55.394402 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 299.24235 -55.394402
Starting process 52674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 52675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 52676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 52677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T09:24:34.863319
Keeping 11 CCDs:
   c4d_130901_015245_ooi_r_ls9.fits.fz c4d_130901_015245_ooi_r_ls9-N14 r exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 56536.078 object DES survey hex -586-542 tiling 3
   c4d_130912_235936_ooi_z_ls9.fits.fz c4d_130912_235936_ooi_z_ls9-N14 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56548.000 object DES survey hex -586-542 tiling 3
   c4d_130831_235908_ooi_g_ls9.fits.fz c4d_130831_235908_ooi_g_ls9-N14 g exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 56535.999 object DES survey hex -586-542 tiling 3
   c4d_150912_235941_ooi_r_ls9.fits.fz c4d_150912_235941_ooi_r_ls9-S9 r exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 57277.998 object DES survey hex -590-562 tiling 6
   c4d_150912_235534_ooi_g_ls9.fits.fz c4d_150912_235534_ooi_g_ls9-S9 g exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57277.995 object DES survey hex -590-562 tiling 6
   c4d_150913_005105_ooi_z_ls9.fits.fz c4d_150913_005105_ooi_z_ls9-S9 z exptime 90.0 propid 2012B-0001 seeing 0.78 MJD 57278.034 object DES survey hex -590-562 tiling 6
   c4d_130923_014045_ooi_r_ls9.fits.fz c4d_130923_014045_ooi_r_ls9-S1 r exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 56558.070 object DES survey hex -590-562 tiling 4
   c4d_130908_000042_ooi_g_ls9.fits.fz c4d_130908_000042_ooi_g_ls9-S1 g exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 56543.000 object DES survey hex -590-562 tiling 4
   c4d_161002_235456_ooi_z_ls9.fits.fz c4d_161002_235456_ooi_z_ls9-N21 z exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57663.995 object DES survey hex -616-552 tiling 7
   c4d_161002_000840_ooi_g_ls9.fits.fz c4d_161002_000840_ooi_g_ls9-N21 g exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57663.004 object DES survey hex -616-552 tiling 7
   c4d_161001_235631_ooi_r_ls9.fits.fz c4d_161001_235631_ooi_r_ls9-N21 r exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57662.996 object DES survey hex -616-552 tiling 7
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962f457-z-20130912T235936_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130831T235908_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T235718_oi[S9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a12-r-20130901T015245_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9621205-z-20150913T004843_oi[S9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T235311_oi[S9,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130923T014045_oi[S1,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T000042_oi[S1,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962cb2b-z-20161002T235235_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962cb9d-g-20161002T000620_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d813-r-20161001T235410_oi[N21,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 48.69 s, CPU: 0.91 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.448496 MB
Stage tims finished: 2020-06-05T09:25:23.551297
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9632a12-r-20130901T015245_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9633379-g-20130908T000042_oi[S1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962fa53-g-20130831T235908_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9621205-z-20150913T004843_oi[S9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962cb2b-z-20161002T235235_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962f457-z-20130912T235936_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T235311_oi[S9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962cb9d-g-20161002T000620_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T235718_oi[S9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96334f7-r-20130923T014045_oi[S1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962d813-r-20161001T235410_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 4.738 s worker CPU, 139.291 s worker Wall, Wall: 48.690 s, Cores in use: 0.12, Total efficiency (on 4 cores): 2.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T09:25:23.729871
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11260.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11167.fits
Matched 34 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/reference-custom-299242m55394.fits
Stage refs : Wall: 10.42 s, CPU: 5.58 s, VmPeak: 1079 MB, VmSize: 1073 MB, VmRSS: 253 MB, VmData: 285 MB, maxrss: 0.448496 MB
Stage refs finished: 2020-06-05T09:25:34.147722
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.419 s, Cores in use: 0.54, Total efficiency (on 4 cores): 13.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T09:25:34.149114
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/outlier-mask-custom-299242m55394.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/outliers-pre-custom-299242m55394.jpg
Image c4d_130831_235908_ooi_g_ls9-N14 g : masking 300 positive outlier pixels and 0 negative outlier pixels
Image c4d_161002_000840_ooi_g_ls9-N21 g : masking 318 positive outlier pixels and 0 negative outlier pixels
Image c4d_161002_235456_ooi_z_ls9-N21 z : masking 204 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/outlier-mask-custom-299242m55394.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/outliers-post-custom-299242m55394.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/outliers-masked-pos-custom-299242m55394.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/outliers-masked-neg-custom-299242m55394.jpg
Stage outliers : Wall: 1.02 s, CPU: 0.55 s, VmPeak: 1083 MB, VmSize: 1083 MB, VmRSS: 265 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage outliers finished: 2020-06-05T09:25:35.172582
Resources for stage outliers : 0.690 s worker CPU, 0.711 s worker Wall, Wall: 1.024 s, Cores in use: 1.21, Total efficiency (on 4 cores): 30.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T09:25:35.174134
Stage halos : Wall: 1.35 s, CPU: 0.17 s, VmPeak: 1083 MB, VmSize: 1083 MB, VmRSS: 265 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage halos finished: 2020-06-05T09:25:36.527142
Resources for stage halos : 0.280 s worker CPU, 3.167 s worker Wall, Wall: 1.354 s, Cores in use: 0.33, Total efficiency (on 4 cores): 8.3 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T09:25:36.529142
PSF sigmas in coadd pixels: ['2.09', '2.03', '2.21', '1.82']
Using average PSF sigma 2.0350516226469697
Gaussian PSF norm 0.13861800292169518 vs pixelized 0.112907484
average tim pixel scale / coadd scale: 1.001016959216524
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.87', '1.65', '1.47', '1.68']
Using average PSF sigma 1.6679911596428325
Gaussian PSF norm 0.16912247414685533 vs pixelized 0.1365432
average tim pixel scale / coadd scale: 1.001031780508809
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.71', '1.27', '1.89']
Using average PSF sigma 1.6249903385152715
Gaussian PSF norm 0.17359782706869742 vs pixelized 0.14488411
average tim pixel scale / coadd scale: 1.0009600317909004
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 1.75 s, CPU: 0.15 s, VmPeak: 1083 MB, VmSize: 1083 MB, VmRSS: 267 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage fit_on_coadds finished: 2020-06-05T09:25:38.275060
Resources for stage fit_on_coadds : 0.168 s worker CPU, 0.170 s worker Wall, Wall: 1.747 s, Cores in use: 0.18, Total efficiency (on 4 cores): 4.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T09:25:38.277825
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 41 potential peaks
Of 41 potential peaks: 22 in veto map, 3 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 44 potential peaks
Of 44 potential peaks: 34 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept
SED r : 6 new peaks
Found 28 potential peaks
Of 28 potential peaks: 26 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 35 potential peaks
Of 35 potential peaks: 28 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 46 potential peaks
Of 46 potential peaks: 39 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 25 new sources
Median coadd sky for g : -5.183224e-05
Median coadd sky for r : 7.858124e-07
Median coadd sky for z : -1.3799039e-05
Stage srcs : Wall: 0.47 s, CPU: 0.42 s, VmPeak: 1083 MB, VmSize: 1083 MB, VmRSS: 267 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage srcs finished: 2020-06-05T09:25:38.744515
Resources for stage srcs : 0.095 s worker CPU, 0.095 s worker Wall, Wall: 0.467 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/PGC409825-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T09:25:38.755266
Blob 1 of 18, id: 5, sources: 4, size: 133x131, npix 11050, brick X: 50,183, Y: 58,189, one pixel: 132 58
Blob 2 of 18, id: 7, sources: 2, size: 42x81, npix 2127, brick X: 6,48, Y: 92,173, one pixel: 22 92
Blob 3 of 18, id: 0, sources: 4, size: 74x34, npix 1536, brick X: 40,114, Y: 0,34, one pixel: 53 0
Blob 4 of 18, id: 1, sources: 5, size: 67x50, npix 1466, brick X: 178,245, Y: 0,50, one pixel: 181 0
Blob 5 of 18, id: 16, sources: 1, size: 32x36, npix 768, brick X: 147,179, Y: 209,245, one pixel: 163 209
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.85 s, CPU: 2.85 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147144 MB
Blob 6 of 18, id: 4, sources: 1, size: 31x30, npix 655, brick X: 214,245, Y: 57,87, one pixel: 225 57
Measuring 2 iterative sources
Blob 3 finished, total: Wall: 3.93 s, CPU: 3.93 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147156 MB
Blob 7 of 18, id: 15, sources: 1, size: 28x27, npix 498, brick X: 44,72, Y: 208,235, one pixel: 55 208
Blob 4 finished, total: Wall: 4.32 s, CPU: 4.32 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148996 MB
Blob 5 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148948 MB
Blob 8 of 18, id: 11, sources: 1, size: 27x28, npix 495, brick X: 195,222, Y: 176,204, one pixel: 208 176
Blob 9 of 18, id: 6, sources: 1, size: 28x26, npix 456, brick X: 30,58, Y: 69,95, one pixel: 42 69
Blob 6 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147156 MB
Blob 10 of 18, id: 8, sources: 1, size: 24x25, npix 384, brick X: 217,241, Y: 109,134, one pixel: 226 109
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.87915, ee1=0.0847434, ee2=0.0784069
Measuring 2 iterative sources
Blob 8 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148996 MB
Blob 11 of 18, id: 13, sources: 1, size: 26x24, npix 375, brick X: 182,208, Y: 198,222, one pixel: 192 198
Blob 9 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147156 MB
Blob 12 of 18, id: 12, sources: 1, size: 23x26, npix 362, brick X: 6,29, Y: 179,205, one pixel: 16 179
Blob 7 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148948 MB
Blob 13 of 18, id: 3, sources: 1, size: 22x22, npix 283, brick X: 69,91, Y: 52,74, one pixel: 79 52
Blob 10 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148996 MB
Blob 14 of 18, id: 17, sources: 1, size: 25x15, npix 268, brick X: 57,82, Y: 230,245, one pixel: 67 230
Blob 12 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148948 MB
Blob 15 of 18, id: 14, sources: 1, size: 21x19, npix 228, brick X: 72,93, Y: 203,222, one pixel: 80 203
Blob 11 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147156 MB
Blob 16 of 18, id: 9, sources: 1, size: 18x19, npix 198, brick X: 197,215, Y: 119,138, one pixel: 205 119
Blob 13 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148996 MB
Blob 17 of 18, id: 2, sources: 1, size: 17x19, npix 195, brick X: 0,17, Y: 48,67, one pixel: 7 48
Blob 1 finished, total: Wall: 7.02 s, CPU: 7.01 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150252 MB
Blob 18 of 18, id: 10, sources: 1, size: 15x19, npix 193, brick X: 230,245, Y: 144,163, one pixel: 238 144
Blob 16 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148996 MB
Blob 18 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.148996 MB
Blob 17 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150252 MB
Blob 15 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147156 MB
Blob 14 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148948 MB
Old catalog: 38
New catalog: 34
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/blobs-custom-299242m55394.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/metrics/cus/all-models-custom-299242m55394.fits
Stage fitblobs : Wall: 8.63 s, CPU: 0.30 s, VmPeak: 1083 MB, VmSize: 1083 MB, VmRSS: 267 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage fitblobs finished: 2020-06-05T09:25:47.382365
Resources for stage fitblobs : 29.907 s worker CPU, 29.936 s worker Wall, Wall: 8.628 s, Cores in use: 3.50, Total efficiency (on 4 cores): 87.5 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T09:25:47.383887
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/tmp-legacysurvey-custom-299242m55394-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/tmp-legacysurvey-custom-299242m55394-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/tmp-legacysurvey-custom-299242m55394-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/tmp-legacysurvey-custom-299242m55394-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-resid.jpg
Stage coadds : Wall: 1.28 s, CPU: 0.42 s, VmPeak: 1083 MB, VmSize: 1083 MB, VmRSS: 268 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage coadds finished: 2020-06-05T09:25:48.665689
Resources for stage coadds : 2.319 s worker CPU, 2.435 s worker Wall, Wall: 1.283 s, Cores in use: 2.14, Total efficiency (on 4 cores): 53.5 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T09:25:48.666875
Cut to 1 unWISE tiles
Reading WISE tile 2986m561 band 1
Reading WISE tile 2986m561 band 2
Reading WISE tile 2986m561 band 3
Reading WISE tile 2986m561 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.205512 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 797 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.19118 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 955 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210196 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/298/2986m561/unwise-2986m561-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 959 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210728 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/tmp-legacysurvey-custom-299242m55394-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/tmp-legacysurvey-custom-299242m55394-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 11.61 s, CPU: 0.35 s, VmPeak: 1083 MB, VmSize: 1083 MB, VmRSS: 268 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage wise_forced finished: 2020-06-05T09:26:00.275326
Resources for stage wise_forced : 3.295 s worker CPU, 10.676 s worker Wall, Wall: 11.609 s, Cores in use: 0.31, Total efficiency (on 4 cores): 7.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T09:26:00.277033
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/coadd/cus/custom-299242m55394/legacysurvey-custom-299242m55394-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/tractor-i/cus/tractor-custom-299242m55394.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/tractor/cus/tractor-custom-299242m55394.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC409825/tractor/cus/brick-custom-299242m55394.sha256sum
Stage writecat : Wall: 2.11 s, CPU: 0.43 s, VmPeak: 1215 MB, VmSize: 1087 MB, VmRSS: 270 MB, VmData: 295 MB, maxrss: 0.448496 MB
Stage writecat finished: 2020-06-05T09:26:02.386060
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.110 s, Cores in use: 0.21, Total efficiency (on 4 cores): 5.1 %
Stage writecat finished
All done: 41.494 s worker CPU, 186.482 s worker Wall, Wall: 87.528 s, Cores in use: 0.58, Total efficiency (on 4 cores): 14.5 %
Finished galaxy PGC409825 in 1.552 minutes.