Started working on galaxy PGC3103899 at Sun Jun  7 13:14:30 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.902432 -7.428181200000001 --width 289 --height 289 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T13:14:31.252766
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.902432', '-7.428181200000001', '--width', '289', '--height', '289', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.902432 -7.428181200000001 --width 289 --height 289 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 313.902432 -7.428181200000001
Starting process 28129 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 28130 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 28131 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 28132 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T13:14:39.634001
Keeping 13 CCDs:
   c4d_180907_011747_ooi_g_ls9.fits.fz c4d_180907_011747_ooi_g_ls9-S24 g exptime 82.0 propid 2014B-0404 seeing 1.24 MJD 58368.054 object DECaLS_27537_g
   c4d_180906_002348_ooi_g_ls9.fits.fz c4d_180906_002348_ooi_g_ls9-S21 g exptime 59.0 propid 2014B-0404 seeing 1.13 MJD 58367.017 object DECaLS_59196_g
   c4d_180914_233823_ooi_z_ls9.fits.fz c4d_180914_233823_ooi_z_ls9-S24 z exptime 250.0 propid 2014B-0404 seeing 1.68 MJD 58375.985 object DECaLS_27537_z
   c4d_180830_003755_ooi_r_ls9.fits.fz c4d_180830_003755_ooi_r_ls9-S24 r exptime 64.0 propid 2014B-0404 seeing 1.20 MJD 58360.026 object DECaLS_27537_r
   c4d_180906_002024_ooi_g_ls9.fits.fz c4d_180906_002024_ooi_g_ls9-N27 g exptime 63.0 propid 2014B-0404 seeing 0.92 MJD 58367.014 object DECaLS_51878_g
   c4d_180905_000409_ooi_g_ls9.fits.fz c4d_180905_000409_ooi_g_ls9-S24 g exptime 77.0 propid 2014B-0404 seeing 1.35 MJD 58366.003 object DECaLS_51683_g
   c4d_180906_001735_ooi_g_ls9.fits.fz c4d_180906_001735_ooi_g_ls9-S24 g exptime 56.0 propid 2014B-0404 seeing 1.18 MJD 58367.012 object DECaLS_51683_g
   c4d_170822_015219_ooi_r_ls9.fits.fz c4d_170822_015219_ooi_r_ls9-S20 r exptime 67.0 propid 2014B-0404 seeing 0.91 MJD 57987.078 object DECaLS_11674_r
   c4d_180518_074923_ooi_g_ls9.fits.fz c4d_180518_074923_ooi_g_ls9-S20 g exptime 161.0 propid 2014B-0404 seeing 1.33 MJD 58256.326 object DECaLS_11674_g
   c4d_170521_102426_ooi_z_ls9.fits.fz c4d_170521_102426_ooi_z_ls9-S20 z exptime 85.0 propid 2014B-0404 seeing 0.91 MJD 57894.432 object DECaLS_11674_z
   c4d_180916_235808_ooi_z_ls9.fits.fz c4d_180916_235808_ooi_z_ls9-S18 z exptime 80.0 propid 2014B-0404 seeing 1.02 MJD 58377.999 object DECaLS_43409_z
   c4d_180910_015705_ooi_r_ls9.fits.fz c4d_180910_015705_ooi_r_ls9-S18 r exptime 47.0 propid 2014B-0404 seeing 1.01 MJD 58371.081 object DECaLS_43409_r
   c4d_181002_001801_ooi_g_ls9.fits.fz c4d_181002_001801_ooi_g_ls9-S18 g exptime 155.0 propid 2014B-0404 seeing 1.29 MJD 58393.013 object DECaLS_43409_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535945-g-20180907T011747_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952da7f-z-20180914T233823_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532ffd-r-20180830T003755_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T002348_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T002024_oi[N27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000409_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T001735_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T015219_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T074923_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951822a-z-20170521T102206_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180910T015705_oi[S18,noinherit][2046,4094][real]: DECaLS_4340
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181002T001801_oi[S18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T235808_oi[S18,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 114.38 s, CPU: 7.53 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 179 MB, VmData: 213 MB, maxrss: 0.456228 MB
Stage tims finished: 2020-06-07T13:16:34.013515
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T002348_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000409_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951822a-z-20170521T102206_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532ffd-r-20180830T003755_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521d7c-r-20170822T015219_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180910T015705_oi[S18,noinherit][2046,4094][real]: DECaLS_4340 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535945-g-20180907T011747_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T001735_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e572-z-20180916T235808_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952da7f-z-20180914T233823_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T002024_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180518T074923_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181002T001801_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.786 s worker CPU, 316.023 s worker Wall, Wall: 114.381 s, Cores in use: 0.11, Total efficiency (on 4 cores): 2.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T13:16:34.341399
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07088.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06959.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/reference-custom-313902m07428.fits
Stage refs : Wall: 9.49 s, CPU: 8.91 s, VmPeak: 1065 MB, VmSize: 1059 MB, VmRSS: 244 MB, VmData: 276 MB, maxrss: 0.456228 MB
Stage refs finished: 2020-06-07T13:16:43.828482
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.488 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T13:16:43.829968
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/outlier-mask-custom-313902m07428.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/outliers-pre-custom-313902m07428.jpg
Image c4d_180906_002348_ooi_g_ls9-S21 g : masking 0 positive outlier pixels and 71 negative outlier pixels
Image c4d_180905_000409_ooi_g_ls9-S24 g : masking 86 positive outlier pixels and 0 negative outlier pixels
Image c4d_180518_074923_ooi_g_ls9-S20 g : masking 295 positive outlier pixels and 0 negative outlier pixels
Image c4d_180906_001735_ooi_g_ls9-S24 g : masking 460 positive outlier pixels and 330 negative outlier pixels
Image c4d_181002_001801_ooi_g_ls9-S18 g : masking 7691 positive outlier pixels and 0 negative outlier pixels
Image c4d_180910_015705_ooi_r_ls9-S18 r : masking 277 positive outlier pixels and 0 negative outlier pixels
Image c4d_180914_233823_ooi_z_ls9-S24 z : masking 544 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/outlier-mask-custom-313902m07428.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/outliers-post-custom-313902m07428.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/outliers-masked-pos-custom-313902m07428.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/outliers-masked-neg-custom-313902m07428.jpg
Stage outliers : Wall: 9.73 s, CPU: 5.69 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 262 MB, VmData: 291 MB, maxrss: 0.456228 MB
Stage outliers finished: 2020-06-07T13:16:53.563493
Resources for stage outliers : 1.710 s worker CPU, 1.755 s worker Wall, Wall: 9.735 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.0 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T13:16:53.565136
Stage halos : Wall: 10.56 s, CPU: 5.27 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 262 MB, VmData: 291 MB, maxrss: 0.456228 MB
Stage halos finished: 2020-06-07T13:17:04.121406
Resources for stage halos : 0.574 s worker CPU, 19.865 s worker Wall, Wall: 10.557 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.8 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T13:17:04.123356
PSF sigmas in coadd pixels: ['2.01', '1.84', '1.49', '2.20', '1.92', '2.15', '2.09']
Using average PSF sigma 1.9564660030766194
Gaussian PSF norm 0.1441858899312705 vs pixelized 0.11985722
average tim pixel scale / coadd scale: 1.001068871230143
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.94', '1.48', '1.64']
Using average PSF sigma 1.687817894125191
Gaussian PSF norm 0.16713579868762446 vs pixelized 0.13868447
average tim pixel scale / coadd scale: 1.0010792353041185
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.73', '1.47', '1.65']
Using average PSF sigma 1.9502976499747469
Gaussian PSF norm 0.14464191749271238 vs pixelized 0.10042196
average tim pixel scale / coadd scale: 1.001049909307017
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.25 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 265 MB, VmData: 293 MB, maxrss: 0.456228 MB
Stage fit_on_coadds finished: 2020-06-07T13:17:04.432677
Resources for stage fit_on_coadds : 0.354 s worker CPU, 0.371 s worker Wall, Wall: 0.310 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.9 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T13:17:04.435464
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 35 potential peaks
Of 35 potential peaks: 11 in veto map, 4 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 42 potential peaks
Of 42 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 9 kept
SED r : 9 new peaks
Found 47 potential peaks
Of 47 potential peaks: 30 in veto map, 8 cut by saddle test, 0 cut by aper test, 9 kept
SED g : 9 new peaks
Found 54 potential peaks
Of 54 potential peaks: 43 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 58 potential peaks
Of 58 potential peaks: 49 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 42 new sources
Median coadd sky for g : -3.9289844e-05
Median coadd sky for r : 5.8753296e-05
Median coadd sky for z : 0.00024729597
Stage srcs : Wall: 6.91 s, CPU: 6.87 s, VmPeak: 1068 MB, VmSize: 1068 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.456228 MB
Stage srcs finished: 2020-06-07T13:17:11.346811
Resources for stage srcs : 0.124 s worker CPU, 0.126 s worker Wall, Wall: 6.912 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/PGC3103899-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T13:17:11.461904
Blob 1 of 19, id: 0, sources: 15, size: 160x201, npix 14587, brick X: 78,238, Y: 0,201, one pixel: 101 0
Blob 2 of 19, id: 14, sources: 8, size: 145x75, npix 4522, brick X: 0,145, Y: 211,286, one pixel: 113 211
Blob 3 of 19, id: 6, sources: 4, size: 57x77, npix 2523, brick X: 232,289, Y: 53,130, one pixel: 254 53
Blob 4 of 19, id: 2, sources: 3, size: 43x55, npix 1334, brick X: 158,201, Y: 1,56, one pixel: 168 1
Blob 5 of 19, id: 8, sources: 2, size: 53x43, npix 1262, brick X: 28,81, Y: 96,139, one pixel: 39 96
Blob 4 finished, total: Wall: 3.79 s, CPU: 3.79 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14918 MB
Blob 6 of 19, id: 17, sources: 3, size: 44x39, npix 1198, brick X: 172,216, Y: 250,289, one pixel: 195 250
Blob 5 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14918 MB
Blob 7 of 19, id: 3, sources: 2, size: 45x33, npix 967, brick X: 60,105, Y: 26,59, one pixel: 73 26
Blob 6 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14918 MB
Blob 8 of 19, id: 10, sources: 3, size: 38x36, npix 694, brick X: 46,84, Y: 168,204, one pixel: 71 168
Measuring 2 iterative sources
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 7.69 s, CPU: 7.68 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149344 MB
Blob 9 of 19, id: 9, sources: 1, size: 28x32, npix 576, brick X: 6,34, Y: 126,158, one pixel: 19 126
Blob 7 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14918 MB
Blob 10 of 19, id: 5, sources: 2, size: 36x29, npix 505, brick X: 16,52, Y: 38,67, one pixel: 24 38
Blob 3 finished, total: Wall: 8.96 s, CPU: 8.81 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149736 MB
Blob 11 of 19, id: 13, sources: 2, size: 29x32, npix 501, brick X: 32,61, Y: 210,242, one pixel: 40 210
Blob 8 finished, total: Wall: 1.31 s, CPU: 1.16 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149596 MB
Blob 12 of 19, id: 4, sources: 1, size: 28x26, npix 479, brick X: 258,286, Y: 28,54, one pixel: 271 28
Blob 9 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149612 MB
Blob 13 of 19, id: 1, sources: 1, size: 26x25, npix 417, brick X: 235,261, Y: 0,25, one pixel: 245 0
Blob 11 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149596 MB
Blob 14 of 19, id: 15, sources: 1, size: 31x20, npix 351, brick X: 67,98, Y: 219,239, one pixel: 76 219
Blob 10 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150008 MB
Blob 15 of 19, id: 12, sources: 1, size: 24x23, npix 337, brick X: 195,219, Y: 180,203, one pixel: 207 180
Blob 14 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150008 MB
Blob 16 of 19, id: 18, sources: 1, size: 22x20, npix 278, brick X: 154,176, Y: 255,275, one pixel: 162 255
Blob 12 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149612 MB
Blob 17 of 19, id: 7, sources: 1, size: 22x21, npix 272, brick X: 187,209, Y: 65,86, one pixel: 196 65
Blob 15 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150008 MB
Blob 18 of 19, id: 16, sources: 1, size: 20x20, npix 228, brick X: 212,232, Y: 225,245, one pixel: 221 225
Blob 16 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149612 MB
Blob 19 of 19, id: 11, sources: 1, size: 19x19, npix 181, brick X: 17,36, Y: 172,191, one pixel: 26 172
Blob 13 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149596 MB
Blob 19 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149596 MB
Blob 17 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150008 MB
Blob 18 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149612 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.17935, ee1=0.0393008, ee2=0.312619
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.90299, -7.43950), pm (9.2, -0.7), parallax 1.738 with NanoMaggies: g=18.9, r=17.9, z=16.7
Reset brightness to NanoMaggies: g=20.2, r=18.8, z=17.4
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 21.65 s, CPU: 21.65 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151536 MB
Old catalog: 66
New catalog: 58
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/blobs-custom-313902m07428.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/metrics/cus/all-models-custom-313902m07428.fits
Stage fitblobs : Wall: 27.53 s, CPU: 6.22 s, VmPeak: 1068 MB, VmSize: 1026 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.456228 MB
Stage fitblobs finished: 2020-06-07T13:17:38.990154
Resources for stage fitblobs : 54.984 s worker CPU, 55.328 s worker Wall, Wall: 27.529 s, Cores in use: 2.22, Total efficiency (on 4 cores): 55.6 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T13:17:38.991791
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/tmp-legacysurvey-custom-313902m07428-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/tmp-legacysurvey-custom-313902m07428-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/tmp-legacysurvey-custom-313902m07428-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/tmp-legacysurvey-custom-313902m07428-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-resid.jpg
Stage coadds : Wall: 10.56 s, CPU: 7.83 s, VmPeak: 1068 MB, VmSize: 1026 MB, VmRSS: 224 MB, VmData: 250 MB, maxrss: 0.456228 MB
Stage coadds finished: 2020-06-07T13:17:49.556249
Resources for stage coadds : 3.252 s worker CPU, 3.368 s worker Wall, Wall: 10.565 s, Cores in use: 1.05, Total efficiency (on 4 cores): 26.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T13:17:49.557850
Cut to 1 unWISE tiles
Reading WISE tile 3142m076 band 1
Reading WISE tile 3142m076 band 2
Reading WISE tile 3142m076 band 3
Reading WISE tile 3142m076 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 966 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.211616 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 962 MB, VmSize: 799 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.191944 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 959 MB, VmSize: 799 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.2143 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/314/3142m076/unwise-3142m076-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 966 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.211092 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/tmp-legacysurvey-custom-313902m07428-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/tmp-legacysurvey-custom-313902m07428-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 9.17 s, CPU: 7.14 s, VmPeak: 1068 MB, VmSize: 1026 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.456228 MB
Stage wise_forced finished: 2020-06-07T13:17:58.729788
Resources for stage wise_forced : 4.328 s worker CPU, 6.617 s worker Wall, Wall: 9.173 s, Cores in use: 1.25, Total efficiency (on 4 cores): 31.3 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T13:17:58.731569
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/coadd/cus/custom-313902m07428/legacysurvey-custom-313902m07428-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/tractor-i/cus/tractor-custom-313902m07428.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/tractor/cus/tractor-custom-313902m07428.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC3103899/tractor/cus/brick-custom-313902m07428.sha256sum
Stage writecat : Wall: 10.09 s, CPU: 9.96 s, VmPeak: 1158 MB, VmSize: 1030 MB, VmRSS: 227 MB, VmData: 250 MB, maxrss: 0.456228 MB
Stage writecat finished: 2020-06-07T13:18:08.819757
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.089 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.7 %
Stage writecat finished
All done: 70.114 s worker CPU, 403.455 s worker Wall, Wall: 209.190 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Finished galaxy PGC3103899 in 3.740 minutes.