Started working on galaxy ESO438-006_GROUP at Wed Aug  5 22:55:15 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39721884447337 -30.313669094066732 --width 587 --height 587 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T22:55:17.206314
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.39721884447337', '-30.313669094066732', '--width', '587', '--height', '587', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39721884447337 -30.313669094066732 --width 587 --height 587 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 167.39721884447337 -30.313669094066732
Starting process 33782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 33783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 33784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 33785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 33786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 33787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB
Starting process 33788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB
Starting process 33789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 33790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 33791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 33792 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33794 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 33795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 33796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 33797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 33798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 33799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 33800 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 33801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 33802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 33803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 33804 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 33805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 33806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 33807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 33808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 33809 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 33811 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 33812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 33810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 33813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T22:55:17.769736
Keeping 6 CCDs:
  c4d_170208_090501_ooi_g_ls9-N26 g expnum 618349 exptime 90.0 propid 2017A-0260 seeing 1.21 MJD 57792.377 object BLISS field: 6123-01-g 
    decam/CP/V4.8.2a/CP20170207/c4d_170208_090501_ooi_g_ls9.fits.fz
  c4d_170209_081226_ooi_z_ls9-N26 z expnum 618726 exptime 90.0 propid 2017A-0260 seeing 0.67 MJD 57793.340 object BLISS field: 6123-01-z 
    decam/CP/V4.8.2a/CP20170208/c4d_170209_081226_ooi_z_ls9.fits.fz
  c4d_170220_062913_ooi_r_ls9-N26 r expnum 622734 exptime 90.0 propid 2017A-0260 seeing 0.87 MJD 57804.269 object BLISS field: 6123-01-r 
    decam/CP/V4.8.2a/CP20170219/c4d_170220_062913_ooi_r_ls9.fits.fz
  c4d_170212_083055_ooi_z_ls9-N20 z expnum 619719 exptime 90.0 propid 2017A-0388 seeing 0.77 MJD 57796.353 object Tile 37867 PASS 3 
    decam/CP/V4.8.2a/CP20170211/c4d_170212_083055_ooi_z_ls9.fits.fz
  c4d_170210_081039_ooi_z_ls9-N26 z expnum 619040 exptime 70.0 propid 2017A-0388 seeing 1.00 MJD 57794.339 object Tile 21995 PASS=2 
    decam/CP/V4.8.2a/CP20170209/c4d_170210_081039_ooi_z_ls9.fits.fz
  c4d_170212_083055_ooi_z_ls9-N25 z expnum 619719 exptime 90.0 propid 2017A-0388 seeing 0.77 MJD 57796.353 object Tile 37867 PASS 3 
    decam/CP/V4.8.2a/CP20170211/c4d_170212_083055_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N25,noinherit][2046,4094][real]: Tile 37
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95ac908-g-20170208T090241_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N20,noinherit][2046,4094][real]: Tile 37
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95af8ee-r-20170220T062654_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170210T080838_oi[N26,noinherit][2046,4094][real]: Tile 21
Clipping 2 pixels with anomalously large oow values: max 0.00298954 vs median 0.00223779
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170209T081005_oi[N26,noinherit][2046,4094][real]: BLISS f
Stage tims : Wall: 58.18 s, CPU: 1.14 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 182 MB, VmData: 216 MB, maxrss: 0.186652 MB
Stage tims finished: 2020-08-05T22:56:15.948136
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N20,noinherit][2046,4094][real]: Tile 37 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95ac908-g-20170208T090241_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170209T081005_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95af8ee-r-20170220T062654_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Resources for stage tims : 3.414 s worker CPU, 132.257 s worker Wall, Wall: 58.181 s, Cores in use: 0.08, Total efficiency (on 32 cores): 0.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N25,noinherit][2046,4094][real]: Tile 37 [astropy.io.fits.card]
Running stage refs at 2020-08-05T22:56:16.189401
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09211.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09340.fits
Matched 3 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/reference-custom-167397m30313.fits
Stage refs : Wall: 9.82 s, CPU: 3.86 s, VmPeak: 1054 MB, VmSize: 1048 MB, VmRSS: 229 MB, VmData: 260 MB, maxrss: 0.234068 MB
Stage refs finished: 2020-08-05T22:56:26.009062
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170210T080838_oi[N26,noinherit][2046,4094][real]: Tile 21 [astropy.io.fits.card]
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 9.822 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T22:56:26.229586
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/outlier-mask-custom-167397m30313.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/outliers-pre-custom-167397m30313.jpg
Image c4d_170212_083055_ooi_z_ls9-N20 z : masking 838 positive outlier pixels and 0 negative outlier pixels
Image c4d_170209_081226_ooi_z_ls9-N26 z : masking 127 positive outlier pixels and 65 negative outlier pixels
Image c4d_170212_083055_ooi_z_ls9-N25 z : masking 850 positive outlier pixels and 0 negative outlier pixels
Image c4d_170210_081039_ooi_z_ls9-N26 z : masking 1274 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/outlier-mask-custom-167397m30313.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/outliers-post-custom-167397m30313.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/outliers-masked-pos-custom-167397m30313.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/outliers-masked-neg-custom-167397m30313.jpg
Stage outliers : Wall: 2.12 s, CPU: 1.27 s, VmPeak: 1067 MB, VmSize: 1067 MB, VmRSS: 275 MB, VmData: 306 MB, maxrss: 0.28162 MB
Stage outliers finished: 2020-08-05T22:56:28.351365
Resources for stage outliers : 1.638 s worker CPU, 2.021 s worker Wall, Wall: 2.124 s, Cores in use: 1.37, Total efficiency (on 32 cores): 4.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T22:56:28.380256
Stage halos : Wall: 0.66 s, CPU: 0.47 s, VmPeak: 1067 MB, VmSize: 1067 MB, VmRSS: 275 MB, VmData: 306 MB, maxrss: 0.282072 MB
Stage halos finished: 2020-08-05T22:56:29.044651
Resources for stage halos : 0.327 s worker CPU, 0.776 s worker Wall, Wall: 0.667 s, Cores in use: 1.20, Total efficiency (on 32 cores): 3.8 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T22:56:29.316951
PSF sigmas in coadd pixels: ['1.96']
Using average PSF sigma 1.9635784188691368
Gaussian PSF norm 0.14366362405650296 vs pixelized 0.119930275
average tim pixel scale / coadd scale: 1.001140653273048
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.42']
Using average PSF sigma 1.4180591661664559
Gaussian PSF norm 0.19893019875643542 vs pixelized 0.16013028
average tim pixel scale / coadd scale: 1.0011067617513978
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.08', '1.25', '1.63', '1.25']
Using average PSF sigma 1.3021804603936562
Gaussian PSF norm 0.2166326406776211 vs pixelized 0.17740795
average tim pixel scale / coadd scale: 1.001071045686178
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.28 s, VmPeak: 1067 MB, VmSize: 1067 MB, VmRSS: 277 MB, VmData: 306 MB, maxrss: 0.283536 MB
Stage fit_on_coadds finished: 2020-08-05T22:56:29.649463
Resources for stage fit_on_coadds : 0.314 s worker CPU, 0.394 s worker Wall, Wall: 0.335 s, Cores in use: 1.78, Total efficiency (on 32 cores): 5.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T22:56:29.818339
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 255 potential peaks
Of 255 potential peaks: 170 in veto map, 11 cut by saddle test, 0 cut by aper test, 74 kept
SED z : 74 new peaks
Found 101254 potential peaks
Of 101254 potential peaks: 101224 in veto map, 15 cut by saddle test, 0 cut by aper test, 15 kept
SED r : 15 new peaks
Found 93346 potential peaks
Of 93346 potential peaks: 93327 in veto map, 18 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 2587 potential peaks
Of 2587 potential peaks: 2561 in veto map, 19 cut by saddle test, 1 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 2662 potential peaks
Of 2662 potential peaks: 2637 in veto map, 22 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 99 new sources
Median coadd sky for g : 9.95633e-05
Median coadd sky for r : 0.00014622927
Median coadd sky for z : -4.8080277e-05
Stage srcs : Wall: 4.77 s, CPU: 2.60 s, VmPeak: 1067 MB, VmSize: 1067 MB, VmRSS: 277 MB, VmData: 306 MB, maxrss: 0.284072 MB
Stage srcs finished: 2020-08-05T22:56:34.584587
Resources for stage srcs : 4.464 s worker CPU, 4.464 s worker Wall, Wall: 4.769 s, Cores in use: 1.48, Total efficiency (on 32 cores): 4.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T22:56:34.949198
Blob 1 of 35, id: 0, sources: 82, size: 587x587, npix 177361, brick X: 0,587, Y: 0,587, one pixel: 0 0
Blob 2 of 35, id: 9, sources: 2, size: 68x51, npix 1840, brick X: 414,482, Y: 198,249, one pixel: 465 198
Blob 3 of 35, id: 13, sources: 2, size: 56x60, npix 1695, brick X: 417,473, Y: 250,310, one pixel: 442 250
Blob 4 of 35, id: 27, sources: 2, size: 52x37, npix 1165, brick X: 211,263, Y: 458,495, one pixel: 243 458
Blob 5 of 35, id: 33, sources: 3, size: 42x37, npix 1072, brick X: 336,378, Y: 550,587, one pixel: 347 550
Blob 6 of 35, id: 17, sources: 1, size: 37x38, npix 1034, brick X: 181,218, Y: 357,395, one pixel: 193 357
Blob 7 of 35, id: 31, sources: 2, size: 45x36, npix 950, brick X: 432,477, Y: 515,551, one pixel: 440 515
Blob 8 of 35, id: 32, sources: 1, size: 36x37, npix 915, brick X: 241,277, Y: 533,570, one pixel: 256 533
Blob 9 of 35, id: 24, sources: 2, size: 33x42, npix 895, brick X: 293,326, Y: 404,446, one pixel: 306 404
Blob 10 of 35, id: 18, sources: 2, size: 34x29, npix 700, brick X: 475,509, Y: 366,395, one pixel: 486 366
Blob 11 of 35, id: 2, sources: 1, size: 30x36, npix 697, brick X: 247,277, Y: 92,128, one pixel: 258 92
Blob 12 of 35, id: 19, sources: 2, size: 30x31, npix 578, brick X: 288,318, Y: 372,403, one pixel: 305 372
Blob 13 of 35, id: 26, sources: 1, size: 31x27, npix 559, brick X: 488,519, Y: 441,468, one pixel: 499 441
Blob 14 of 35, id: 15, sources: 2, size: 31x34, npix 518, brick X: 499,530, Y: 311,345, one pixel: 507 311
Blob 15 of 35, id: 3, sources: 1, size: 28x28, npix 513, brick X: 454,482, Y: 99,127, one pixel: 467 99
Blob 16 of 35, id: 21, sources: 1, size: 28x28, npix 503, brick X: 215,243, Y: 393,421, one pixel: 226 393
Blob 17 of 35, id: 34, sources: 2, size: 35x24, npix 426, brick X: 414,449, Y: 562,586, one pixel: 440 562
Blob 18 of 35, id: 10, sources: 1, size: 26x26, npix 417, brick X: 485,511, Y: 216,242, one pixel: 497 216
Blob 19 of 35, id: 11, sources: 1, size: 25x26, npix 403, brick X: 519,544, Y: 238,264, one pixel: 529 238
Blob 20 of 35, id: 4, sources: 1, size: 25x24, npix 366, brick X: 539,564, Y: 111,135, one pixel: 549 111
Blob 21 of 35, id: 22, sources: 1, size: 24x23, npix 348, brick X: 409,433, Y: 395,418, one pixel: 421 395
Blob 22 of 35, id: 29, sources: 1, size: 24x23, npix 326, brick X: 499,523, Y: 505,528, one pixel: 509 505
Blob 23 of 35, id: 7, sources: 1, size: 22x23, npix 323, brick X: 443,465, Y: 144,167, one pixel: 451 144
Blob 24 of 35, id: 14, sources: 1, size: 23x23, npix 306, brick X: 550,573, Y: 265,288, one pixel: 560 265
Blob 25 of 35, id: 25, sources: 1, size: 22x23, npix 305, brick X: 558,580, Y: 425,448, one pixel: 567 425
Blob 26 of 35, id: 5, sources: 1, size: 21x22, npix 281, brick X: 202,223, Y: 118,140, one pixel: 211 118
Blob 27 of 35, id: 30, sources: 1, size: 21x21, npix 268, brick X: 313,334, Y: 506,527, one pixel: 321 506
Blob 28 of 35, id: 8, sources: 1, size: 21x20, npix 258, brick X: 522,543, Y: 188,208, one pixel: 530 188
Blob 29 of 35, id: 20, sources: 1, size: 21x21, npix 251, brick X: 547,568, Y: 390,411, one pixel: 557 390
Blob 30 of 35, id: 6, sources: 1, size: 22x19, npix 244, brick X: 272,294, Y: 124,143, one pixel: 280 124
Blob 31 of 35, id: 28, sources: 1, size: 20x19, npix 227, brick X: 184,204, Y: 466,485, one pixel: 192 466
Blob 32 of 35, id: 16, sources: 1, size: 20x19, npix 209, brick X: 552,572, Y: 329,348, one pixel: 561 329
Blob 33 of 35, id: 23, sources: 1, size: 19x18, npix 189, brick X: 253,272, Y: 398,416, one pixel: 262 398
Blob 6 finished, total: Wall: 0.11 s, CPU: 0.10 s, VmPeak: 957 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146032 MB
Blob 34 of 35, id: 12, sources: 1, size: 18x18, npix 180, brick X: 566,584, Y: 246,264, one pixel: 574 246
Blob 30 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 681 MB, VmSize: 675 MB, VmRSS: 96 MB, VmData: 146 MB, maxrss: 0.101404 MB
Blob 35 of 35, id: 1, sources: 1, size: 17x17, npix 145, brick X: 319,336, Y: 85,102, one pixel: 327 85
Blob 34 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 681 MB, VmSize: 675 MB, VmRSS: 96 MB, VmData: 146 MB, maxrss: 0.101404 MB
Blob 35 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 681 MB, VmSize: 675 MB, VmRSS: 96 MB, VmData: 146 MB, maxrss: 0.101404 MB
Blob 28 finished, total: Wall: 0.41 s, CPU: 0.40 s, VmPeak: 677 MB, VmSize: 675 MB, VmRSS: 101 MB, VmData: 146 MB, maxrss: 0.102916 MB
Blob 32 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 681 MB, VmSize: 679 MB, VmRSS: 104 MB, VmData: 150 MB, maxrss: 0.106856 MB
Blob 33 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 957 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146032 MB
Blob 29 finished, total: Wall: 0.45 s, CPU: 0.41 s, VmPeak: 678 MB, VmSize: 675 MB, VmRSS: 101 MB, VmData: 146 MB, maxrss: 0.103024 MB
Blob 14 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 116 MB, VmData: 169 MB, maxrss: 0.118708 MB
Blob 31 finished, total: Wall: 0.71 s, CPU: 0.67 s, VmPeak: 685 MB, VmSize: 678 MB, VmRSS: 104 MB, VmData: 149 MB, maxrss: 0.108492 MB
Blob 27 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 677 MB, VmSize: 675 MB, VmRSS: 101 MB, VmData: 146 MB, maxrss: 0.103264 MB
Blob 17 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 677 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102268 MB
Blob 15 finished, total: Wall: 0.92 s, CPU: 0.91 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 98 MB, VmData: 145 MB, maxrss: 0.100796 MB
Blob 22 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097196 MB
Blob 20 finished, total: Wall: 0.96 s, CPU: 0.93 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144696 MB
Blob 18 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.101944 MB
Blob 8 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101716 MB
Blob 21 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099732 MB
Blob 25 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.152784 MB
Blob 26 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092032 MB
Blob 16 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09806 MB
Measuring 1 iterative sources
Blob 24 finished, total: Wall: 1.14 s, CPU: 1.13 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.113924 MB
Blob 19 finished, total: Wall: 1.17 s, CPU: 1.15 s, VmPeak: 956 MB, VmSize: 700 MB, VmRSS: 114 MB, VmData: 155 MB, maxrss: 0.144876 MB
Measuring 1 iterative sources
Blob 23 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098284 MB
Blob 11 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147024 MB
Blob 12 finished, total: Wall: 1.56 s, CPU: 1.55 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092484 MB
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 1.91 s, CPU: 1.91 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.114008 MB
Blob 7 finished, total: Wall: 1.94 s, CPU: 1.93 s, VmPeak: 684 MB, VmSize: 679 MB, VmRSS: 105 MB, VmData: 150 MB, maxrss: 0.10726 MB
Blob 9 finished, total: Wall: 1.98 s, CPU: 1.98 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09832 MB
Blob 13 finished, total: Wall: 2.00 s, CPU: 2.00 s, VmPeak: 699 MB, VmSize: 699 MB, VmRSS: 118 MB, VmData: 170 MB, maxrss: 0.12126 MB
Blob 4 finished, total: Wall: 2.06 s, CPU: 2.06 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.09946 MB
Blob 2 finished, total: Wall: 2.10 s, CPU: 2.10 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098336 MB
Blob 5 finished, total: Wall: 2.31 s, CPU: 2.31 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.153216 MB
Blob 3 finished, total: Wall: 2.39 s, CPU: 2.39 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.098876 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.28883, -30.34626), pm (-60.9, -2.9), parallax 4.355 with NanoMaggies: g=9.54, r=9.23, z=9.17
Reset brightness to NanoMaggies: g=9.54, r=9.23, z=9.17
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=3.03278, ee1=0.152313, ee2=0.188935
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42281, -30.30757), pm (-12.9, -0.2), parallax 0.837 with NanoMaggies: g=16.8, r=16.2, z=14.9
Reset brightness to NanoMaggies: g=16.8, r=16.2, z=15.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42317, -30.31395), pm (-7.3, 2.1), parallax 0.218 with NanoMaggies: g=18.1, r=17.6, z=15.9
Reset brightness to NanoMaggies: g=18.1, r=17.6, z=17.5
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.14584, ee1=-0.0283515, ee2=-0.296705
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.41970, -30.29046), pm (-15.8, 7.9), parallax 0.141 with NanoMaggies: g=21.4, r=20, z=16.9
Reset brightness to NanoMaggies: g=21.4, r=20, z=18.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42039, -30.29036), pm (1.6, -2.2), parallax 0.343 with NanoMaggies: g=20.4, r=20.1, z=(flux -204)
Reset brightness to NanoMaggies: g=20.4, r=20.1, z=20.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.37134, -30.33037), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -34.5), r=(flux -81.8), z=20.8
Reset brightness to NanoMaggies: g=22.1, r=21.1, z=20.6
Measuring 20 iterative sources
Blob 1 finished, total: Wall: 85.70 s, CPU: 85.70 s, VmPeak: 908 MB, VmSize: 798 MB, VmRSS: 235 MB, VmData: 269 MB, maxrss: 0.352152 MB
Old catalog: 131
New catalog: 139
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/blobs-custom-167397m30313.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/metrics/cus/all-models-custom-167397m30313.fits
Stage fitblobs : Wall: 86.63 s, CPU: 0.84 s, VmPeak: 1067 MB, VmSize: 1057 MB, VmRSS: 275 MB, VmData: 303 MB, maxrss: 0.291368 MB
Stage fitblobs finished: 2020-08-05T22:58:01.582701
Resources for stage fitblobs : 123.627 s worker CPU, 124.070 s worker Wall, Wall: 86.636 s, Cores in use: 1.44, Total efficiency (on 32 cores): 4.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T22:58:01.787432
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-resid.jpg
Stage coadds : Wall: 5.47 s, CPU: 1.24 s, VmPeak: 1101 MB, VmSize: 1049 MB, VmRSS: 272 MB, VmData: 299 MB, maxrss: 0.330652 MB
Stage coadds finished: 2020-08-05T22:58:07.260670
Resources for stage coadds : 41.289 s worker CPU, 42.106 s worker Wall, Wall: 5.476 s, Cores in use: 7.77, Total efficiency (on 32 cores): 24.3 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T22:58:07.293272
Cut to 1 unWISE tiles
Reading WISE tile 1669m303 band 1
Reading WISE tile 1669m303 band 2
Reading WISE tile 1669m303 band 3
Reading WISE tile 1669m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.33 s, CPU: 0.89 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 145 MB, VmData: 187 MB, maxrss: 0.204468 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.64 s, CPU: 2.09 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 147 MB, VmData: 191 MB, maxrss: 0.189184 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.22 s, CPU: 0.50 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 148 MB, VmData: 191 MB, maxrss: 0.2089 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.22 s, CPU: 0.50 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 149 MB, VmData: 188 MB, maxrss: 0.209364 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.99 s, CPU: 0.81 s, VmPeak: 1101 MB, VmSize: 1052 MB, VmRSS: 275 MB, VmData: 301 MB, maxrss: 0.330652 MB
Stage wise_forced finished: 2020-08-05T22:58:11.280500
Resources for stage wise_forced : 6.990 s worker CPU, 7.929 s worker Wall, Wall: 3.990 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T22:58:11.631759
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/tractor-i/cus/tractor-custom-167397m30313.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/tractor/cus/tractor-custom-167397m30313.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/tractor/cus/brick-custom-167397m30313.sha256sum
Stage writecat : Wall: 1.21 s, CPU: 1.07 s, VmPeak: 1198 MB, VmSize: 1070 MB, VmRSS: 290 MB, VmData: 315 MB, maxrss: 0.428044 MB
Stage writecat finished: 2020-08-05T22:58:12.838209
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.209 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-writecat.p
All done: 182.068 s worker CPU, 314.023 s worker Wall, Wall: 175.346 s, Cores in use: 1.12, Total efficiency (on 32 cores): 3.5 %
Finished galaxy ESO438-006_GROUP in 2.971 minutes.
Started working on galaxy ESO438-006_GROUP at Mon Aug 10 18:11:06 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39722153665264 -30.3137271762281 --width 585 --height 585 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T18:11:07.284248
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.39722153665264', '-30.3137271762281', '--width', '585', '--height', '585', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39722153665264 -30.3137271762281 --width 585 --height 585 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 167.39722153665264 -30.3137271762281
Starting process 39458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 39459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 39462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB
Starting process 39463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB
Starting process 39464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB
Starting process 39465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 39466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 39467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 39468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 39471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 39474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 39475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 39476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 39477 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 39478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 39479 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 39480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 39481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 39482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 39483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 39484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 39485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 39486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 39487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 39488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 39489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T18:11:07.713586
Keeping 6 CCDs:
  c4d_170208_090501_ooi_g_ls9-N26 g expnum 618349 exptime 90.0 propid 2017A-0260 seeing 1.21 MJD 57792.377 object BLISS field: 6123-01-g 
    decam/CP/V4.8.2a/CP20170207/c4d_170208_090501_ooi_g_ls9.fits.fz
  c4d_170209_081226_ooi_z_ls9-N26 z expnum 618726 exptime 90.0 propid 2017A-0260 seeing 0.67 MJD 57793.340 object BLISS field: 6123-01-z 
    decam/CP/V4.8.2a/CP20170208/c4d_170209_081226_ooi_z_ls9.fits.fz
  c4d_170220_062913_ooi_r_ls9-N26 r expnum 622734 exptime 90.0 propid 2017A-0260 seeing 0.87 MJD 57804.269 object BLISS field: 6123-01-r 
    decam/CP/V4.8.2a/CP20170219/c4d_170220_062913_ooi_r_ls9.fits.fz
  c4d_170212_083055_ooi_z_ls9-N20 z expnum 619719 exptime 90.0 propid 2017A-0388 seeing 0.77 MJD 57796.353 object Tile 37867 PASS 3 
    decam/CP/V4.8.2a/CP20170211/c4d_170212_083055_ooi_z_ls9.fits.fz
  c4d_170210_081039_ooi_z_ls9-N26 z expnum 619040 exptime 70.0 propid 2017A-0388 seeing 1.00 MJD 57794.339 object Tile 21995 PASS=2 
    decam/CP/V4.8.2a/CP20170209/c4d_170210_081039_ooi_z_ls9.fits.fz
  c4d_170212_083055_ooi_z_ls9-N25 z expnum 619719 exptime 90.0 propid 2017A-0388 seeing 0.77 MJD 57796.353 object Tile 37867 PASS 3 
    decam/CP/V4.8.2a/CP20170211/c4d_170212_083055_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95ac908-g-20170208T090241_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95af8ee-r-20170220T062654_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170210T080838_oi[N26,noinherit][2046,4094][real]: Tile 21
Clipping 2 pixels with anomalously large oow values: max 0.00298954 vs median 0.00223779
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170209T081005_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N20,noinherit][2046,4094][real]: Tile 37
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N25,noinherit][2046,4094][real]: Tile 37
Stage tims : Wall: 4.12 s, CPU: 0.78 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 182 MB, VmData: 216 MB, maxrss: 0.186464 MB
Stage tims finished: 2020-08-10T18:11:11.835281
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170209T081005_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95af8ee-r-20170220T062654_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N25,noinherit][2046,4094][real]: Tile 37 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95ac908-g-20170208T090241_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Resources for stage tims : 3.584 s worker CPU, 17.905 s worker Wall, Wall: 4.125 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N20,noinherit][2046,4094][real]: Tile 37 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170210T080838_oi[N26,noinherit][2046,4094][real]: Tile 21 [astropy.io.fits.card]
Running stage refs at 2020-08-10T18:11:11.862023
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09211.fits
Matched 3 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/reference-custom-167397m30313.fits
Stage refs : Wall: 3.80 s, CPU: 3.64 s, VmPeak: 1054 MB, VmSize: 1048 MB, VmRSS: 228 MB, VmData: 260 MB, maxrss: 0.233756 MB
Stage refs finished: 2020-08-10T18:11:15.662444
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 3.803 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T18:11:15.906070
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outlier-mask-custom-167397m30313.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-pre-custom-167397m30313.jpg
Image c4d_170212_083055_ooi_z_ls9-N20 z : masking 817 positive outlier pixels and 0 negative outlier pixels
Image c4d_170212_083055_ooi_z_ls9-N25 z : masking 915 positive outlier pixels and 0 negative outlier pixels
Image c4d_170209_081226_ooi_z_ls9-N26 z : masking 92 positive outlier pixels and 61 negative outlier pixels
Image c4d_170210_081039_ooi_z_ls9-N26 z : masking 1238 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outlier-mask-custom-167397m30313.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-post-custom-167397m30313.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-masked-pos-custom-167397m30313.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-masked-neg-custom-167397m30313.jpg
Stage outliers : Wall: 1.66 s, CPU: 0.90 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 274 MB, VmData: 305 MB, maxrss: 0.280988 MB
Stage outliers finished: 2020-08-10T18:11:17.562574
Resources for stage outliers : 1.676 s worker CPU, 2.022 s worker Wall, Wall: 1.659 s, Cores in use: 1.56, Total efficiency (on 32 cores): 4.9 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T18:11:17.693246
Stage halos : Wall: 0.33 s, CPU: 0.23 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 275 MB, VmData: 305 MB, maxrss: 0.281552 MB
Stage halos finished: 2020-08-10T18:11:18.021950
Resources for stage halos : 0.322 s worker CPU, 0.385 s worker Wall, Wall: 0.331 s, Cores in use: 1.68, Total efficiency (on 32 cores): 5.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T18:11:18.052586
PSF sigmas in coadd pixels: ['1.96']
Using average PSF sigma 1.9635784188691368
Gaussian PSF norm 0.14366362405650296 vs pixelized 0.11992791
average tim pixel scale / coadd scale: 1.001140653273048
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.42']
Using average PSF sigma 1.4180591661664559
Gaussian PSF norm 0.19893019875643542 vs pixelized 0.16013028
average tim pixel scale / coadd scale: 1.0011067617513978
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.08', '1.25', '1.63', '1.25']
Using average PSF sigma 1.3021804603936562
Gaussian PSF norm 0.2166326406776211 vs pixelized 0.17740731
average tim pixel scale / coadd scale: 1.001071045686178
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.28 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 276 MB, VmData: 305 MB, maxrss: 0.283016 MB
Stage fit_on_coadds finished: 2020-08-10T18:11:18.403238
Resources for stage fit_on_coadds : 0.287 s worker CPU, 0.318 s worker Wall, Wall: 0.353 s, Cores in use: 1.63, Total efficiency (on 32 cores): 5.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T18:11:18.423741
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 250 potential peaks
Of 250 potential peaks: 163 in veto map, 13 cut by saddle test, 0 cut by aper test, 74 kept
SED z : 74 new peaks
Found 100202 potential peaks
Of 100202 potential peaks: 100171 in veto map, 16 cut by saddle test, 0 cut by aper test, 15 kept
SED r : 15 new peaks
Found 92359 potential peaks
Of 92359 potential peaks: 92341 in veto map, 16 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 2567 potential peaks
Of 2567 potential peaks: 2542 in veto map, 18 cut by saddle test, 1 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 2635 potential peaks
Of 2635 potential peaks: 2612 in veto map, 22 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 98 new sources
Median coadd sky for g : 0.000105050756
Median coadd sky for r : 0.0001591619
Median coadd sky for z : 2.819643e-06
Stage srcs : Wall: 4.41 s, CPU: 2.28 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 277 MB, VmData: 305 MB, maxrss: 0.28354 MB
Stage srcs finished: 2020-08-10T18:11:22.834393
Resources for stage srcs : 4.327 s worker CPU, 4.367 s worker Wall, Wall: 4.413 s, Cores in use: 1.50, Total efficiency (on 32 cores): 4.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T18:11:22.870917
Blob 1 of 34, id: 0, sources: 82, size: 585x585, npix 176039, brick X: 0,585, Y: 0,585, one pixel: 0 0
Blob 2 of 34, id: 8, sources: 2, size: 68x51, npix 1829, brick X: 413,481, Y: 198,249, one pixel: 464 198
Blob 3 of 34, id: 12, sources: 2, size: 56x60, npix 1700, brick X: 416,472, Y: 250,310, one pixel: 441 250
Blob 4 of 34, id: 26, sources: 2, size: 52x37, npix 1151, brick X: 210,262, Y: 458,495, one pixel: 242 458
Blob 5 of 34, id: 16, sources: 1, size: 37x38, npix 1022, brick X: 180,217, Y: 356,394, one pixel: 195 356
Blob 6 of 34, id: 32, sources: 3, size: 41x35, npix 1022, brick X: 336,377, Y: 550,585, one pixel: 346 550
Blob 7 of 34, id: 30, sources: 2, size: 45x36, npix 948, brick X: 431,476, Y: 515,551, one pixel: 439 515
Blob 8 of 34, id: 31, sources: 1, size: 36x37, npix 910, brick X: 240,276, Y: 533,570, one pixel: 255 533
Blob 9 of 34, id: 23, sources: 2, size: 33x41, npix 895, brick X: 292,325, Y: 404,445, one pixel: 305 404
Blob 10 of 34, id: 1, sources: 1, size: 30x37, npix 712, brick X: 246,276, Y: 91,128, one pixel: 258 91
Blob 11 of 34, id: 17, sources: 2, size: 34x30, npix 697, brick X: 474,508, Y: 365,395, one pixel: 489 365
Blob 12 of 34, id: 18, sources: 2, size: 31x31, npix 584, brick X: 287,318, Y: 372,403, one pixel: 303 372
Blob 13 of 34, id: 25, sources: 1, size: 31x27, npix 560, brick X: 487,518, Y: 441,468, one pixel: 498 441
Blob 14 of 34, id: 14, sources: 2, size: 31x35, npix 522, brick X: 498,529, Y: 310,345, one pixel: 507 310
Blob 15 of 34, id: 2, sources: 1, size: 28x28, npix 516, brick X: 453,481, Y: 99,127, one pixel: 465 99
Blob 16 of 34, id: 20, sources: 1, size: 28x28, npix 512, brick X: 214,242, Y: 393,421, one pixel: 225 393
Blob 17 of 34, id: 33, sources: 2, size: 35x23, npix 422, brick X: 413,448, Y: 562,585, one pixel: 439 562
Blob 18 of 34, id: 9, sources: 1, size: 26x26, npix 418, brick X: 484,510, Y: 216,242, one pixel: 495 216
Blob 19 of 34, id: 10, sources: 1, size: 25x25, npix 404, brick X: 518,543, Y: 238,263, one pixel: 528 238
Blob 20 of 34, id: 3, sources: 1, size: 25x24, npix 364, brick X: 538,563, Y: 110,134, one pixel: 549 110
Blob 21 of 34, id: 21, sources: 1, size: 24x23, npix 348, brick X: 408,432, Y: 395,418, one pixel: 419 395
Blob 22 of 34, id: 28, sources: 1, size: 24x23, npix 327, brick X: 498,522, Y: 505,528, one pixel: 508 505
Blob 23 of 34, id: 6, sources: 1, size: 22x23, npix 323, brick X: 442,464, Y: 144,167, one pixel: 450 144
Blob 24 of 34, id: 24, sources: 1, size: 22x22, npix 313, brick X: 557,579, Y: 425,447, one pixel: 566 425
Blob 25 of 34, id: 4, sources: 1, size: 22x22, npix 300, brick X: 201,223, Y: 118,140, one pixel: 209 118
Blob 26 of 34, id: 13, sources: 1, size: 23x22, npix 295, brick X: 549,572, Y: 265,287, one pixel: 559 265
Blob 27 of 34, id: 19, sources: 1, size: 21x21, npix 261, brick X: 546,567, Y: 390,411, one pixel: 555 390
Blob 28 of 34, id: 29, sources: 1, size: 21x21, npix 259, brick X: 312,333, Y: 506,527, one pixel: 320 506
Blob 29 of 34, id: 7, sources: 1, size: 21x20, npix 257, brick X: 521,542, Y: 188,208, one pixel: 529 188
Blob 30 of 34, id: 5, sources: 1, size: 22x19, npix 255, brick X: 271,293, Y: 123,142, one pixel: 280 123
Blob 31 of 34, id: 15, sources: 1, size: 20x20, npix 219, brick X: 551,571, Y: 328,348, one pixel: 561 328
Blob 32 of 34, id: 27, sources: 1, size: 20x19, npix 218, brick X: 183,203, Y: 466,485, one pixel: 191 466
Blob 33 of 34, id: 22, sources: 1, size: 18x18, npix 180, brick X: 253,271, Y: 398,416, one pixel: 261 398
Blob 5 finished, total: Wall: 0.15 s, CPU: 0.11 s, VmPeak: 685 MB, VmSize: 677 MB, VmRSS: 98 MB, VmData: 148 MB, maxrss: 0.1084 MB
Blob 34 of 34, id: 11, sources: 1, size: 18x18, npix 171, brick X: 565,583, Y: 246,264, one pixel: 573 246
Blob 30 finished, total: Wall: 0.13 s, CPU: 0.10 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 187 MB, maxrss: 0.148948 MB
Blob 34 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 187 MB, maxrss: 0.148948 MB
Blob 33 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 685 MB, VmSize: 677 MB, VmRSS: 103 MB, VmData: 148 MB, maxrss: 0.1084 MB
Blob 27 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 679 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101092 MB
Blob 31 finished, total: Wall: 0.46 s, CPU: 0.42 s, VmPeak: 962 MB, VmSize: 716 MB, VmRSS: 131 MB, VmData: 171 MB, maxrss: 0.144616 MB
Blob 29 finished, total: Wall: 0.45 s, CPU: 0.41 s, VmPeak: 686 MB, VmSize: 679 MB, VmRSS: 104 MB, VmData: 150 MB, maxrss: 0.106892 MB
Blob 14 finished, total: Wall: 0.70 s, CPU: 0.69 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09788 MB
Blob 17 finished, total: Wall: 0.83 s, CPU: 0.80 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.151004 MB
Blob 28 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 677 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.099524 MB
Blob 32 finished, total: Wall: 0.95 s, CPU: 0.92 s, VmPeak: 958 MB, VmSize: 717 MB, VmRSS: 132 MB, VmData: 172 MB, maxrss: 0.145048 MB
Blob 18 finished, total: Wall: 1.03 s, CPU: 1.01 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 119 MB, VmData: 169 MB, maxrss: 0.121376 MB
Blob 15 finished, total: Wall: 1.06 s, CPU: 1.03 s, VmPeak: 681 MB, VmSize: 681 MB, VmRSS: 106 MB, VmData: 152 MB, maxrss: 0.108864 MB
Blob 16 finished, total: Wall: 1.06 s, CPU: 1.02 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.115692 MB
Blob 22 finished, total: Wall: 1.07 s, CPU: 1.01 s, VmPeak: 697 MB, VmSize: 697 MB, VmRSS: 115 MB, VmData: 168 MB, maxrss: 0.117416 MB
Blob 25 finished, total: Wall: 1.08 s, CPU: 1.05 s, VmPeak: 679 MB, VmSize: 676 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.104232 MB
Blob 21 finished, total: Wall: 1.10 s, CPU: 1.08 s, VmPeak: 682 MB, VmSize: 682 MB, VmRSS: 107 MB, VmData: 153 MB, maxrss: 0.109736 MB
Measuring 1 iterative sources
Blob 20 finished, total: Wall: 1.14 s, CPU: 1.11 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09614 MB
Blob 24 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 680 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.10106 MB
Measuring 1 iterative sources
Blob 26 finished, total: Wall: 1.16 s, CPU: 1.13 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098192 MB
Blob 19 finished, total: Wall: 1.23 s, CPU: 1.21 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098132 MB
Blob 8 finished, total: Wall: 1.42 s, CPU: 1.38 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099636 MB
Blob 23 finished, total: Wall: 1.32 s, CPU: 1.28 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.096828 MB
Blob 10 finished, total: Wall: 1.42 s, CPU: 1.39 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.89 s, CPU: 1.86 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.099604 MB
Blob 4 finished, total: Wall: 2.11 s, CPU: 2.09 s, VmPeak: 680 MB, VmSize: 677 MB, VmRSS: 103 MB, VmData: 149 MB, maxrss: 0.105912 MB
Blob 12 finished, total: Wall: 1.95 s, CPU: 1.93 s, VmPeak: 701 MB, VmSize: 701 MB, VmRSS: 120 MB, VmData: 172 MB, maxrss: 0.12294 MB
Blob 11 finished, total: Wall: 2.02 s, CPU: 1.99 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101536 MB
Blob 13 finished, total: Wall: 2.02 s, CPU: 2.00 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.153164 MB
Blob 7 finished, total: Wall: 2.10 s, CPU: 2.07 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 102 MB, VmData: 148 MB, maxrss: 0.104432 MB
Blob 9 finished, total: Wall: 2.32 s, CPU: 2.26 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.098856 MB
Blob 3 finished, total: Wall: 2.52 s, CPU: 2.50 s, VmPeak: 685 MB, VmSize: 685 MB, VmRSS: 111 MB, VmData: 156 MB, maxrss: 0.113592 MB
Blob 6 finished, total: Wall: 2.60 s, CPU: 2.54 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091184 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.28883, -30.34626), pm (-60.9, -2.9), parallax 4.355 with NanoMaggies: g=9.54, r=9.23, z=9.17
Reset brightness to NanoMaggies: g=9.54, r=9.23, z=9.17
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42281, -30.30757), pm (-12.9, -0.2), parallax 0.837 with NanoMaggies: g=16.8, r=16.2, z=14.9
Reset brightness to NanoMaggies: g=16.8, r=16.2, z=15.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.49523, ee1=0.0775053, ee2=0.187955
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42317, -30.31395), pm (-7.3, 2.1), parallax 0.218 with NanoMaggies: g=18.1, r=17.6, z=16.1
Reset brightness to NanoMaggies: g=18.1, r=17.6, z=17.5
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.59419, ee1=-0.0910014, ee2=-0.272696
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.37134, -30.33037), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -32.2), r=(flux -44.5), z=20.6
Reset brightness to NanoMaggies: g=22.1, r=21.1, z=20.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.41970, -30.29046), pm (-15.8, 7.9), parallax 0.141 with NanoMaggies: g=21.4, r=20, z=(flux -1.51e+03)
Reset brightness to NanoMaggies: g=21.4, r=20, z=18.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42039, -30.29036), pm (1.6, -2.2), parallax 0.343 with NanoMaggies: g=20.4, r=20.1, z=(flux -3.52e+03)
Reset brightness to NanoMaggies: g=20.4, r=20.1, z=20.1
Measuring 22 iterative sources
Blob 1 finished, total: Wall: 80.59 s, CPU: 80.58 s, VmPeak: 882 MB, VmSize: 806 MB, VmRSS: 235 MB, VmData: 274 MB, maxrss: 0.312756 MB
Old catalog: 130
New catalog: 138
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/blobs-custom-167397m30313.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/all-models-custom-167397m30313.fits
Stage fitblobs : Wall: 83.55 s, CPU: 2.72 s, VmPeak: 1066 MB, VmSize: 1057 MB, VmRSS: 274 MB, VmData: 302 MB, maxrss: 0.290776 MB
Stage fitblobs finished: 2020-08-10T18:12:46.420019
Resources for stage fitblobs : 120.532 s worker CPU, 127.727 s worker Wall, Wall: 83.551 s, Cores in use: 1.48, Total efficiency (on 32 cores): 4.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T18:12:46.451821
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-resid.jpg
Stage coadds : Wall: 6.52 s, CPU: 1.32 s, VmPeak: 1100 MB, VmSize: 1067 MB, VmRSS: 291 MB, VmData: 318 MB, maxrss: 0.332012 MB
Stage coadds finished: 2020-08-10T18:12:52.969483
Resources for stage coadds : 55.157 s worker CPU, 68.235 s worker Wall, Wall: 6.520 s, Cores in use: 8.66, Total efficiency (on 32 cores): 27.1 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T18:12:53.000616
Cut to 1 unWISE tiles
Reading WISE tile 1669m303 band 1
Reading WISE tile 1669m303 band 2
Reading WISE tile 1669m303 band 3
Reading WISE tile 1669m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.33 s, CPU: 0.91 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 142 MB, VmData: 187 MB, maxrss: 0.20302 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.68 s, CPU: 2.22 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 148 MB, VmData: 191 MB, maxrss: 0.188772 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.26 s, CPU: 0.59 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 149 MB, VmData: 189 MB, maxrss: 0.20928 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.25 s, CPU: 0.56 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 151 MB, VmData: 194 MB, maxrss: 0.211772 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.34 s, CPU: 0.74 s, VmPeak: 1100 MB, VmSize: 1067 MB, VmRSS: 292 MB, VmData: 318 MB, maxrss: 0.332012 MB
Stage wise_forced finished: 2020-08-10T18:12:55.342270
Resources for stage wise_forced : 7.485 s worker CPU, 5.530 s worker Wall, Wall: 2.344 s, Cores in use: 3.51, Total efficiency (on 32 cores): 11.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T18:12:55.378518
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/tractor-i/cus/tractor-custom-167397m30313.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/tractor/cus/tractor-custom-167397m30313.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/tractor/cus/brick-custom-167397m30313.sha256sum
Stage writecat : Wall: 1.15 s, CPU: 0.96 s, VmPeak: 1199 MB, VmSize: 1071 MB, VmRSS: 293 MB, VmData: 318 MB, maxrss: 0.431544 MB
Stage writecat finished: 2020-08-10T18:12:56.531750
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.156 s, Cores in use: 0.84, Total efficiency (on 32 cores): 2.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-writecat.p
All done: 193.377 s worker CPU, 226.496 s worker Wall, Wall: 108.873 s, Cores in use: 1.91, Total efficiency (on 32 cores): 6.0 %
Finished galaxy ESO438-006_GROUP in 1.842 minutes.
Started working on galaxy ESO438-006_GROUP at Thu Aug 13 07:29:57 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39722153665264 -30.3137271762281 --width 585 --height 585 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-13T07:30:00.345348
legacypipe git version: DR9.5.11-watershed-9-g82106209
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.39722153665264', '-30.3137271762281', '--width', '585', '--height', '585', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39722153665264 -30.3137271762281 --width 585 --height 585 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 167.39722153665264 -30.3137271762281
Starting process 36003 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 36004 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 36005 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 36006 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 36007 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB
Starting process 36008 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 36009 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 36010 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 36011 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 36012 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 36013 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 36014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 36015 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36016 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36017 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36018 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 36019 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 36020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 36021 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 36022 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 36023 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 36024 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 36025 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 36026 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 36027 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 36028 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 36029 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 36030 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 36031 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 36032 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 36033 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 36034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-13T07:30:03.230403
Keeping 6 CCDs:
  c4d_170208_090501_ooi_g_ls9-N26 g expnum 618349 exptime 90.0 propid 2017A-0260 seeing 1.21 MJD 57792.377 object BLISS field: 6123-01-g 
    decam/CP/V4.8.2a/CP20170207/c4d_170208_090501_ooi_g_ls9.fits.fz
  c4d_170209_081226_ooi_z_ls9-N26 z expnum 618726 exptime 90.0 propid 2017A-0260 seeing 0.67 MJD 57793.340 object BLISS field: 6123-01-z 
    decam/CP/V4.8.2a/CP20170208/c4d_170209_081226_ooi_z_ls9.fits.fz
  c4d_170220_062913_ooi_r_ls9-N26 r expnum 622734 exptime 90.0 propid 2017A-0260 seeing 0.87 MJD 57804.269 object BLISS field: 6123-01-r 
    decam/CP/V4.8.2a/CP20170219/c4d_170220_062913_ooi_r_ls9.fits.fz
  c4d_170212_083055_ooi_z_ls9-N20 z expnum 619719 exptime 90.0 propid 2017A-0388 seeing 0.77 MJD 57796.353 object Tile 37867 PASS 3 
    decam/CP/V4.8.2a/CP20170211/c4d_170212_083055_ooi_z_ls9.fits.fz
  c4d_170210_081039_ooi_z_ls9-N26 z expnum 619040 exptime 70.0 propid 2017A-0388 seeing 1.00 MJD 57794.339 object Tile 21995 PASS=2 
    decam/CP/V4.8.2a/CP20170209/c4d_170210_081039_ooi_z_ls9.fits.fz
  c4d_170212_083055_ooi_z_ls9-N25 z expnum 619719 exptime 90.0 propid 2017A-0388 seeing 0.77 MJD 57796.353 object Tile 37867 PASS 3 
    decam/CP/V4.8.2a/CP20170211/c4d_170212_083055_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95ac908-g-20170208T090241_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170209T081005_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170210T080838_oi[N26,noinherit][2046,4094][real]: Tile 21
Clipping 2 pixels with anomalously large oow values: max 0.00298954 vs median 0.00223779
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95af8ee-r-20170220T062654_oi[N26,noinherit][2046,4094][real]: BLISS f
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N25,noinherit][2046,4094][real]: Tile 37
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N20,noinherit][2046,4094][real]: Tile 37
Stage tims : Wall: 25.48 s, CPU: 2.22 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 182 MB, VmData: 216 MB, maxrss: 0.18638 MB
Stage tims finished: 2020-08-13T07:30:28.711699
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170209T081005_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a3b95-z-20170210T080838_oi[N26,noinherit][2046,4094][real]: Tile 21 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N20,noinherit][2046,4094][real]: Tile 37 [astropy.io.fits.card]
Resources for stage tims : 3.636 s worker CPU, 118.243 s worker Wall, Wall: 25.484 s, Cores in use: 0.23, Total efficiency (on 32 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95ac908-g-20170208T090241_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95a51da-z-20170212T082835_oi[N25,noinherit][2046,4094][real]: Tile 37 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95af8ee-r-20170220T062654_oi[N26,noinherit][2046,4094][real]: BLISS f [astropy.io.fits.card]
Running stage refs at 2020-08-13T07:30:28.773426
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09211.fits
Matched 3 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/reference-custom-167397m30313.fits
Stage refs : Wall: 6.41 s, CPU: 4.96 s, VmPeak: 1054 MB, VmSize: 1048 MB, VmRSS: 229 MB, VmData: 260 MB, maxrss: 0.234092 MB
Stage refs finished: 2020-08-13T07:30:35.186962
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 6.416 s, Cores in use: 0.77, Total efficiency (on 32 cores): 2.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-13T07:30:35.236760
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outlier-mask-custom-167397m30313.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-pre-custom-167397m30313.jpg
Image c4d_170212_083055_ooi_z_ls9-N20 z : masking 817 positive outlier pixels and 0 negative outlier pixels
Image c4d_170209_081226_ooi_z_ls9-N26 z : masking 92 positive outlier pixels and 61 negative outlier pixels
Image c4d_170212_083055_ooi_z_ls9-N25 z : masking 915 positive outlier pixels and 0 negative outlier pixels
Image c4d_170210_081039_ooi_z_ls9-N26 z : masking 1238 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outlier-mask-custom-167397m30313.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-post-custom-167397m30313.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-masked-pos-custom-167397m30313.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/outliers-masked-neg-custom-167397m30313.jpg
Stage outliers : Wall: 11.07 s, CPU: 2.27 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 274 MB, VmData: 304 MB, maxrss: 0.280472 MB
Stage outliers finished: 2020-08-13T07:30:46.302617
Resources for stage outliers : 1.595 s worker CPU, 2.028 s worker Wall, Wall: 11.068 s, Cores in use: 0.35, Total efficiency (on 32 cores): 1.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-13T07:30:46.361501
Stage halos : Wall: 1.25 s, CPU: 0.98 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 274 MB, VmData: 305 MB, maxrss: 0.281064 MB
Stage halos finished: 2020-08-13T07:30:47.615459
Resources for stage halos : 0.332 s worker CPU, 1.076 s worker Wall, Wall: 1.256 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-13T07:30:48.047790
PSF sigmas in coadd pixels: ['1.96']
Using average PSF sigma 1.9635784188691368
Gaussian PSF norm 0.14366362405650296 vs pixelized 0.11992791
average tim pixel scale / coadd scale: 1.001140653273048
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.42']
Using average PSF sigma 1.4180591661664559
Gaussian PSF norm 0.19893019875643542 vs pixelized 0.16013028
average tim pixel scale / coadd scale: 1.0011067617513978
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.08', '1.25', '1.63', '1.25']
Using average PSF sigma 1.3021804603936562
Gaussian PSF norm 0.2166326406776211 vs pixelized 0.17740731
average tim pixel scale / coadd scale: 1.001071045686178
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.38 s, CPU: 0.27 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 276 MB, VmData: 305 MB, maxrss: 0.282528 MB
Stage fit_on_coadds finished: 2020-08-13T07:30:48.422982
Resources for stage fit_on_coadds : 0.282 s worker CPU, 0.319 s worker Wall, Wall: 0.377 s, Cores in use: 1.48, Total efficiency (on 32 cores): 4.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-13T07:30:48.497801
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 250 potential peaks
Of 250 potential peaks: 163 in veto map, 13 cut by saddle test, 0 cut by aper test, 74 kept
SED z : 74 new peaks
Found 100202 potential peaks
Of 100202 potential peaks: 100171 in veto map, 16 cut by saddle test, 0 cut by aper test, 15 kept
SED r : 15 new peaks
Found 92359 potential peaks
Of 92359 potential peaks: 92341 in veto map, 16 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 2567 potential peaks
Of 2567 potential peaks: 2542 in veto map, 18 cut by saddle test, 1 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 2635 potential peaks
Of 2635 potential peaks: 2612 in veto map, 22 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 98 new sources
Median coadd sky for g : 0.000105050756
Median coadd sky for r : 0.0001591619
Median coadd sky for z : 2.8196428e-06
Stage srcs : Wall: 5.60 s, CPU: 3.34 s, VmPeak: 1066 MB, VmSize: 1066 MB, VmRSS: 276 MB, VmData: 305 MB, maxrss: 0.283052 MB
Stage srcs finished: 2020-08-13T07:30:54.096711
Resources for stage srcs : 4.496 s worker CPU, 4.496 s worker Wall, Wall: 5.601 s, Cores in use: 1.40, Total efficiency (on 32 cores): 4.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-13T07:30:54.163716
Blob 1 of 34, id: 0, sources: 82, size: 585x585, npix 176039, brick X: 0,585, Y: 0,585, one pixel: 0 0
Blob 2 of 34, id: 8, sources: 2, size: 68x51, npix 1829, brick X: 413,481, Y: 198,249, one pixel: 464 198
Blob 3 of 34, id: 12, sources: 2, size: 56x60, npix 1700, brick X: 416,472, Y: 250,310, one pixel: 441 250
Blob 4 of 34, id: 26, sources: 2, size: 52x37, npix 1151, brick X: 210,262, Y: 458,495, one pixel: 242 458
Blob 5 of 34, id: 16, sources: 1, size: 37x38, npix 1022, brick X: 180,217, Y: 356,394, one pixel: 195 356
Blob 6 of 34, id: 32, sources: 3, size: 41x35, npix 1022, brick X: 336,377, Y: 550,585, one pixel: 346 550
Blob 7 of 34, id: 30, sources: 2, size: 45x36, npix 948, brick X: 431,476, Y: 515,551, one pixel: 439 515
Blob 8 of 34, id: 31, sources: 1, size: 36x37, npix 910, brick X: 240,276, Y: 533,570, one pixel: 255 533
Blob 9 of 34, id: 23, sources: 2, size: 33x41, npix 895, brick X: 292,325, Y: 404,445, one pixel: 305 404
Blob 10 of 34, id: 1, sources: 1, size: 30x37, npix 712, brick X: 246,276, Y: 91,128, one pixel: 258 91
Blob 11 of 34, id: 17, sources: 2, size: 34x30, npix 697, brick X: 474,508, Y: 365,395, one pixel: 489 365
Blob 12 of 34, id: 18, sources: 2, size: 31x31, npix 584, brick X: 287,318, Y: 372,403, one pixel: 303 372
Blob 13 of 34, id: 25, sources: 1, size: 31x27, npix 560, brick X: 487,518, Y: 441,468, one pixel: 498 441
Blob 14 of 34, id: 14, sources: 2, size: 31x35, npix 522, brick X: 498,529, Y: 310,345, one pixel: 507 310
Blob 15 of 34, id: 2, sources: 1, size: 28x28, npix 516, brick X: 453,481, Y: 99,127, one pixel: 465 99
Blob 16 of 34, id: 20, sources: 1, size: 28x28, npix 512, brick X: 214,242, Y: 393,421, one pixel: 225 393
Blob 17 of 34, id: 33, sources: 2, size: 35x23, npix 422, brick X: 413,448, Y: 562,585, one pixel: 439 562
Blob 18 of 34, id: 9, sources: 1, size: 26x26, npix 418, brick X: 484,510, Y: 216,242, one pixel: 495 216
Blob 19 of 34, id: 10, sources: 1, size: 25x25, npix 404, brick X: 518,543, Y: 238,263, one pixel: 528 238
Blob 20 of 34, id: 3, sources: 1, size: 25x24, npix 364, brick X: 538,563, Y: 110,134, one pixel: 549 110
Blob 21 of 34, id: 21, sources: 1, size: 24x23, npix 348, brick X: 408,432, Y: 395,418, one pixel: 419 395
Blob 22 of 34, id: 28, sources: 1, size: 24x23, npix 327, brick X: 498,522, Y: 505,528, one pixel: 508 505
Blob 23 of 34, id: 6, sources: 1, size: 22x23, npix 323, brick X: 442,464, Y: 144,167, one pixel: 450 144
Blob 24 of 34, id: 24, sources: 1, size: 22x22, npix 313, brick X: 557,579, Y: 425,447, one pixel: 566 425
Blob 25 of 34, id: 4, sources: 1, size: 22x22, npix 300, brick X: 201,223, Y: 118,140, one pixel: 209 118
Blob 26 of 34, id: 13, sources: 1, size: 23x22, npix 295, brick X: 549,572, Y: 265,287, one pixel: 559 265
Blob 27 of 34, id: 19, sources: 1, size: 21x21, npix 261, brick X: 546,567, Y: 390,411, one pixel: 555 390
Blob 28 of 34, id: 29, sources: 1, size: 21x21, npix 259, brick X: 312,333, Y: 506,527, one pixel: 320 506
Blob 29 of 34, id: 7, sources: 1, size: 21x20, npix 257, brick X: 521,542, Y: 188,208, one pixel: 529 188
Blob 30 of 34, id: 5, sources: 1, size: 22x19, npix 255, brick X: 271,293, Y: 123,142, one pixel: 280 123
Blob 31 of 34, id: 15, sources: 1, size: 20x20, npix 219, brick X: 551,571, Y: 328,348, one pixel: 561 328
Blob 32 of 34, id: 27, sources: 1, size: 20x19, npix 218, brick X: 183,203, Y: 466,485, one pixel: 191 466
Blob 33 of 34, id: 22, sources: 1, size: 18x18, npix 180, brick X: 253,271, Y: 398,416, one pixel: 261 398
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.40513, -30.30767), pm (-4.1, -3.2), parallax 0.510 with NanoMaggies: g=18.8, r=17.5, z=16.9
  cat entry: tabledata object with 1 rows and 62 columns
Blob 5 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 956 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146188 MB
Blob 34 of 34, id: 11, sources: 1, size: 18x18, npix 171, brick X: 565,583, Y: 246,264, one pixel: 573 246
Blob 30 finished, total: Wall: 0.15 s, CPU: 0.11 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 93 MB, VmData: 144 MB, maxrss: 0.095272 MB
Blob 34 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 93 MB, VmData: 144 MB, maxrss: 0.095416 MB
Blob 31 finished, total: Wall: 0.41 s, CPU: 0.40 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 111 MB, VmData: 157 MB, maxrss: 0.114128 MB
Blob 29 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 676 MB, VmSize: 676 MB, VmRSS: 100 MB, VmData: 147 MB, maxrss: 0.102784 MB
Blob 27 finished, total: Wall: 0.43 s, CPU: 0.42 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099184 MB
Blob 33 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 956 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146188 MB
Blob 14 finished, total: Wall: 0.76 s, CPU: 0.75 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.097836 MB
Blob 22 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 675 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.09772 MB
Blob 25 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 680 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.10104 MB
Blob 28 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.095988 MB
Blob 18 finished, total: Wall: 1.04 s, CPU: 1.03 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146244 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.38249, -30.32678), pm (-10.2, 8.5), parallax -0.654 with NanoMaggies: g=22.2, r=20.6, z=19.2
  cat entry: tabledata object with 1 rows and 62 columns
Blob 15 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101272 MB
Blob 17 finished, total: Wall: 1.07 s, CPU: 1.03 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.099196 MB
Blob 20 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100036 MB
Blob 26 finished, total: Wall: 1.07 s, CPU: 1.04 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090284 MB
Blob 21 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 962 MB, VmSize: 699 MB, VmRSS: 114 MB, VmData: 154 MB, maxrss: 0.14466 MB
Blob 19 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146756 MB
Blob 32 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.153156 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.40265, -30.30540), pm (-26.0, 17.8), parallax 1.821 with NanoMaggies: g=22.9, r=21.2, z=19.2
  cat entry: tabledata object with 1 rows and 62 columns
Blob 16 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091864 MB
Blob 24 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 678 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099528 MB
Measuring 1 iterative sources
Blob 23 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 676 MB, VmSize: 676 MB, VmRSS: 101 MB, VmData: 147 MB, maxrss: 0.10298 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.40013, -30.29489), pm (-7.2, 1.3), parallax 0.081 with NanoMaggies: g=19, r=18.3, z=18
  cat entry: tabledata object with 1 rows and 62 columns
Blob 8 finished, total: Wall: 1.40 s, CPU: 1.39 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 116 MB, VmData: 169 MB, maxrss: 0.11912 MB
Measuring 1 iterative sources
Blob 12 finished, total: Wall: 1.58 s, CPU: 1.56 s, VmPeak: 681 MB, VmSize: 681 MB, VmRSS: 107 MB, VmData: 152 MB, maxrss: 0.109076 MB
Blob 10 finished, total: Wall: 1.69 s, CPU: 1.69 s, VmPeak: 677 MB, VmSize: 673 MB, VmRSS: 99 MB, VmData: 144 MB, maxrss: 0.101408 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.38307, -30.31905), pm (-8.7, -0.9), parallax 0.169 with NanoMaggies: g=18.4, r=17.9, z=17.7
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.38437, -30.31815), pm (-5.1, 1.9), parallax 0.537 with NanoMaggies: g=20.2, r=19.3, z=18.9
  cat entry: tabledata object with 1 rows and 62 columns
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 1.86 s, CPU: 1.85 s, VmPeak: 673 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.100088 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.38073, -30.30735), pm (-11.1, -5.8), parallax 0.005 with NanoMaggies: g=21.4, r=20.1, z=19.1
  cat entry: tabledata object with 1 rows and 62 columns
Blob 11 finished, total: Wall: 1.93 s, CPU: 1.92 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.11672 MB
Blob 2 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099824 MB
Blob 13 finished, total: Wall: 2.09 s, CPU: 2.08 s, VmPeak: 957 MB, VmSize: 700 MB, VmRSS: 115 MB, VmData: 155 MB, maxrss: 0.144996 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.40130, -30.30031), pm (-138.3, -19.3), parallax 6.747 with NanoMaggies: g=21.6, r=19.8, z=16.8
  cat entry: tabledata object with 1 rows and 62 columns
Blob 4 finished, total: Wall: 2.17 s, CPU: 2.17 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.100188 MB
Blob 9 finished, total: Wall: 2.28 s, CPU: 2.27 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 110 MB, VmData: 165 MB, maxrss: 0.11236 MB
Blob 3 finished, total: Wall: 2.46 s, CPU: 2.45 s, VmPeak: 682 MB, VmSize: 682 MB, VmRSS: 108 MB, VmData: 153 MB, maxrss: 0.110108 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.39136, -30.29327), pm (-1.7, -0.8), parallax -0.561 with NanoMaggies: g=20.7, r=20.4, z=20
  cat entry: tabledata object with 1 rows and 62 columns
Blob 6 finished, total: Wall: 2.68 s, CPU: 2.67 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101128 MB
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.28883, -30.34626), pm (-60.9, -2.9), parallax 4.355 with NanoMaggies: g=9.54, r=9.23, z=9.17
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.42281, -30.30757), pm (-12.9, -0.2), parallax 0.837 with NanoMaggies: g=16.8, r=16.2, z=14.9
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.40383, -30.31448), pm (-11.4, -1.2), parallax 0.529 with NanoMaggies: g=17.6, r=16.8, z=16.6
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.41639, -30.30791), pm (-6.7, 2.7), parallax -0.003 with NanoMaggies: g=17.9, r=17.4, z=17.4
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.41645, -30.29391), pm (-6.8, -3.7), parallax 0.294 with NanoMaggies: g=17.9, r=17.5, z=17.4
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.37294, -30.33329), pm (-13.4, 2.6), parallax 0.736 with NanoMaggies: g=15.5, r=17.5, z=17.3
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.42317, -30.31395), pm (-7.3, 2.1), parallax 0.218 with NanoMaggies: g=18.1, r=17.6, z=16.1
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.42181, -30.30767), pm (-13.1, 0.1), parallax 0.796 with NanoMaggies: g=20.2, r=18.9, z=18.3
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.41784, -30.32818), pm (-2.5, -3.2), parallax -0.179 with NanoMaggies: g=19.8, r=19.4, z=19.4
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.39030, -30.32155), pm (-8.4, -4.7), parallax 0.888 with NanoMaggies: g=20.9, r=19.7, z=18.1
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.41970, -30.29046), pm (-15.8, 7.9), parallax 0.141 with NanoMaggies: g=21.4, r=20, z=(flux -1.51e+03)
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.39257, -30.32187), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=18.9, r=19.4, z=20.2
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.39306, -30.32054), pm (-0.8, -0.5), parallax -0.303 with NanoMaggies: g=20.3, r=19.9, z=19.8
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.42039, -30.29036), pm (1.6, -2.2), parallax 0.343 with NanoMaggies: g=20.4, r=20.1, z=(flux -3.52e+03)
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.38372, -30.32966), pm (0.1, 1.2), parallax -1.637 with NanoMaggies: g=20.9, r=20.6, z=20.4
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.40964, -30.30611), pm (0.4, 1.6), parallax -0.707 with NanoMaggies: g=(flux -34.8), r=19.3, z=19.7
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: GaiaSource at GaiaPosition: RA, Dec = (167.37134, -30.33037), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -32.2), r=(flux -44.5), z=20.6
  cat entry: tabledata object with 1 rows and 62 columns
Reference source: ExpGalaxy at RaDecPos: RA, Dec = (167.40187, -30.31188) with NanoMaggies: g=18, r=17.8, z=18.2 and EllipseWithPriors(0.25): log r_e=1.59419, ee1=-0.0910016, ee2=-0.272696
  cat entry: tabledata object with 1 rows and 62 columns
  cat entry: tabledata object with 2 rows and 62 columns
Reference source: ExpGalaxy at RaDecPos: RA, Dec = (167.39537, -30.31595) with NanoMaggies: g=17.3, r=17, z=16.1 and EllipseWithPriors(0.25): log r_e=2.49523, ee1=0.0775054, ee2=0.187955
  cat entry: tabledata object with 1 rows and 62 columns
  cat entry: tabledata object with 2 rows and 62 columns
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.28883, -30.34626), pm (-60.9, -2.9), parallax 4.355 with NanoMaggies: g=9.54, r=9.23, z=9.17
Reset brightness to NanoMaggies: g=9.54, r=9.23, z=9.17
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42281, -30.30757), pm (-12.9, -0.2), parallax 0.837 with NanoMaggies: g=16.8, r=16.2, z=14.9
Reset brightness to NanoMaggies: g=16.8, r=16.2, z=15.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.49523, ee1=0.0775054, ee2=0.187955
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42317, -30.31395), pm (-7.3, 2.1), parallax 0.218 with NanoMaggies: g=18.1, r=17.6, z=16.1
Reset brightness to NanoMaggies: g=18.1, r=17.6, z=17.5
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.59419, ee1=-0.0910016, ee2=-0.272696
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.37134, -30.33037), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -32.2), r=(flux -44.5), z=20.6
Reset brightness to NanoMaggies: g=22.1, r=21.1, z=20.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.41970, -30.29046), pm (-15.8, 7.9), parallax 0.141 with NanoMaggies: g=21.4, r=20, z=(flux -1.51e+03)
Reset brightness to NanoMaggies: g=21.4, r=20, z=18.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (167.42039, -30.29036), pm (1.6, -2.2), parallax 0.343 with NanoMaggies: g=20.4, r=20.1, z=(flux -3.52e+03)
Reset brightness to NanoMaggies: g=20.4, r=20.1, z=20.1
Measuring 22 iterative sources
Blob 1 finished, total: Wall: 80.41 s, CPU: 80.34 s, VmPeak: 881 MB, VmSize: 807 MB, VmRSS: 235 MB, VmData: 275 MB, maxrss: 0.310976 MB
Old catalog: 130
New catalog: 139
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/blobs-custom-167397m30313.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/metrics/cus/all-models-custom-167397m30313.fits
Stage fitblobs : Wall: 82.30 s, CPU: 1.70 s, VmPeak: 1066 MB, VmSize: 1060 MB, VmRSS: 278 MB, VmData: 305 MB, maxrss: 0.291212 MB
Stage fitblobs finished: 2020-08-13T07:32:16.461223
Resources for stage fitblobs : 120.789 s worker CPU, 121.749 s worker Wall, Wall: 82.300 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-13T07:32:16.816900
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-resid.jpg
Stage coadds : Wall: 10.47 s, CPU: 3.63 s, VmPeak: 1104 MB, VmSize: 1104 MB, VmRSS: 327 MB, VmData: 354 MB, maxrss: 0.335116 MB
Stage coadds finished: 2020-08-13T07:32:27.285291
Resources for stage coadds : 36.732 s worker CPU, 82.016 s worker Wall, Wall: 10.471 s, Cores in use: 3.86, Total efficiency (on 32 cores): 12.0 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-13T07:32:27.354486
Cut to 1 unWISE tiles
Reading WISE tile 1669m303 band 1
Reading WISE tile 1669m303 band 4
Reading WISE tile 1669m303 band 3
Reading WISE tile 1669m303 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.62 s, CPU: 2.01 s, VmPeak: 1070 MB, VmSize: 1008 MB, VmRSS: 145 MB, VmData: 191 MB, maxrss: 0.187216 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.32 s, CPU: 0.85 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 141 MB, VmData: 187 MB, maxrss: 0.202428 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.25 s, CPU: 0.57 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 144 MB, VmData: 188 MB, maxrss: 0.206772 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/166/1669m303/unwise-1669m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.22 s, CPU: 0.50 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 153 MB, VmData: 193 MB, maxrss: 0.21328 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/tmp-legacysurvey-custom-167397m30313-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 10.33 s, CPU: 3.46 s, VmPeak: 1104 MB, VmSize: 1104 MB, VmRSS: 328 MB, VmData: 354 MB, maxrss: 0.335892 MB
Stage wise_forced finished: 2020-08-13T07:32:37.682145
Resources for stage wise_forced : 7.123 s worker CPU, 8.373 s worker Wall, Wall: 10.330 s, Cores in use: 1.02, Total efficiency (on 32 cores): 3.2 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-13T07:32:37.744389
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/coadd/cus/custom-167397m30313/legacysurvey-custom-167397m30313-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/tractor-i/cus/tractor-custom-167397m30313.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/tractor/cus/tractor-custom-167397m30313.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/tractor/cus/brick-custom-167397m30313.sha256sum
Stage writecat : Wall: 8.87 s, CPU: 3.73 s, VmPeak: 1207 MB, VmSize: 1079 MB, VmRSS: 301 MB, VmData: 324 MB, maxrss: 0.438876 MB
Stage writecat finished: 2020-08-13T07:32:46.610500
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.869 s, Cores in use: 0.42, Total efficiency (on 32 cores): 1.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/ESO438-006_GROUP/ESO438-006_GROUP-largegalaxy-writecat.p
All done: 174.992 s worker CPU, 338.307 s worker Wall, Wall: 163.449 s, Cores in use: 1.24, Total efficiency (on 32 cores): 3.9 %
Finished galaxy ESO438-006_GROUP in 2.836 minutes.