Started working on galaxy PGC714465 at Sun Jun  7 12:21:09 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 31.992618 -30.6656412 --width 405 --height 405 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T12:21:10.919417
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '31.992618', '-30.6656412', '--width', '405', '--height', '405', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 31.992618 -30.6656412 --width 405 --height 405 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 31.992618 -30.6656412
Starting process 23595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 23597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 23598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB
Starting process 23599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T12:21:19.558493
Keeping 19 CCDs:
   c4d_141230_034550_ooi_z_ls9.fits.fz c4d_141230_034550_ooi_z_ls9-N5 z exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57021.155 object DES survey hex 323-298 tiling 3
   c4d_151205_034605_ooi_r_ls9.fits.fz c4d_151205_034605_ooi_r_ls9-N5 r exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57361.155 object DES survey hex 323-298 tiling 3
   c4d_161207_051343_ooi_r_ls9.fits.fz c4d_161207_051343_ooi_r_ls9-S28 r exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57729.216 object DES survey hex 321-318 tiling 6
   c4d_161023_072150_ooi_z_ls9.fits.fz c4d_161023_072150_ooi_z_ls9-S28 z exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 57684.305 object DES survey hex 321-318 tiling 6
   c4d_161124_054139_ooi_g_ls9.fits.fz c4d_161124_054139_ooi_g_ls9-S28 g exptime 90.0 propid 2012B-0001 seeing 1.85 MJD 57716.236 object DES survey hex 321-318 tiling 6
   c4d_161218_041900_ooi_z_ls9.fits.fz c4d_161218_041900_ooi_z_ls9-S28 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57740.178 object DES survey hex 321-318 tiling 6
   c4d_161123_055050_ooi_g_v1.fits.fz c4d_161123_055050_ooi_g_v1-S28 g exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57715.242 object DES survey hex 321-318 tiling 6
   c4d_180203_010051_ooi_r_v1.fits.fz c4d_180203_010051_ooi_r_v1-N13 r exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 58152.042 object DES survey hex 303-308 tiling 9
   c4d_180203_010250_ooi_g_v1.fits.fz c4d_180203_010250_ooi_g_v1-N13 g exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 58152.044 object DES survey hex 303-308 tiling 9
   c4d_180123_010814_ooi_z_v1.fits.fz c4d_180123_010814_ooi_z_v1-N13 z exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58141.047 object DES survey hex 303-308 tiling 9
   c4d_171020_075834_ooi_r_ls9.fits.fz c4d_171020_075834_ooi_r_ls9-N26 r exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58046.332 object DES survey hex 323-298 tiling 8
   c4d_171020_080032_ooi_g_ls9.fits.fz c4d_171020_080032_ooi_g_ls9-N26 g exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58046.334 object DES survey hex 323-298 tiling 8
   c4d_171207_050449_ooi_z_ls9.fits.fz c4d_171207_050449_ooi_z_ls9-N26 z exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58094.212 object DES survey hex 323-298 tiling 8
   c4d_151024_015535_ooi_z_ls9.fits.fz c4d_151024_015535_ooi_z_ls9-S16 z exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57319.079 object DES survey hex 321-318 tiling 4
   c4d_151204_031543_ooi_g_ls9.fits.fz c4d_151204_031543_ooi_g_ls9-N29 g exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 57360.134 object DES survey hex 323-298 tiling 1
   c4d_151118_025337_ooi_r_ls9.fits.fz c4d_151118_025337_ooi_r_ls9-N29 r exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57344.119 object DES survey hex 323-298 tiling 1
   c4d_171018_063145_ooi_g_v1.fits.fz c4d_171018_063145_ooi_g_v1-N12 g exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58044.272 object DES survey hex 303-308 tiling 7
   c4d_170201_010804_ooi_z_ls9.fits.fz c4d_170201_010804_ooi_z_ls9-N12 z exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57785.046 object DES survey hex 303-308 tiling 7
   c4d_151214_011553_ooi_g_ls9.fits.fz c4d_151214_011553_ooi_g_ls9-N5 g exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57370.051 object DES survey hex 323-298 tiling 3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N13,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000266)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N13,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N13,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 3.8e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N26,noinherit][2046,4094][real]: DES sur
Zeroing out 0 weight-map pixels below quantization error (= median 0.000162)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N12,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N26,noinherit][2046,4094][real]: DES sur
Zeroing out 0 weight-map pixels below quantization error (= median 5.82e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S16,noinherit][2046,4094][real]: DES sur
Zeroing out 2 weight-map pixels below quantization error (= median 0.000229)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[N5,noinherit][2046,4094][real]: DES surv
Stage tims : Wall: 201.49 s, CPU: 7.53 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 202 MB, VmData: 235 MB, maxrss: 0.454624 MB
Stage tims finished: 2020-06-07T12:24:41.044476
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N13,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N13,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N12,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 6.642 s worker CPU, 577.465 s worker Wall, Wall: 201.487 s, Cores in use: 0.07, Total efficiency (on 4 cores): 1.8 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N13,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Running stage refs at 2020-06-07T12:24:41.271263
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09291.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09163.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/reference-custom-031992m30665.fits
Stage refs : Wall: 10.19 s, CPU: 9.92 s, VmPeak: 1034 MB, VmSize: 1013 MB, VmRSS: 219 MB, VmData: 252 MB, maxrss: 0.454624 MB
Stage refs finished: 2020-06-07T12:24:51.460558
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.190 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T12:24:51.461927
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outlier-mask-custom-031992m30665.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-pre-custom-031992m30665.jpg
Image c4d_161124_054139_ooi_g_ls9-S28 g : masking 730 positive outlier pixels and 301 negative outlier pixels
Image c4d_161123_055050_ooi_g_v1-S28 g : masking 4082 positive outlier pixels and 219 negative outlier pixels
Image c4d_180203_010250_ooi_g_v1-N13 g : masking 1748 positive outlier pixels and 0 negative outlier pixels
Image c4d_151204_031543_ooi_g_ls9-N29 g : masking 779 positive outlier pixels and 0 negative outlier pixels
Image c4d_171018_063145_ooi_g_v1-N12 g : masking 883 positive outlier pixels and 0 negative outlier pixels
Image c4d_161207_051343_ooi_r_ls9-S28 r : masking 312 positive outlier pixels and 98 negative outlier pixels
Image c4d_180203_010051_ooi_r_v1-N13 r : masking 287 positive outlier pixels and 0 negative outlier pixels
Image c4d_171020_075834_ooi_r_ls9-N26 r : masking 521 positive outlier pixels and 0 negative outlier pixels
Image c4d_151118_025337_ooi_r_ls9-N29 r : masking 474 positive outlier pixels and 0 negative outlier pixels
Image c4d_161023_072150_ooi_z_ls9-S28 z : masking 1614 positive outlier pixels and 0 negative outlier pixels
Image c4d_161218_041900_ooi_z_ls9-S28 z : masking 359 positive outlier pixels and 0 negative outlier pixels
Image c4d_180123_010814_ooi_z_v1-N13 z : masking 427 positive outlier pixels and 0 negative outlier pixels
Image c4d_171207_050449_ooi_z_ls9-N26 z : masking 91 positive outlier pixels and 0 negative outlier pixels
Image c4d_151024_015535_ooi_z_ls9-S16 z : masking 64 positive outlier pixels and 192 negative outlier pixels
Image c4d_170201_010804_ooi_z_ls9-N12 z : masking 83 positive outlier pixels and 367 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outlier-mask-custom-031992m30665.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-post-custom-031992m30665.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-masked-pos-custom-031992m30665.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-masked-neg-custom-031992m30665.jpg
Stage outliers : Wall: 11.86 s, CPU: 9.10 s, VmPeak: 1034 MB, VmSize: 1023 MB, VmRSS: 260 MB, VmData: 290 MB, maxrss: 0.454624 MB
Stage outliers finished: 2020-06-07T12:25:03.325681
Resources for stage outliers : 4.702 s worker CPU, 4.827 s worker Wall, Wall: 11.865 s, Cores in use: 1.16, Total efficiency (on 4 cores): 29.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T12:25:03.327319
Stage halos : Wall: 14.96 s, CPU: 7.98 s, VmPeak: 1034 MB, VmSize: 1023 MB, VmRSS: 260 MB, VmData: 290 MB, maxrss: 0.454624 MB
Stage halos finished: 2020-06-07T12:25:18.283336
Resources for stage halos : 0.232 s worker CPU, 23.080 s worker Wall, Wall: 14.957 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.7 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T12:25:18.285155
PSF sigmas in coadd pixels: ['3.00', '2.21', '1.49', '1.51', '2.35', '1.80', '1.83']
Using average PSF sigma 2.0278730761330706
Gaussian PSF norm 0.13910870216384633 vs pixelized 0.10743482
average tim pixel scale / coadd scale: 1.0010329802086904
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.99', '1.76', '1.59', '1.76']
Using average PSF sigma 1.808556899645815
Gaussian PSF norm 0.15597783615717215 vs pixelized 0.159452
average tim pixel scale / coadd scale: 1.0010606532859552
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.73', '2.33', '1.71', '2.08', '1.55', '1.83', '1.64']
Using average PSF sigma 1.8393698048476212
Gaussian PSF norm 0.15336491391259285 vs pixelized 0.1422636
average tim pixel scale / coadd scale: 1.0010084292075454
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.72 s, CPU: 0.62 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.454624 MB
Stage fit_on_coadds finished: 2020-06-07T12:25:19.000840
Resources for stage fit_on_coadds : 0.949 s worker CPU, 1.046 s worker Wall, Wall: 0.717 s, Cores in use: 2.19, Total efficiency (on 4 cores): 54.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T12:25:19.004039
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 56 potential peaks
Of 56 potential peaks: 3 in veto map, 8 cut by saddle test, 0 cut by aper test, 45 kept
SED z : 45 new peaks
Found 65 potential peaks
Of 65 potential peaks: 39 in veto map, 7 cut by saddle test, 0 cut by aper test, 19 kept
SED r : 19 new peaks
Found 45 potential peaks
Of 45 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 91 potential peaks
Of 91 potential peaks: 65 in veto map, 11 cut by saddle test, 0 cut by aper test, 15 kept
SED Flat : 15 new peaks
Found 100 potential peaks
Of 100 potential peaks: 85 in veto map, 11 cut by saddle test, 0 cut by aper test, 4 kept
SED Red : 4 new peaks
Adding 86 new sources
Median coadd sky for g : -0.000108928216
Median coadd sky for r : -6.6268944e-06
Median coadd sky for z : 8.403628e-05
Stage srcs : Wall: 8.02 s, CPU: 7.94 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.454624 MB
Stage srcs finished: 2020-06-07T12:25:27.023435
Resources for stage srcs : 0.228 s worker CPU, 0.242 s worker Wall, Wall: 8.020 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T12:25:27.040118
Blob 1 of 58, id: 15, sources: 4, size: 110x177, npix 9648, brick X: 149,259, Y: 114,291, one pixel: 173 114
Blob 2 of 58, id: 0, sources: 2, size: 62x49, npix 2183, brick X: 0,62, Y: 0,49, one pixel: 10 0
Blob 3 of 58, id: 49, sources: 5, size: 66x60, npix 1999, brick X: 23,89, Y: 345,405, one pixel: 50 345
Blob 4 of 58, id: 38, sources: 4, size: 80x52, npix 1869, brick X: 271,351, Y: 275,327, one pixel: 310 275
Blob 5 of 58, id: 24, sources: 5, size: 52x71, npix 1696, brick X: 41,93, Y: 171,242, one pixel: 54 171
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.153624 MB
Blob 6 of 58, id: 4, sources: 3, size: 55x49, npix 1433, brick X: 96,151, Y: 27,76, one pixel: 112 27
Blob 5 finished, total: Wall: 3.20 s, CPU: 3.20 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.153624 MB
Blob 7 of 58, id: 5, sources: 4, size: 58x49, npix 1236, brick X: 224,282, Y: 27,76, one pixel: 233 27
Measuring 2 iterative sources
Measuring 2 iterative sources
Blob 4 finished, total: Wall: 5.39 s, CPU: 5.39 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.156132 MB
Blob 8 of 58, id: 44, sources: 2, size: 49x37, npix 991, brick X: 353,402, Y: 321,358, one pixel: 389 321
Blob 3 finished, total: Wall: 6.63 s, CPU: 6.63 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.1519 MB
Blob 9 of 58, id: 7, sources: 2, size: 46x32, npix 878, brick X: 14,60, Y: 57,89, one pixel: 32 57
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 2.76 s, CPU: 2.76 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.153624 MB
Blob 10 of 58, id: 19, sources: 2, size: 41x36, npix 863, brick X: 0,41, Y: 126,162, one pixel: 4 126
Blob 9 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 11 of 58, id: 36, sources: 2, size: 30x44, npix 849, brick X: 182,212, Y: 271,315, one pixel: 191 271
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.31697, ee1=0.290371, ee2=-0.687034
Measuring 1 iterative sources
Blob 7 finished, total: Wall: 4.00 s, CPU: 3.99 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.156132 MB
Blob 12 of 58, id: 10, sources: 3, size: 35x38, npix 824, brick X: 370,405, Y: 68,106, one pixel: 395 68
Blob 8 finished, total: Wall: 2.97 s, CPU: 2.97 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.1519 MB
Blob 13 of 58, id: 53, sources: 1, size: 36x28, npix 761, brick X: 176,212, Y: 377,405, one pixel: 196 377
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 10.55 s, CPU: 10.55 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150072 MB
Blob 14 of 58, id: 14, sources: 1, size: 34x32, npix 697, brick X: 215,249, Y: 92,124, one pixel: 234 92
Blob 11 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.156132 MB
Blob 15 of 58, id: 30, sources: 1, size: 30x34, npix 678, brick X: 369,399, Y: 226,260, one pixel: 381 226
Blob 10 finished, total: Wall: 2.82 s, CPU: 2.82 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 16 of 58, id: 40, sources: 2, size: 26x42, npix 666, brick X: 56,82, Y: 295,337, one pixel: 67 295
Blob 14 finished, total: Wall: 1.80 s, CPU: 1.80 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.156132 MB
Blob 17 of 58, id: 28, sources: 2, size: 27x37, npix 630, brick X: 295,322, Y: 210,247, one pixel: 306 210
Blob 12 finished, total: Wall: 2.78 s, CPU: 2.78 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.1519 MB
Blob 18 of 58, id: 48, sources: 1, size: 30x31, npix 618, brick X: 321,351, Y: 340,371, one pixel: 333 340
Measuring 1 iterative sources
Blob 15 finished, total: Wall: 1.80 s, CPU: 1.80 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 19 of 58, id: 17, sources: 2, size: 24x43, npix 608, brick X: 370,394, Y: 121,164, one pixel: 381 121
Blob 13 finished, total: Wall: 2.96 s, CPU: 2.96 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 20 of 58, id: 3, sources: 1, size: 28x34, npix 603, brick X: 331,359, Y: 25,59, one pixel: 341 25
Blob 16 finished, total: Wall: 1.18 s, CPU: 1.17 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.156132 MB
Blob 21 of 58, id: 54, sources: 1, size: 29x28, npix 575, brick X: 288,317, Y: 377,405, one pixel: 299 377
Blob 18 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 22 of 58, id: 29, sources: 2, size: 42x22, npix 539, brick X: 113,155, Y: 215,237, one pixel: 138 215
Blob 17 finished, total: Wall: 2.19 s, CPU: 2.19 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.1519 MB
Blob 23 of 58, id: 23, sources: 1, size: 28x28, npix 528, brick X: 360,388, Y: 166,194, one pixel: 371 166
Measuring 1 iterative sources
Blob 19 finished, total: Wall: 1.91 s, CPU: 1.91 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 24 of 58, id: 9, sources: 1, size: 27x29, npix 503, brick X: 283,310, Y: 61,90, one pixel: 296 61
Blob 20 finished, total: Wall: 2.18 s, CPU: 2.18 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156196 MB
Blob 25 of 58, id: 16, sources: 1, size: 27x27, npix 473, brick X: 90,117, Y: 121,148, one pixel: 101 121
Blob 21 finished, total: Wall: 1.70 s, CPU: 1.70 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 26 of 58, id: 26, sources: 1, size: 27x26, npix 467, brick X: 111,138, Y: 185,211, one pixel: 122 185
Blob 23 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 27 of 58, id: 21, sources: 2, size: 33x21, npix 399, brick X: 87,120, Y: 146,167, one pixel: 108 146
Blob 22 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.1519 MB
Blob 28 of 58, id: 25, sources: 1, size: 25x25, npix 391, brick X: 273,298, Y: 178,203, one pixel: 284 178
Blob 27 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 29 of 58, id: 35, sources: 2, size: 30x21, npix 375, brick X: 88,118, Y: 264,285, one pixel: 98 264
Blob 26 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 30 of 58, id: 37, sources: 1, size: 24x25, npix 364, brick X: 141,165, Y: 272,297, one pixel: 152 272
Blob 24 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156196 MB
Blob 31 of 58, id: 13, sources: 1, size: 24x25, npix 358, brick X: 12,36, Y: 92,117, one pixel: 23 92
Blob 25 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 32 of 58, id: 45, sources: 1, size: 24x24, npix 351, brick X: 95,119, Y: 324,348, one pixel: 106 324
Blob 28 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 33 of 58, id: 55, sources: 1, size: 22x27, npix 336, brick X: 90,112, Y: 378,405, one pixel: 102 378
Blob 30 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156196 MB
Blob 34 of 58, id: 56, sources: 1, size: 29x16, npix 330, brick X: 250,279, Y: 389,405, one pixel: 263 389
Measuring 1 iterative sources
Blob 31 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 35 of 58, id: 20, sources: 1, size: 23x23, npix 316, brick X: 65,88, Y: 134,157, one pixel: 74 134
Blob 33 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156196 MB
Blob 36 of 58, id: 27, sources: 1, size: 22x23, npix 316, brick X: 16,38, Y: 191,214, one pixel: 25 191
Blob 32 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 37 of 58, id: 6, sources: 1, size: 22x23, npix 314, brick X: 186,208, Y: 41,64, one pixel: 195 41
Blob 29 finished, total: Wall: 1.76 s, CPU: 1.76 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 38 of 58, id: 1, sources: 1, size: 23x22, npix 306, brick X: 233,256, Y: 0,22, one pixel: 242 0
Blob 34 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 39 of 58, id: 34, sources: 1, size: 22x22, npix 301, brick X: 376,398, Y: 261,283, one pixel: 384 261
Blob 36 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 40 of 58, id: 2, sources: 1, size: 22x22, npix 293, brick X: 138,160, Y: 8,30, one pixel: 147 8
Blob 35 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156196 MB
Blob 41 of 58, id: 31, sources: 1, size: 22x23, npix 284, brick X: 42,64, Y: 240,263, one pixel: 53 240
Blob 37 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 42 of 58, id: 41, sources: 1, size: 22x22, npix 280, brick X: 4,26, Y: 297,319, one pixel: 15 297
Blob 39 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 43 of 58, id: 51, sources: 1, size: 21x21, npix 279, brick X: 361,382, Y: 359,380, one pixel: 370 359
Blob 38 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 44 of 58, id: 12, sources: 1, size: 21x21, npix 269, brick X: 81,102, Y: 88,109, one pixel: 90 88
Blob 40 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156196 MB
Blob 45 of 58, id: 50, sources: 1, size: 21x21, npix 268, brick X: 87,108, Y: 357,378, one pixel: 96 357
Blob 43 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 46 of 58, id: 47, sources: 1, size: 21x21, npix 261, brick X: 161,182, Y: 331,352, one pixel: 170 331
Blob 41 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 47 of 58, id: 33, sources: 1, size: 21x21, npix 258, brick X: 128,149, Y: 247,268, one pixel: 137 247
Blob 45 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 48 of 58, id: 42, sources: 1, size: 20x20, npix 229, brick X: 342,362, Y: 314,334, one pixel: 350 314
Blob 42 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 49 of 58, id: 22, sources: 1, size: 19x20, npix 227, brick X: 75,94, Y: 161,181, one pixel: 83 161
Blob 44 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156636 MB
Blob 50 of 58, id: 39, sources: 1, size: 16x21, npix 215, brick X: 389,405, Y: 286,307, one pixel: 399 286
Blob 48 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 51 of 58, id: 8, sources: 1, size: 20x19, npix 209, brick X: 59,79, Y: 61,80, one pixel: 68 61
Blob 46 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 52 of 58, id: 43, sources: 1, size: 19x19, npix 199, brick X: 121,140, Y: 319,338, one pixel: 129 319
Blob 47 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 53 of 58, id: 18, sources: 1, size: 18x19, npix 198, brick X: 312,330, Y: 124,143, one pixel: 320 124
Blob 52 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 54 of 58, id: 57, sources: 1, size: 19x13, npix 184, brick X: 0,19, Y: 392,405, one pixel: 5 392
Blob 55 of 58, id: 32, sources: 1, size: 18x18, npix 171, brick X: 99,117, Y: 240,258, one pixel: 107 240
Blob 53 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.155708 MB
Blob 49 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156644 MB
Blob 56 of 58, id: 46, sources: 1, size: 18x18, npix 171, brick X: 185,203, Y: 324,342, one pixel: 193 324
Blob 51 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Blob 57 of 58, id: 11, sources: 1, size: 17x17, npix 145, brick X: 313,330, Y: 85,102, one pixel: 321 85
Blob 55 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156644 MB
Blob 58 of 58, id: 52, sources: 1, size: 17x17, npix 145, brick X: 117,134, Y: 368,385, one pixel: 125 368
Blob 50 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 58 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 1019 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152004 MB
Blob 57 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 1022 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156644 MB
Blob 54 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 963 MB, VmSize: 727 MB, VmRSS: 153 MB, VmData: 190 MB, maxrss: 0.156488 MB
Blob 56 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 1018 MB, VmSize: 721 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151552 MB
Old catalog: 91
New catalog: 95
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/blobs-custom-031992m30665.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/all-models-custom-031992m30665.fits
Stage fitblobs : Wall: 29.91 s, CPU: 6.79 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 263 MB, VmData: 290 MB, maxrss: 0.454624 MB
Stage fitblobs finished: 2020-06-07T12:25:56.950034
Resources for stage fitblobs : 91.478 s worker CPU, 91.518 s worker Wall, Wall: 29.911 s, Cores in use: 3.29, Total efficiency (on 4 cores): 82.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T12:25:56.951824
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-resid.jpg
Stage coadds : Wall: 9.72 s, CPU: 6.68 s, VmPeak: 1151 MB, VmSize: 1026 MB, VmRSS: 267 MB, VmData: 295 MB, maxrss: 0.454624 MB
Stage coadds finished: 2020-06-07T12:26:06.672707
Resources for stage coadds : 4.065 s worker CPU, 4.185 s worker Wall, Wall: 9.722 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T12:26:06.674786
Cut to 1 unWISE tiles
Reading WISE tile 0313m303 band 1
Reading WISE tile 0313m303 band 2
Reading WISE tile 0313m303 band 3
Reading WISE tile 0313m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.19 s, CPU: 0.35 s, VmPeak: 1018 MB, VmSize: 1002 MB, VmRSS: 150 MB, VmData: 189 MB, maxrss: 0.21244 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.35 s, VmPeak: 1019 MB, VmSize: 1006 MB, VmRSS: 157 MB, VmData: 193 MB, maxrss: 0.219884 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.23 s, CPU: 0.49 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 154 MB, VmData: 189 MB, maxrss: 0.216404 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.32 s, CPU: 1.01 s, VmPeak: 1022 MB, VmSize: 1006 MB, VmRSS: 157 MB, VmData: 193 MB, maxrss: 0.200892 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 12.29 s, CPU: 8.84 s, VmPeak: 1151 MB, VmSize: 1026 MB, VmRSS: 268 MB, VmData: 295 MB, maxrss: 0.454624 MB
Stage wise_forced finished: 2020-06-07T12:26:18.964141
Resources for stage wise_forced : 6.024 s worker CPU, 9.827 s worker Wall, Wall: 12.291 s, Cores in use: 1.21, Total efficiency (on 4 cores): 30.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T12:26:18.966018
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/tractor-i/cus/tractor-custom-031992m30665.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/tractor/cus/tractor-custom-031992m30665.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/tractor/cus/brick-custom-031992m30665.sha256sum
Stage writecat : Wall: 6.40 s, CPU: 6.25 s, VmPeak: 1159 MB, VmSize: 1031 MB, VmRSS: 270 MB, VmData: 295 MB, maxrss: 0.454624 MB
Stage writecat finished: 2020-06-07T12:26:25.361249
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.396 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.4 %
Stage writecat finished
All done: 114.321 s worker CPU, 712.193 s worker Wall, Wall: 305.808 s, Cores in use: 0.61, Total efficiency (on 4 cores): 15.2 %
Finished galaxy PGC714465 in 5.268 minutes.
Started working on galaxy PGC714465 at Mon Aug 10 13:32:58 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 31.992598694367025 -30.66516992021772 --width 405 --height 405 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T13:33:00.172777
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '31.992598694367025', '-30.66516992021772', '--width', '405', '--height', '405', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 31.992598694367025 -30.66516992021772 --width 405 --height 405 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 31.992598694367025 -30.66516992021772
Starting process 16414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05922 MB
Starting process 16415 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 16416 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 16417 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 16418 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 16419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 16420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 16421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 16422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 16423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 16424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 16425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 16426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 16427 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 16428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 16429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T13:33:01.371196
Keeping 19 CCDs:
  c4d_141230_034550_ooi_z_ls9-N5 z expnum 393123 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57021.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_034550_ooi_z_ls9.fits.fz
  c4d_151205_034605_ooi_r_ls9-N5 r expnum 499423 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57361.155 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151204/c4d_151205_034605_ooi_r_ls9.fits.fz
  c4d_161207_051343_ooi_r_ls9-S28 r expnum 600574 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57729.216 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161206/c4d_161207_051343_ooi_r_ls9.fits.fz
  c4d_161023_072150_ooi_z_ls9-S28 z expnum 585344 exptime 90.0 propid 2012B-0001 seeing 1.44 MJD 57684.305 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2a/CP20161022/c4d_161023_072150_ooi_z_ls9.fits.fz
  c4d_161124_054139_ooi_g_ls9-S28 g expnum 595828 exptime 90.0 propid 2012B-0001 seeing 1.85 MJD 57716.236 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161123/c4d_161124_054139_ooi_g_ls9.fits.fz
  c4d_161218_041900_ooi_z_ls9-S28 z expnum 601831 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57740.178 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.8.2/CP20161217/c4d_161218_041900_ooi_z_ls9.fits.fz
  c4d_161123_055050_ooi_g_v1-S28 g expnum 595463 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57715.242 object DES survey hex 321-318 tiling 6 
    decam/CP/V4.1/CP20161123/c4d_161123_055050_ooi_g_v1.fits.fz
  c4d_180203_010051_ooi_r_v1-N13 r expnum 716850 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 58152.042 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010051_ooi_r_v1.fits.fz
  c4d_180203_010250_ooi_g_v1-N13 g expnum 716851 exptime 90.0 propid 2012B-0001 seeing 0.92 MJD 58152.044 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180202/c4d_180203_010250_ooi_g_v1.fits.fz
  c4d_180123_010814_ooi_z_v1-N13 z expnum 714408 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58141.047 object DES survey hex 303-308 tiling 9 
    decam/CP/V4.1/CP20180122/c4d_180123_010814_ooi_z_v1.fits.fz
  c4d_171020_075834_ooi_r_ls9-N26 r expnum 689042 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58046.332 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_075834_ooi_r_ls9.fits.fz
  c4d_171020_080032_ooi_g_ls9-N26 g expnum 689043 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 58046.334 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171019/c4d_171020_080032_ooi_g_ls9.fits.fz
  c4d_171207_050449_ooi_z_ls9-N26 z expnum 702364 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58094.212 object DES survey hex 323-298 tiling 8 
    decam/CP/V4.8.2a/CP20171206/c4d_171207_050449_ooi_z_ls9.fits.fz
  c4d_151024_015535_ooi_z_ls9-S16 z expnum 487065 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57319.079 object DES survey hex 321-318 tiling 4 
    decam/CP/V4.8.2a/CP20151023/c4d_151024_015535_ooi_z_ls9.fits.fz
  c4d_151204_031543_ooi_g_ls9-N29 g expnum 499071 exptime 90.0 propid 2012B-0001 seeing 1.45 MJD 57360.134 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151203/c4d_151204_031543_ooi_g_ls9.fits.fz
  c4d_151118_025337_ooi_r_ls9-N29 r expnum 494335 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57344.119 object DES survey hex 323-298 tiling 1 
    decam/CP/V4.8.2a/CP20151117/c4d_151118_025337_ooi_r_ls9.fits.fz
  c4d_171018_063145_ooi_g_v1-N12 g expnum 688200 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58044.272 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.1/CP20171017/c4d_171018_063145_ooi_g_v1.fits.fz
  c4d_170201_010804_ooi_z_ls9-N12 z expnum 615074 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57785.046 object DES survey hex 303-308 tiling 7 
    decam/CP/V4.8.2/CP20170131/c4d_170201_010804_ooi_z_ls9.fits.fz
  c4d_151214_011553_ooi_g_ls9-N5 g expnum 501642 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57370.051 object DES survey hex 323-298 tiling 3 
    decam/CP/V4.8.2a/CP20151213/c4d_151214_011553_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N13,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N13,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N29,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N13,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[N5,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N29,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0441585 vs median 0.0338479
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N26,noinherit][2046,4094][real]: DES sur
Clipping 1 pixels with anomalously large oow values: max 0.0457409 vs median 0.034218
Zeroing out 0 weight-map pixels below quantization error (= median 5.82e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N12,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[N5,noinherit][2046,4094][real]: DES surv
Zeroing out 0 weight-map pixels below quantization error (= median 0.000266)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N12,noinherit][2046,4094][real]: DE
Stage tims : Wall: 20.69 s, CPU: 1.41 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 205 MB, VmData: 238 MB, maxrss: 0.20954 MB
Stage tims finished: 2020-08-10T13:33:22.060805
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501b6d-g-20161124T053917_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 3.8e-05)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-r-20180203T010051_oi[N13,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151024T015314_oi[S16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 0 weight-map pixels below quantization error (= median 0.000162)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180203T010250_oi[N13,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151205T034344_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[N29,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958c221-z-20141230T034330_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Zeroing out 2 weight-map pixels below quantization error (= median 0.000229)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962e7ae-z-20161023T071927_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151214T011334_oi[N5,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T054833_oi[S28,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171017_8fe5678-g-20171018T063145_oi[N12,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 11.826 s worker CPU, 213.037 s worker Wall, Wall: 20.691 s, Cores in use: 0.64, Total efficiency (on 16 cores): 4.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041640_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T051124_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[N26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180123T010814_oi[N13,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9507c56-z-20170201T010545_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-10T13:33:22.136113
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09291.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09163.fits
Matched 8 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/reference-custom-031992m30665.fits
Stage refs : Wall: 1.56 s, CPU: 1.29 s, VmPeak: 1043 MB, VmSize: 1024 MB, VmRSS: 223 MB, VmData: 256 MB, maxrss: 0.22824 MB
Stage refs finished: 2020-08-10T13:33:23.694026
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.559 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T13:33:23.753876
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outlier-mask-custom-031992m30665.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-pre-custom-031992m30665.jpg
Image c4d_161124_054139_ooi_g_ls9-S28 g : masking 746 positive outlier pixels and 280 negative outlier pixels
Image c4d_161123_055050_ooi_g_v1-S28 g : masking 3588 positive outlier pixels and 0 negative outlier pixels
Image c4d_151204_031543_ooi_g_ls9-N29 g : masking 808 positive outlier pixels and 0 negative outlier pixels
Image c4d_171018_063145_ooi_g_v1-N12 g : masking 878 positive outlier pixels and 234 negative outlier pixels
Image c4d_180203_010250_ooi_g_v1-N13 g : masking 1727 positive outlier pixels and 0 negative outlier pixels
Image c4d_151118_025337_ooi_r_ls9-N29 r : masking 600 positive outlier pixels and 0 negative outlier pixels
Image c4d_180203_010051_ooi_r_v1-N13 r : masking 309 positive outlier pixels and 0 negative outlier pixels
Image c4d_161207_051343_ooi_r_ls9-S28 r : masking 311 positive outlier pixels and 0 negative outlier pixels
Image c4d_171020_075834_ooi_r_ls9-N26 r : masking 491 positive outlier pixels and 0 negative outlier pixels
Image c4d_161023_072150_ooi_z_ls9-S28 z : masking 1609 positive outlier pixels and 0 negative outlier pixels
Image c4d_161218_041900_ooi_z_ls9-S28 z : masking 355 positive outlier pixels and 0 negative outlier pixels
Image c4d_180123_010814_ooi_z_v1-N13 z : masking 432 positive outlier pixels and 0 negative outlier pixels
Image c4d_151024_015535_ooi_z_ls9-S16 z : masking 66 positive outlier pixels and 202 negative outlier pixels
Image c4d_171207_050449_ooi_z_ls9-N26 z : masking 87 positive outlier pixels and 0 negative outlier pixels
Image c4d_170201_010804_ooi_z_ls9-N12 z : masking 79 positive outlier pixels and 350 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outlier-mask-custom-031992m30665.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-post-custom-031992m30665.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-masked-pos-custom-031992m30665.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/outliers-masked-neg-custom-031992m30665.jpg
Stage outliers : Wall: 2.07 s, CPU: 1.54 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 264 MB, VmData: 295 MB, maxrss: 0.279356 MB
Stage outliers finished: 2020-08-10T13:33:25.821705
Resources for stage outliers : 4.406 s worker CPU, 4.406 s worker Wall, Wall: 2.069 s, Cores in use: 2.87, Total efficiency (on 16 cores): 18.0 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T13:33:25.884294
Stage halos : Wall: 0.45 s, CPU: 0.42 s, VmPeak: 1162 MB, VmSize: 1035 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.279356 MB
Stage halos finished: 2020-08-10T13:33:26.333240
Resources for stage halos : 0.310 s worker CPU, 0.614 s worker Wall, Wall: 0.451 s, Cores in use: 1.61, Total efficiency (on 16 cores): 10.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T13:33:26.985101
PSF sigmas in coadd pixels: ['3.00', '2.21', '1.49', '1.51', '2.35', '1.80', '1.83']
Using average PSF sigma 2.0278730761330706
Gaussian PSF norm 0.13910870216384633 vs pixelized 0.10743844
average tim pixel scale / coadd scale: 1.0010329802086904
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.99', '1.76', '1.59', '1.76']
Using average PSF sigma 1.808556899645815
Gaussian PSF norm 0.15597783615717215 vs pixelized 0.15945885
average tim pixel scale / coadd scale: 1.0010606532859552
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.73', '2.33', '1.71', '2.08', '1.55', '1.83', '1.64']
Using average PSF sigma 1.8393698048476212
Gaussian PSF norm 0.15336491391259285 vs pixelized 0.1422683
average tim pixel scale / coadd scale: 1.0010084292075454
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.62 s, CPU: 0.60 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 266 MB, VmData: 296 MB, maxrss: 0.282764 MB
Stage fit_on_coadds finished: 2020-08-10T13:33:27.605355
Resources for stage fit_on_coadds : 1.019 s worker CPU, 1.022 s worker Wall, Wall: 0.622 s, Cores in use: 2.61, Total efficiency (on 16 cores): 16.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T13:33:27.933630
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 57 potential peaks
Of 57 potential peaks: 5 in veto map, 7 cut by saddle test, 0 cut by aper test, 45 kept
SED z : 45 new peaks
Found 64 potential peaks
Of 64 potential peaks: 41 in veto map, 5 cut by saddle test, 0 cut by aper test, 18 kept
SED r : 18 new peaks
Found 45 potential peaks
Of 45 potential peaks: 38 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 91 potential peaks
Of 91 potential peaks: 62 in veto map, 12 cut by saddle test, 0 cut by aper test, 17 kept
SED Flat : 17 new peaks
Found 99 potential peaks
Of 99 potential peaks: 87 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 85 new sources
Median coadd sky for g : -0.00010453985
Median coadd sky for r : -2.4883648e-05
Median coadd sky for z : 8.457147e-05
Stage srcs : Wall: 1.32 s, CPU: 1.22 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 267 MB, VmData: 296 MB, maxrss: 0.282764 MB
Stage srcs finished: 2020-08-10T13:33:29.249394
Resources for stage srcs : 0.199 s worker CPU, 0.199 s worker Wall, Wall: 1.317 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T13:33:29.275050
Blob 1 of 56, id: 14, sources: 4, size: 111x177, npix 9666, brick X: 148,259, Y: 108,285, one pixel: 172 108
Blob 2 of 56, id: 49, sources: 7, size: 88x66, npix 2636, brick X: 23,111, Y: 339,405, one pixel: 48 339
Blob 3 of 56, id: 0, sources: 1, size: 61x42, npix 1899, brick X: 0,61, Y: 0,42, one pixel: 6 0
Blob 4 of 56, id: 38, sources: 4, size: 80x53, npix 1868, brick X: 271,351, Y: 268,321, one pixel: 311 268
Blob 5 of 56, id: 5, sources: 3, size: 55x48, npix 1444, brick X: 96,151, Y: 21,69, one pixel: 111 21
Blob 6 of 56, id: 4, sources: 4, size: 58x49, npix 1233, brick X: 224,282, Y: 20,69, one pixel: 234 20
Blob 7 of 56, id: 7, sources: 3, size: 65x32, npix 1105, brick X: 14,79, Y: 51,83, one pixel: 30 51
Blob 8 of 56, id: 23, sources: 3, size: 35x52, npix 1021, brick X: 40,75, Y: 164,216, one pixel: 55 164
Blob 9 of 56, id: 44, sources: 2, size: 49x37, npix 990, brick X: 353,402, Y: 315,352, one pixel: 388 315
Blob 10 of 56, id: 52, sources: 1, size: 35x35, npix 914, brick X: 176,211, Y: 370,405, one pixel: 197 370
Blob 11 of 56, id: 18, sources: 2, size: 41x36, npix 849, brick X: 0,41, Y: 120,156, one pixel: 3 120
Blob 12 of 56, id: 36, sources: 2, size: 30x43, npix 847, brick X: 182,212, Y: 265,308, one pixel: 191 265
Blob 13 of 56, id: 9, sources: 3, size: 36x39, npix 831, brick X: 369,405, Y: 61,100, one pixel: 395 61
Blob 14 of 56, id: 13, sources: 1, size: 34x31, npix 702, brick X: 215,249, Y: 86,117, one pixel: 233 86
Blob 15 of 56, id: 28, sources: 2, size: 35x32, npix 675, brick X: 58,93, Y: 204,236, one pixel: 79 204
Blob 16 of 56, id: 30, sources: 1, size: 30x34, npix 665, brick X: 369,399, Y: 220,254, one pixel: 381 220
Blob 17 of 56, id: 40, sources: 2, size: 27x43, npix 654, brick X: 55,82, Y: 288,331, one pixel: 68 288
Measuring 2 iterative sources
Blob 16 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145528 MB
Blob 18 of 56, id: 27, sources: 2, size: 27x38, npix 637, brick X: 295,322, Y: 203,241, one pixel: 308 203
Blob 3 finished, total: Wall: 1.25 s, CPU: 1.24 s, VmPeak: 952 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14812 MB
Measuring 1 iterative sources
Blob 19 of 56, id: 48, sources: 1, size: 30x31, npix 619, brick X: 321,351, Y: 333,364, one pixel: 334 333
Blob 15 finished, total: Wall: 1.78 s, CPU: 1.78 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 20 of 56, id: 3, sources: 1, size: 27x35, npix 609, brick X: 331,358, Y: 18,53, one pixel: 341 18
Blob 14 finished, total: Wall: 1.87 s, CPU: 1.87 s, VmPeak: 963 MB, VmSize: 731 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153232 MB
Blob 21 of 56, id: 16, sources: 2, size: 24x43, npix 599, brick X: 370,394, Y: 115,158, one pixel: 380 115
Measuring 1 iterative sources
Blob 12 finished, total: Wall: 2.09 s, CPU: 2.09 s, VmPeak: 1012 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146156 MB
Blob 22 of 56, id: 53, sources: 1, size: 30x30, npix 587, brick X: 287,317, Y: 370,400, one pixel: 299 370
Blob 17 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145528 MB
Blob 23 of 56, id: 54, sources: 1, size: 35x22, npix 580, brick X: 247,282, Y: 383,405, one pixel: 261 383
Blob 13 finished, total: Wall: 2.21 s, CPU: 2.20 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147224 MB
Blob 24 of 56, id: 22, sources: 1, size: 28x29, npix 541, brick X: 360,388, Y: 159,188, one pixel: 372 159
Blob 8 finished, total: Wall: 2.32 s, CPU: 2.32 s, VmPeak: 952 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145704 MB
Blob 25 of 56, id: 29, sources: 2, size: 41x22, npix 536, brick X: 113,154, Y: 208,230, one pixel: 138 208
Blob 9 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147768 MB
Blob 26 of 56, id: 8, sources: 1, size: 27x28, npix 492, brick X: 283,310, Y: 55,83, one pixel: 295 55
Blob 7 finished, total: Wall: 2.53 s, CPU: 2.53 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148516 MB
Blob 27 of 56, id: 15, sources: 1, size: 27x27, npix 489, brick X: 90,117, Y: 114,141, one pixel: 102 114
Blob 11 finished, total: Wall: 2.66 s, CPU: 2.66 s, VmPeak: 961 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14904 MB
Blob 28 of 56, id: 25, sources: 1, size: 27x27, npix 465, brick X: 110,137, Y: 178,205, one pixel: 124 178
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 2.82 s, CPU: 2.82 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148172 MB
Blob 29 of 56, id: 20, sources: 2, size: 32x22, npix 392, brick X: 87,119, Y: 139,161, one pixel: 109 139
Blob 5 finished, total: Wall: 2.93 s, CPU: 2.93 s, VmPeak: 1016 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149104 MB
Blob 30 of 56, id: 24, sources: 1, size: 25x25, npix 380, brick X: 273,298, Y: 172,197, one pixel: 283 172
Blob 19 finished, total: Wall: 1.26 s, CPU: 1.25 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 31 of 56, id: 55, sources: 1, size: 23x20, npix 369, brick X: 0,23, Y: 385,405, one pixel: 5 385
Measuring 1 iterative sources
Blob 24 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 952 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145704 MB
Blob 32 of 56, id: 12, sources: 1, size: 24x25, npix 357, brick X: 11,35, Y: 86,111, one pixel: 22 86
Blob 6 finished, total: Wall: 3.38 s, CPU: 3.38 s, VmPeak: 1011 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 33 of 56, id: 37, sources: 1, size: 24x24, npix 354, brick X: 141,165, Y: 266,290, one pixel: 151 266
Blob 20 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 963 MB, VmSize: 731 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153232 MB
Blob 34 of 56, id: 35, sources: 2, size: 30x20, npix 347, brick X: 88,118, Y: 258,278, one pixel: 97 258
Blob 29 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 1016 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149104 MB
Blob 35 of 56, id: 45, sources: 1, size: 24x23, npix 331, brick X: 95,119, Y: 318,341, one pixel: 105 318
Blob 18 finished, total: Wall: 2.38 s, CPU: 2.38 s, VmPeak: 952 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148492 MB
Blob 36 of 56, id: 6, sources: 1, size: 22x23, npix 323, brick X: 186,208, Y: 34,57, one pixel: 196 34
Blob 22 finished, total: Wall: 1.60 s, CPU: 1.60 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147392 MB
Blob 37 of 56, id: 26, sources: 1, size: 23x23, npix 317, brick X: 15,38, Y: 185,208, one pixel: 25 185
Blob 28 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148612 MB
Blob 38 of 56, id: 19, sources: 1, size: 22x23, npix 306, brick X: 65,87, Y: 127,150, one pixel: 74 127
Blob 21 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 1012 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146156 MB
Blob 39 of 56, id: 2, sources: 1, size: 22x23, npix 304, brick X: 138,160, Y: 1,24, one pixel: 147 1
Blob 30 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 40 of 56, id: 32, sources: 1, size: 22x22, npix 294, brick X: 42,64, Y: 234,256, one pixel: 52 234
Blob 27 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 961 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14904 MB
Blob 41 of 56, id: 34, sources: 1, size: 22x22, npix 293, brick X: 376,398, Y: 254,276, one pixel: 385 254
Blob 26 finished, total: Wall: 1.59 s, CPU: 1.59 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148516 MB
Blob 42 of 56, id: 51, sources: 1, size: 22x21, npix 281, brick X: 360,382, Y: 353,374, one pixel: 369 353
Blob 25 finished, total: Wall: 1.95 s, CPU: 1.95 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147768 MB
Blob 33 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 963 MB, VmSize: 731 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153232 MB
Blob 43 of 56, id: 41, sources: 1, size: 22x21, npix 270, brick X: 4,26, Y: 291,312, one pixel: 14 291
Blob 44 of 56, id: 47, sources: 1, size: 21x21, npix 269, brick X: 161,182, Y: 325,346, one pixel: 169 325
Blob 32 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 1011 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 45 of 56, id: 50, sources: 1, size: 20x22, npix 267, brick X: 87,107, Y: 350,372, one pixel: 96 350
Blob 23 finished, total: Wall: 2.23 s, CPU: 2.23 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147528 MB
Blob 46 of 56, id: 11, sources: 1, size: 21x21, npix 260, brick X: 81,102, Y: 82,103, one pixel: 89 82
Blob 41 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148516 MB
Blob 47 of 56, id: 33, sources: 1, size: 21x21, npix 259, brick X: 128,149, Y: 240,261, one pixel: 138 240
Blob 35 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 952 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148492 MB
Blob 48 of 56, id: 21, sources: 1, size: 20x20, npix 228, brick X: 74,94, Y: 155,175, one pixel: 82 155
Measuring 2 iterative sources
Blob 37 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 951 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148612 MB
Blob 49 of 56, id: 42, sources: 1, size: 20x19, npix 218, brick X: 341,361, Y: 308,327, one pixel: 350 308
Blob 36 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147392 MB
Blob 50 of 56, id: 39, sources: 1, size: 16x22, npix 212, brick X: 389,405, Y: 279,301, one pixel: 399 279
Blob 43 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 963 MB, VmSize: 731 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153232 MB
Blob 51 of 56, id: 1, sources: 1, size: 21x16, npix 205, brick X: 234,255, Y: 0,16, one pixel: 239 0
Blob 42 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147768 MB
Blob 45 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147528 MB
Blob 52 of 56, id: 43, sources: 1, size: 19x18, npix 189, brick X: 121,140, Y: 313,331, one pixel: 129 313
Blob 53 of 56, id: 17, sources: 1, size: 18x18, npix 180, brick X: 312,330, Y: 118,136, one pixel: 320 118
Blob 39 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 54 of 56, id: 31, sources: 1, size: 18x18, npix 180, brick X: 99,117, Y: 233,251, one pixel: 107 233
Blob 52 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147528 MB
Blob 55 of 56, id: 46, sources: 1, size: 17x18, npix 162, brick X: 185,202, Y: 318,336, one pixel: 193 318
Blob 38 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 1012 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146156 MB
Blob 56 of 56, id: 10, sources: 1, size: 17x17, npix 145, brick X: 313,330, Y: 79,96, one pixel: 321 79
Blob 40 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 961 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14904 MB
Blob 53 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 31 finished, total: Wall: 1.67 s, CPU: 1.67 s, VmPeak: 952 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147828 MB
Blob 49 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 953 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147392 MB
Blob 55 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 1012 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146156 MB
Blob 4 finished, total: Wall: 5.24 s, CPU: 5.24 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147744 MB
Blob 54 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147528 MB
Blob 56 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 961 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14904 MB
Blob 44 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 1011 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147776 MB
Blob 46 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 1013 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148516 MB
Blob 47 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 952 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148492 MB
Blob 48 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 951 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148612 MB
Measuring 3 iterative sources
Blob 51 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147768 MB
Blob 50 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 963 MB, VmSize: 731 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153232 MB
Blob 34 finished, total: Wall: 1.91 s, CPU: 1.91 s, VmPeak: 1016 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149104 MB
Blob 2 finished, total: Wall: 6.58 s, CPU: 6.57 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148696 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.1616, ee1=0.281525, ee2=-0.656848
Blob 1 finished, total: Wall: 7.34 s, CPU: 7.34 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149716 MB
Old catalog: 90
New catalog: 96
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/blobs-custom-031992m30665.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/metrics/cus/all-models-custom-031992m30665.fits
Stage fitblobs : Wall: 8.54 s, CPU: 1.05 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 267 MB, VmData: 296 MB, maxrss: 0.282764 MB
Stage fitblobs finished: 2020-08-10T13:33:37.815163
Resources for stage fitblobs : 87.497 s worker CPU, 87.729 s worker Wall, Wall: 8.542 s, Cores in use: 10.37, Total efficiency (on 16 cores): 64.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T13:33:37.834191
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-resid.jpg
Stage coadds : Wall: 2.78 s, CPU: 0.74 s, VmPeak: 1163 MB, VmSize: 1037 MB, VmRSS: 269 MB, VmData: 298 MB, maxrss: 0.282764 MB
Stage coadds finished: 2020-08-10T13:33:40.615922
Resources for stage coadds : 19.249 s worker CPU, 26.312 s worker Wall, Wall: 2.783 s, Cores in use: 7.18, Total efficiency (on 16 cores): 44.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T13:33:40.638915
Cut to 1 unWISE tiles
Reading WISE tile 0313m303 band 2
Reading WISE tile 0313m303 band 1
Reading WISE tile 0313m303 band 4
Reading WISE tile 0313m303 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.26 s, CPU: 0.76 s, VmPeak: 1016 MB, VmSize: 1012 MB, VmRSS: 151 MB, VmData: 191 MB, maxrss: 0.192228 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.16 s, CPU: 0.38 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.212192 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.31 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.20832 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/031/0313m303/unwise-0313m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.32 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 146 MB, VmData: 186 MB, maxrss: 0.208756 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/tmp-legacysurvey-custom-031992m30665-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.34 s, CPU: 0.61 s, VmPeak: 1163 MB, VmSize: 1037 MB, VmRSS: 269 MB, VmData: 298 MB, maxrss: 0.282764 MB
Stage wise_forced finished: 2020-08-10T13:33:44.976594
Resources for stage wise_forced : 5.017 s worker CPU, 4.755 s worker Wall, Wall: 4.339 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T13:33:45.005037
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/coadd/cus/custom-031992m30665/legacysurvey-custom-031992m30665-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/tractor-i/cus/tractor-custom-031992m30665.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/tractor/cus/tractor-custom-031992m30665.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/tractor/cus/brick-custom-031992m30665.sha256sum
Stage writecat : Wall: 2.97 s, CPU: 2.27 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 271 MB, VmData: 298 MB, maxrss: 0.408608 MB
Stage writecat finished: 2020-08-10T13:33:47.979685
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.976 s, Cores in use: 0.76, Total efficiency (on 16 cores): 4.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/031/PGC714465/PGC714465-largegalaxy-writecat.p
All done: 129.524 s worker CPU, 338.079 s worker Wall, Wall: 46.640 s, Cores in use: 3.02, Total efficiency (on 16 cores): 18.9 %
Finished galaxy PGC714465 in 0.831 minutes.