Started working on galaxy PGC070621 at Thu Jun  4 06:28:41 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.639208 8.1406111 --width 259 --height 259 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T06:28:43.478886
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.639208', '8.1406111', '--width', '259', '--height', '259', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.639208 8.1406111 --width 259 --height 259 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.639208 8.1406111
Starting process 54898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 54899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 54900 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 54901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 54902 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB
Starting process 54903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Starting process 54904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Starting process 54905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T06:28:47.901389
Keeping 13 CCDs:
   c4d_170721_064110_ooi_g_ls9.fits.fz c4d_170721_064110_ooi_g_ls9-S27 g exptime 116.0 propid 2014B-0404 seeing 1.29 MJD 57955.277 object DECaLS_39664_g
   c4d_140815_080641_ooi_z_ls9.fits.fz c4d_140815_080641_ooi_z_ls9-S27 z exptime 145.0 propid 2014B-0404 seeing 0.97 MJD 56884.336 object DECaLS_39664_z
   c4d_170721_063843_ooi_r_ls9.fits.fz c4d_170721_063843_ooi_r_ls9-S27 r exptime 74.0 propid 2014B-0404 seeing 1.09 MJD 57955.275 object DECaLS_39664_r
   c4d_170821_050553_ooi_g_ls9.fits.fz c4d_170821_050553_ooi_g_ls9-S28 g exptime 199.0 propid 2014B-0404 seeing 1.60 MJD 57986.212 object DECaLS_23792_g
   c4d_170801_034558_ooi_z_ls9.fits.fz c4d_170801_034558_ooi_z_ls9-S28 z exptime 106.0 propid 2014B-0404 seeing 1.80 MJD 57966.155 object DECaLS_23792_z
   c4d_180915_030915_ooi_z_ls9.fits.fz c4d_180915_030915_ooi_z_ls9-S28 z exptime 86.0 propid 2014B-0404 seeing 1.65 MJD 58376.131 object DECaLS_23792_z
   c4d_170916_044446_ooi_r_ls9.fits.fz c4d_170916_044446_ooi_r_ls9-S28 r exptime 72.0 propid 2014B-0404 seeing 1.24 MJD 58012.198 object DECaLS_23792_r
   c4d_160813_054906_ooi_z_ls9.fits.fz c4d_160813_054906_ooi_z_ls9-N20 z exptime 87.0 propid 2014B-0404 seeing 1.00 MJD 57613.241 object DECaLS_23776_z
   c4d_180902_031331_ooi_r_ls9.fits.fz c4d_180902_031331_ooi_r_ls9-N20 r exptime 55.0 propid 2014B-0404 seeing 1.79 MJD 58363.134 object DECaLS_23776_r
   c4d_170916_032211_ooi_g_ls9.fits.fz c4d_170916_032211_ooi_g_ls9-N20 g exptime 122.0 propid 2014B-0404 seeing 1.55 MJD 58012.140 object DECaLS_23776_g
   c4d_151029_011146_ooi_z_ls9.fits.fz c4d_151029_011146_ooi_z_ls9-N21 z exptime 127.0 propid 2014B-0404 seeing 1.10 MJD 57324.048 object DECaLS_7904_z
   c4d_170726_061538_ooi_r_ls9.fits.fz c4d_170726_061538_ooi_r_ls9-N21 r exptime 40.0 propid 2014B-0404 seeing 1.10 MJD 57960.260 object DECaLS_7904_r
   c4d_170917_035319_ooi_g_ls9.fits.fz c4d_170917_035319_ooi_g_ls9-N21 g exptime 97.0 propid 2014B-0404 seeing 1.05 MJD 58013.162 object DECaLS_7904_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054649_oi[N20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[S28,noinherit][2046,4094][real]: DECaLS_
Swapping in SKY_JOHN values for 1 splinesky cells; 2419.88 -> 2418.3562
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170916T032211_oi[N20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031331_oi[N20,noinherit][2046,4094][real]: DECaLS_2377
WARNING: image median 0.005422826 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151029T010849_oi[N21,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.010750409 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520746-r-20170726T061406_oi[N21,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.0049988804 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523bc7-g-20170917T035319_oi[N21,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 35.08 s, CPU: 4.35 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.451352 MB
Stage tims finished: 2020-06-04T06:29:22.980163
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952e102-z-20180915T030915_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: image median 0.010427255 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951cf8e-r-20170721T063637_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: image median 0.01967543 is more than 1 sigma away from zero!
WARNING: image median 0.010325996 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951a9b6-z-20170801T034320_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T080321_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180902T031331_oi[N20,noinherit][2046,4094][real]: DECaLS_2377 [astropy.io.fits.card]
WARNING: image median 0.005211766 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T054649_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170916T032211_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: image median 0.011102436 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9522dd2-r-20170916T044446_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520746-r-20170726T061406_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: image median 0.005381529 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T050553_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523bc7-g-20170917T035319_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 6.749 s worker CPU, 198.512 s worker Wall, Wall: 35.080 s, Cores in use: 0.32, Total efficiency (on 8 cores): 4.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T063822_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151029T010849_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-04T06:29:23.013225
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05435.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05308.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05307.fits
Matched 12 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/reference-custom-347639p08140.fits
Stage refs : Wall: 4.79 s, CPU: 3.87 s, VmPeak: 1027 MB, VmSize: 1013 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.451352 MB
Stage refs finished: 2020-06-04T06:29:27.806879
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.795 s, Cores in use: 0.81, Total efficiency (on 8 cores): 10.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T06:29:27.808840
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/outlier-mask-custom-347639p08140.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/outliers-pre-custom-347639p08140.jpg
Image c4d_170721_064110_ooi_g_ls9-S27 g : masking 421 positive outlier pixels and 0 negative outlier pixels
Image c4d_170821_050553_ooi_g_ls9-S28 g : masking 229 positive outlier pixels and 0 negative outlier pixels
Image c4d_170917_035319_ooi_g_ls9-N21 g : masking 332 positive outlier pixels and 0 negative outlier pixels
Image c4d_170916_044446_ooi_r_ls9-S28 r : masking 329 positive outlier pixels and 0 negative outlier pixels
Image c4d_170721_063843_ooi_r_ls9-S27 r : masking 441 positive outlier pixels and 0 negative outlier pixels
Image c4d_170726_061538_ooi_r_ls9-N21 r : masking 752 positive outlier pixels and 0 negative outlier pixels
Image c4d_170801_034558_ooi_z_ls9-S28 z : masking 0 positive outlier pixels and 176 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/outlier-mask-custom-347639p08140.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/outliers-post-custom-347639p08140.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/outliers-masked-pos-custom-347639p08140.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/outliers-masked-neg-custom-347639p08140.jpg
Stage outliers : Wall: 3.22 s, CPU: 2.91 s, VmPeak: 1027 MB, VmSize: 1022 MB, VmRSS: 213 MB, VmData: 244 MB, maxrss: 0.451352 MB
Stage outliers finished: 2020-06-04T06:29:31.027261
Resources for stage outliers : 1.419 s worker CPU, 1.421 s worker Wall, Wall: 3.220 s, Cores in use: 1.35, Total efficiency (on 8 cores): 16.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T06:29:31.029645
Stage halos : Wall: 2.38 s, CPU: 2.38 s, VmPeak: 1027 MB, VmSize: 1022 MB, VmRSS: 213 MB, VmData: 244 MB, maxrss: 0.451352 MB
Stage halos finished: 2020-06-04T06:29:33.409173
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.381 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T06:29:33.411745
PSF sigmas in coadd pixels: ['2.09', '2.60', '2.52', '1.70']
Using average PSF sigma 2.225404063002805
Gaussian PSF norm 0.12676115608112945 vs pixelized 0.10163481
average tim pixel scale / coadd scale: 1.0011515755407185
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.77', '2.01', '2.91', '1.79']
Using average PSF sigma 2.122331815429887
Gaussian PSF norm 0.13291738347556115 vs pixelized 0.10949473
average tim pixel scale / coadd scale: 1.001199363585995
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.57', '2.92', '2.69', '1.62', '1.79']
Using average PSF sigma 2.1182703797382247
Gaussian PSF norm 0.1331722307370126 vs pixelized 0.110716976
average tim pixel scale / coadd scale: 1.0011657070055717
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 1027 MB, VmSize: 1022 MB, VmRSS: 215 MB, VmData: 245 MB, maxrss: 0.451352 MB
Stage fit_on_coadds finished: 2020-06-04T06:29:33.673490
Resources for stage fit_on_coadds : 0.321 s worker CPU, 0.327 s worker Wall, Wall: 0.263 s, Cores in use: 2.16, Total efficiency (on 8 cores): 27.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T06:29:33.677203
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 229 potential peaks
Of 229 potential peaks: 206 in veto map, 10 cut by saddle test, 0 cut by aper test, 13 kept
SED z : 13 new peaks
Found 222 potential peaks
Of 222 potential peaks: 208 in veto map, 11 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 211 potential peaks
Of 211 potential peaks: 200 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 193 potential peaks
Of 193 potential peaks: 179 in veto map, 13 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 194 potential peaks
Of 194 potential peaks: 181 in veto map, 13 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 17 new sources
Median coadd sky for g : 0.0006305953
Median coadd sky for r : 0.0013685278
Median coadd sky for z : 0.002405078
Stage srcs : Wall: 3.68 s, CPU: 3.64 s, VmPeak: 1027 MB, VmSize: 1022 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.451352 MB
Stage srcs finished: 2020-06-04T06:29:37.359602
Resources for stage srcs : 0.102 s worker CPU, 0.102 s worker Wall, Wall: 3.684 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/PGC070621-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T06:29:37.372225
Blob 1 of 1, id: 0, sources: 19, size: 259x259, npix 65481, brick X: 0,259, Y: 0,259, one pixel: 12 0
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.06424, ee1=-0.046756, ee2=0.0522867
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (347.65126, 8.14163), pm (1.0, -0.4), parallax 0.392 with NanoMaggies: g=19.6, r=18.8, z=18.5
Reset brightness to NanoMaggies: g=19.6, r=18.8, z=18.5
Measuring 37 iterative sources
Blob 1 finished, total: Wall: 59.39 s, CPU: 59.39 s, VmPeak: 956 MB, VmSize: 754 MB, VmRSS: 189 MB, VmData: 217 MB, maxrss: 0.201312 MB
Old catalog: 19
New catalog: 53
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/blobs-custom-347639p08140.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/metrics/cus/all-models-custom-347639p08140.fits
Stage fitblobs : Wall: 62.00 s, CPU: 2.57 s, VmPeak: 1027 MB, VmSize: 1019 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.451352 MB
Stage fitblobs finished: 2020-06-04T06:30:39.374985
Resources for stage fitblobs : 59.429 s worker CPU, 59.441 s worker Wall, Wall: 62.004 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T06:30:39.378799
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/tmp-legacysurvey-custom-347639p08140-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/tmp-legacysurvey-custom-347639p08140-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/tmp-legacysurvey-custom-347639p08140-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/tmp-legacysurvey-custom-347639p08140-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-resid.jpg
Stage coadds : Wall: 3.41 s, CPU: 2.57 s, VmPeak: 1027 MB, VmSize: 1019 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.451352 MB
Stage coadds finished: 2020-06-04T06:30:42.791911
Resources for stage coadds : 4.851 s worker CPU, 5.030 s worker Wall, Wall: 3.414 s, Cores in use: 2.17, Total efficiency (on 8 cores): 27.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T06:30:42.793832
Cut to 1 unWISE tiles
Reading WISE tile 3477p075 band 2
Reading WISE tile 3477p075 band 1
Reading WISE tile 3477p075 band 3
Reading WISE tile 3477p075 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 954 MB, VmSize: 788 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205048 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 959 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.183808 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 947 MB, VmSize: 787 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.199588 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3477p075/unwise-3477p075-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 950 MB, VmSize: 791 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.208948 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/tmp-legacysurvey-custom-347639p08140-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/tmp-legacysurvey-custom-347639p08140-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.42 s, CPU: 2.01 s, VmPeak: 1027 MB, VmSize: 1019 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.451352 MB
Stage wise_forced finished: 2020-06-04T06:30:46.209202
Resources for stage wise_forced : 3.664 s worker CPU, 4.710 s worker Wall, Wall: 3.417 s, Cores in use: 1.66, Total efficiency (on 8 cores): 20.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T06:30:46.211335
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/coadd/cus/custom-347639p08140/legacysurvey-custom-347639p08140-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/tractor-i/cus/tractor-custom-347639p08140.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/tractor/cus/tractor-custom-347639p08140.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC070621/tractor/cus/brick-custom-347639p08140.sha256sum
Stage writecat : Wall: 1.90 s, CPU: 1.62 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 218 MB, VmData: 242 MB, maxrss: 0.451352 MB
Stage writecat finished: 2020-06-04T06:30:48.108631
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.898 s, Cores in use: 0.86, Total efficiency (on 8 cores): 10.7 %
Stage writecat finished
All done: 76.538 s worker CPU, 269.546 s worker Wall, Wall: 120.213 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.7 %
Finished galaxy PGC070621 in 2.119 minutes.