Started working on galaxy PGC1993450 at Thu Jun  4 04:37:32 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.558577 32.3626302 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T04:37:33.819288
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.558577', '32.3626302', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.558577 32.3626302 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.558577 32.3626302
Starting process 13393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 13394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 13395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 13396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 13397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 13398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 13399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 13400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T04:37:36.621081
Keeping 9 CCDs:
   c4d_181002_060244_ooi_z_ls9.fits.fz c4d_181002_060244_ooi_z_ls9-N19 z exptime 106.0 propid 2014B-0404 seeing 1.09 MJD 58393.252 object DECaLS_20806_z
   c4d_181105_043024_ooi_z_ls9.fits.fz c4d_181105_043024_ooi_z_ls9-N23 z exptime 106.0 propid 2014B-0404 seeing 0.89 MJD 58427.188 object DECaLS_36678_z
   c4d_181110_030217_ooi_g_ls9.fits.fz c4d_181110_030217_ooi_g_ls9-N23 g exptime 200.0 propid 2014B-0404 seeing 2.02 MJD 58432.127 object DECaLS_36678_g
   c4d_181104_041447_ooi_r_ls9.fits.fz c4d_181104_041447_ooi_r_ls9-N23 r exptime 90.0 propid 2014B-0404 seeing 1.24 MJD 58426.177 object DECaLS_36678_r
   c4d_181110_030606_ooi_r_ls9.fits.fz c4d_181110_030606_ooi_r_ls9-N14 r exptime 78.0 propid 2014B-0404 seeing 1.68 MJD 58432.129 object DECaLS_4955_r
   c4d_181002_060032_ooi_z_ls9.fits.fz c4d_181002_060032_ooi_z_ls9-N14 z exptime 96.0 propid 2014B-0404 seeing 1.21 MJD 58393.250 object DECaLS_4955_z
   c4d_181103_041850_ooi_g_ls9.fits.fz c4d_181103_041850_ooi_g_ls9-N14 g exptime 184.0 propid 2014B-0404 seeing 1.52 MJD 58425.180 object DECaLS_4955_g
   c4d_181110_030041_ooi_r_ls9.fits.fz c4d_181110_030041_ooi_r_ls9-N19 r exptime 67.0 propid 2014B-0404 seeing 1.90 MJD 58432.125 object DECaLS_20806_r
   c4d_181104_041106_ooi_g_ls9.fits.fz c4d_181104_041106_ooi_g_ls9-N19 g exptime 193.0 propid 2014B-0404 seeing 1.50 MJD 58426.174 object DECaLS_20806_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030606_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060032_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T041850_oi[N14,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030041_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181105T043024_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060244_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T041447_oi[N23,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T041106_oi[N19,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T030217_oi[N23,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 82.94 s, CPU: 5.82 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.451424 MB
Stage tims finished: 2020-06-04T04:38:59.561752
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060032_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030041_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181105T043024_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T041447_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T041850_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9538e4d-g-20181110T030217_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T060244_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.282 s worker CPU, 252.384 s worker Wall, Wall: 82.942 s, Cores in use: 0.13, Total efficiency (on 8 cores): 1.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953829b-r-20181110T030606_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181104T041106_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-04T04:38:59.695980
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02762.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02891.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02890.fits
Matched 12 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/reference-custom-029558p32362.fits
Stage refs : Wall: 3.82 s, CPU: 2.97 s, VmPeak: 1027 MB, VmSize: 1021 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.451424 MB
Stage refs finished: 2020-06-04T04:39:03.518514
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.824 s, Cores in use: 0.78, Total efficiency (on 8 cores): 9.7 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T04:39:03.520280
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/outlier-mask-custom-029558p32362.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/outliers-pre-custom-029558p32362.jpg
Image c4d_181110_030217_ooi_g_ls9-N23 g : masking 758 positive outlier pixels and 0 negative outlier pixels
Image c4d_181104_041106_ooi_g_ls9-N19 g : masking 276 positive outlier pixels and 0 negative outlier pixels
Image c4d_181110_030606_ooi_r_ls9-N14 r : masking 71 positive outlier pixels and 0 negative outlier pixels
Image c4d_181110_030041_ooi_r_ls9-N19 r : masking 110 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/outlier-mask-custom-029558p32362.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/outliers-post-custom-029558p32362.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/outliers-masked-pos-custom-029558p32362.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/outliers-masked-neg-custom-029558p32362.jpg
Stage outliers : Wall: 1.60 s, CPU: 1.36 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 216 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage outliers finished: 2020-06-04T04:39:05.121446
Resources for stage outliers : 0.773 s worker CPU, 0.778 s worker Wall, Wall: 1.603 s, Cores in use: 1.33, Total efficiency (on 8 cores): 16.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T04:39:05.123695
Stage halos : Wall: 1.87 s, CPU: 0.74 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 216 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage halos finished: 2020-06-04T04:39:06.997035
Resources for stage halos : 0.105 s worker CPU, 2.696 s worker Wall, Wall: 1.875 s, Cores in use: 0.45, Total efficiency (on 8 cores): 5.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T04:39:06.999268
PSF sigmas in coadd pixels: ['3.28', '2.47', '2.43']
Using average PSF sigma 2.7274582920007244
Gaussian PSF norm 0.10342771972030701 vs pixelized 0.09483215
average tim pixel scale / coadd scale: 1.0014515754923168
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.02', '2.73', '3.08']
Using average PSF sigma 2.609764038548642
Gaussian PSF norm 0.10809206794448684 vs pixelized 0.096776895
average tim pixel scale / coadd scale: 1.0014619062412957
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.77', '1.44', '1.96']
Using average PSF sigma 1.7246105222144488
Gaussian PSF norm 0.16357014418053095 vs pixelized 0.14038661
average tim pixel scale / coadd scale: 1.0014528418421915
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.14 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage fit_on_coadds finished: 2020-06-04T04:39:07.159597
Resources for stage fit_on_coadds : 0.184 s worker CPU, 0.184 s worker Wall, Wall: 0.161 s, Cores in use: 2.04, Total efficiency (on 8 cores): 25.4 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T04:39:07.162323
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 21 kept
SED z : 21 new peaks
Found 19 potential peaks
Of 19 potential peaks: 19 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 21 potential peaks
Of 21 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 30 potential peaks
Of 30 potential peaks: 23 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 32 potential peaks
Of 32 potential peaks: 28 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 26 new sources
Median coadd sky for g : -3.8689486e-05
Median coadd sky for r : -9.828987e-05
Median coadd sky for z : -0.00011024335
Stage srcs : Wall: 0.94 s, CPU: 0.90 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage srcs finished: 2020-06-04T04:39:08.101162
Resources for stage srcs : 0.089 s worker CPU, 0.089 s worker Wall, Wall: 0.940 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/PGC1993450-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T04:39:08.113084
Blob 1 of 20, id: 6, sources: 5, size: 118x141, npix 6821, brick X: 56,174, Y: 50,191, one pixel: 66 50
Blob 2 of 20, id: 0, sources: 3, size: 52x75, npix 2505, brick X: 162,214, Y: 0,75, one pixel: 175 0
Blob 3 of 20, id: 19, sources: 1, size: 52x38, npix 1224, brick X: 64,116, Y: 219,257, one pixel: 107 219
Blob 4 of 20, id: 13, sources: 1, size: 42x37, npix 1115, brick X: 77,119, Y: 180,217, one pixel: 97 180
Blob 5 of 20, id: 8, sources: 2, size: 44x41, npix 1078, brick X: 171,215, Y: 127,168, one pixel: 188 127
Blob 6 of 20, id: 14, sources: 1, size: 36x38, npix 852, brick X: 200,236, Y: 181,219, one pixel: 215 181
Blob 7 of 20, id: 18, sources: 2, size: 29x42, npix 791, brick X: 13,42, Y: 215,257, one pixel: 27 215
Blob 8 of 20, id: 17, sources: 1, size: 31x30, npix 616, brick X: 116,147, Y: 195,225, one pixel: 130 195
Blob 9 of 20, id: 3, sources: 2, size: 31x29, npix 490, brick X: 117,148, Y: 20,49, one pixel: 137 20
Blob 4 finished, total: Wall: 1.51 s, CPU: 1.51 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147564 MB
Blob 10 of 20, id: 4, sources: 1, size: 27x27, npix 483, brick X: 225,252, Y: 42,69, one pixel: 237 42
Blob 7 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14624 MB
Blob 11 of 20, id: 2, sources: 1, size: 19x33, npix 453, brick X: 0,19, Y: 19,52, one pixel: 4 19
Blob 6 finished, total: Wall: 1.71 s, CPU: 1.71 s, VmPeak: 952 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.14268 MB
Blob 12 of 20, id: 5, sources: 1, size: 26x27, npix 431, brick X: 21,47, Y: 44,71, one pixel: 32 44
Blob 5 finished, total: Wall: 2.46 s, CPU: 2.46 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14562 MB
Blob 13 of 20, id: 11, sources: 1, size: 26x26, npix 416, brick X: 73,99, Y: 153,179, one pixel: 85 153
Blob 8 finished, total: Wall: 2.52 s, CPU: 2.51 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14748 MB
Blob 10 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14624 MB
Blob 14 of 20, id: 9, sources: 1, size: 24x24, npix 366, brick X: 38,62, Y: 143,167, one pixel: 48 143
Blob 15 of 20, id: 10, sources: 1, size: 25x23, npix 353, brick X: 221,246, Y: 147,170, one pixel: 232 147
Blob 9 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147744 MB
Blob 16 of 20, id: 1, sources: 1, size: 24x20, npix 329, brick X: 205,229, Y: 0,20, one pixel: 212 0
Measuring 2 iterative sources
Blob 14 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.1479 MB
Blob 17 of 20, id: 15, sources: 1, size: 23x23, npix 327, brick X: 14,37, Y: 183,206, one pixel: 23 183
Blob 15 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147744 MB
Blob 18 of 20, id: 7, sources: 1, size: 17x27, npix 323, brick X: 240,257, Y: 64,91, one pixel: 250 64
Blob 3 finished, total: Wall: 3.08 s, CPU: 3.08 s, VmPeak: 952 MB, VmSize: 714 MB, VmRSS: 137 MB, VmData: 177 MB, maxrss: 0.140352 MB
Blob 19 of 20, id: 16, sources: 1, size: 19x20, npix 209, brick X: 157,176, Y: 191,211, one pixel: 166 191
Blob 17 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147744 MB
Blob 20 of 20, id: 12, sources: 1, size: 19x18, npix 180, brick X: 110,129, Y: 171,189, one pixel: 118 171
Blob 11 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 952 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.14268 MB
Blob 12 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.14562 MB
Blob 13 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14624 MB
Blob 16 finished, total: Wall: 0.70 s, CPU: 0.69 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.1479 MB
Blob 19 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147744 MB
Blob 18 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 952 MB, VmSize: 714 MB, VmRSS: 137 MB, VmData: 177 MB, maxrss: 0.140352 MB
Blob 20 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 952 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143184 MB
Measuring 2 iterative sources
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.41934, ee1=0.434659, ee2=-1.13994
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 5.99 s, CPU: 5.99 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148572 MB
Blob 1 finished, total: Wall: 6.49 s, CPU: 6.49 s, VmPeak: 948 MB, VmSize: 714 MB, VmRSS: 141 MB, VmData: 177 MB, maxrss: 0.144348 MB
Old catalog: 30
New catalog: 32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/blobs-custom-029558p32362.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/metrics/cus/all-models-custom-029558p32362.fits
Stage fitblobs : Wall: 7.04 s, CPU: 0.59 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 218 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage fitblobs finished: 2020-06-04T04:39:15.150733
Resources for stage fitblobs : 34.877 s worker CPU, 34.922 s worker Wall, Wall: 7.039 s, Cores in use: 5.04, Total efficiency (on 8 cores): 63.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T04:39:15.152751
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/tmp-legacysurvey-custom-029558p32362-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/tmp-legacysurvey-custom-029558p32362-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/tmp-legacysurvey-custom-029558p32362-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/tmp-legacysurvey-custom-029558p32362-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-resid.jpg
Stage coadds : Wall: 1.60 s, CPU: 0.94 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 219 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage coadds finished: 2020-06-04T04:39:16.752408
Resources for stage coadds : 3.868 s worker CPU, 4.183 s worker Wall, Wall: 1.601 s, Cores in use: 3.00, Total efficiency (on 8 cores): 37.5 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T04:39:16.754021
Cut to 1 unWISE tiles
Reading WISE tile 0300p318 band 1
Reading WISE tile 0300p318 band 2
Reading WISE tile 0300p318 band 3
Reading WISE tile 0300p318 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 792 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204444 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.19058 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 952 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.204808 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300p318/unwise-0300p318-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 948 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206008 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/tmp-legacysurvey-custom-029558p32362-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/tmp-legacysurvey-custom-029558p32362-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.60 s, CPU: 0.92 s, VmPeak: 1031 MB, VmSize: 1031 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage wise_forced finished: 2020-06-04T04:39:21.353590
Resources for stage wise_forced : 2.944 s worker CPU, 7.835 s worker Wall, Wall: 4.601 s, Cores in use: 0.84, Total efficiency (on 8 cores): 10.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T04:39:21.355622
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/coadd/cus/custom-029558p32362/legacysurvey-custom-029558p32362-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/tractor-i/cus/tractor-custom-029558p32362.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/tractor/cus/tractor-custom-029558p32362.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1993450/tractor/cus/brick-custom-029558p32362.sha256sum
Stage writecat : Wall: 0.69 s, CPU: 0.42 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 222 MB, VmData: 247 MB, maxrss: 0.451424 MB
Stage writecat finished: 2020-06-04T04:39:22.048290
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.694 s, Cores in use: 0.61, Total efficiency (on 8 cores): 7.7 %
Stage writecat finished
All done: 48.124 s worker CPU, 303.074 s worker Wall, Wall: 105.433 s, Cores in use: 0.60, Total efficiency (on 8 cores): 7.5 %
Finished galaxy PGC1993450 in 1.831 minutes.