Started working on galaxy PGC1386172 at Thu Jun  4 09:13:38 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.0277 10.9057 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T09:13:40.067873
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.0277', '10.9057', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.0277 10.9057 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.0277 10.9057
Starting process 51322 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 51323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 51324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 51325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 51326 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 51327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 51329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 51328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T09:13:44.474512
Keeping 11 CCDs:
   c4d_170917_035203_ooi_r_ls9.fits.fz c4d_170917_035203_ooi_r_ls9-S27 r exptime 48.0 propid 2014B-0404 seeing 1.01 MJD 58013.161 object DECaLS_7884_r
   c4d_171113_005045_ooi_z_ls9.fits.fz c4d_171113_005045_ooi_z_ls9-S27 z exptime 161.0 propid 2014B-0404 seeing 0.84 MJD 58070.035 object DECaLS_7884_z
   c4d_160813_055306_ooi_z_ls9.fits.fz c4d_160813_055306_ooi_z_ls9-S21 z exptime 90.0 propid 2014B-0404 seeing 0.91 MJD 57613.244 object DECaLS_23756_z
   c4d_170916_044805_ooi_g_ls9.fits.fz c4d_170916_044805_ooi_g_ls9-S21 g exptime 127.0 propid 2014B-0404 seeing 1.47 MJD 58012.200 object DECaLS_23756_g
   c4d_180619_084616_ooi_r_ls9.fits.fz c4d_180619_084616_ooi_r_ls9-S21 r exptime 90.0 propid 2014B-0404 seeing 1.44 MJD 58288.365 object DECaLS_23756_r
   c4d_170721_064746_ooi_g_ls9.fits.fz c4d_170721_064746_ooi_g_ls9-S20 g exptime 131.0 propid 2014B-0404 seeing 1.41 MJD 57955.281 object DECaLS_39628_g
   c4d_170719_073302_ooi_r_ls9.fits.fz c4d_170719_073302_ooi_r_ls9-S20 r exptime 114.0 propid 2014B-0404 seeing 2.21 MJD 57953.313 object DECaLS_39628_r
   c4d_140815_075529_ooi_z_ls9.fits.fz c4d_140815_075529_ooi_z_ls9-S20 z exptime 138.0 propid 2014B-0404 seeing 0.92 MJD 56884.328 object DECaLS_39628_z
   c4d_180910_023807_ooi_r_ls9.fits.fz c4d_180910_023807_ooi_r_ls9-S20 r exptime 46.0 propid 2014B-0404 seeing 1.35 MJD 58371.110 object DECaLS_39628_r
   c4d_170915_025927_ooi_g_ls9.fits.fz c4d_170915_025927_ooi_g_ls9-N31 g exptime 200.0 propid 2014B-0404 seeing 1.07 MJD 58011.125 object DECaLS_39605_g
   c4d_170922_022610_ooi_g_ls9.fits.fz c4d_170922_022610_ooi_g_ls9-S27 g exptime 154.0 propid 2014B-0404 seeing 1.45 MJD 58018.102 object DECaLS_7884_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170916T044805_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T064442_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171113T005045_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560feb-r-20180619T084616_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T075216_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T035203_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T073015_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T055045_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T022610_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180910T023807_oi[S20,noinherit][2046,4094][real]: DECaLS_3962
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170915T025927_oi[N31,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 73.11 s, CPU: 3.50 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 177 MB, VmData: 210 MB, maxrss: 0.450024 MB
Stage tims finished: 2020-06-04T09:14:57.582818
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T075216_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560feb-r-20180619T084616_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T035203_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T073015_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171113T005045_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T022610_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T064442_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180910T023807_oi[S20,noinherit][2046,4094][real]: DECaLS_3962 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170916T044805_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170915T025927_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T055045_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 5.377 s worker CPU, 230.245 s worker Wall, Wall: 73.110 s, Cores in use: 0.12, Total efficiency (on 8 cores): 1.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-04T09:14:57.616238
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05051.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/reference-custom-347027p10905.fits
Stage refs : Wall: 5.68 s, CPU: 4.44 s, VmPeak: 1026 MB, VmSize: 1013 MB, VmRSS: 196 MB, VmData: 228 MB, maxrss: 0.450024 MB
Stage refs finished: 2020-06-04T09:15:03.295940
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.681 s, Cores in use: 0.78, Total efficiency (on 8 cores): 9.8 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T09:15:03.297647
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outlier-mask-custom-347027p10905.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-pre-custom-347027p10905.jpg
Image c4d_180619_084616_ooi_r_ls9-S21 r : masking 2095 positive outlier pixels and 58 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outlier-mask-custom-347027p10905.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-post-custom-347027p10905.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-masked-pos-custom-347027p10905.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-masked-neg-custom-347027p10905.jpg
Stage outliers : Wall: 2.40 s, CPU: 2.17 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.450024 MB
Stage outliers finished: 2020-06-04T09:15:05.695532
Resources for stage outliers : 0.991 s worker CPU, 0.992 s worker Wall, Wall: 2.399 s, Cores in use: 1.32, Total efficiency (on 8 cores): 16.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T09:15:05.697679
Stage halos : Wall: 1.30 s, CPU: 0.85 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 213 MB, VmData: 242 MB, maxrss: 0.450024 MB
Stage halos finished: 2020-06-04T09:15:06.998168
Resources for stage halos : 0.187 s worker CPU, 2.539 s worker Wall, Wall: 1.302 s, Cores in use: 0.80, Total efficiency (on 8 cores): 10.0 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T09:15:07.000539
PSF sigmas in coadd pixels: ['2.38', '2.29', '2.36']
Using average PSF sigma 2.3424632459718997
Gaussian PSF norm 0.12042656048455337 vs pixelized 0.10025104
average tim pixel scale / coadd scale: 1.0011683130203142
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.64', '2.34', '3.60', '2.19']
Using average PSF sigma 2.444542165331849
Gaussian PSF norm 0.11539780159021455 vs pixelized 0.091037214
average tim pixel scale / coadd scale: 1.0012015130482828
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.37', '1.47', '1.49']
Using average PSF sigma 1.4432623553118888
Gaussian PSF norm 0.19545634980059984 vs pixelized 0.15971643
average tim pixel scale / coadd scale: 1.0011003966770269
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.23 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 215 MB, VmData: 243 MB, maxrss: 0.450024 MB
Stage fit_on_coadds finished: 2020-06-04T09:15:07.257942
Resources for stage fit_on_coadds : 0.255 s worker CPU, 0.255 s worker Wall, Wall: 0.259 s, Cores in use: 1.89, Total efficiency (on 8 cores): 23.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T09:15:07.261145
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 58 potential peaks
Of 58 potential peaks: 34 in veto map, 7 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 20 potential peaks
Of 20 potential peaks: 13 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 22 potential peaks
Of 22 potential peaks: 14 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept
SED g : 4 new peaks
Found 32 potential peaks
Of 32 potential peaks: 22 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 38 potential peaks
Of 38 potential peaks: 31 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 32 new sources
Median coadd sky for g : 1.9886153e-05
Median coadd sky for r : -2.6835427e-05
Median coadd sky for z : -1.2030134e-07
Stage srcs : Wall: 0.84 s, CPU: 0.79 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.450024 MB
Stage srcs finished: 2020-06-04T09:15:08.098720
Resources for stage srcs : 0.105 s worker CPU, 0.105 s worker Wall, Wall: 0.839 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T09:15:08.126380
Blob 1 of 19, id: 6, sources: 10, size: 161x140, npix 14159, brick X: 81,242, Y: 82,222, one pixel: 184 82
Blob 2 of 19, id: 0, sources: 3, size: 59x40, npix 1261, brick X: 2,61, Y: 1,41, one pixel: 39 1
Blob 3 of 19, id: 16, sources: 1, size: 35x31, npix 704, brick X: 129,164, Y: 270,301, one pixel: 146 270
Blob 4 of 19, id: 10, sources: 3, size: 37x32, npix 664, brick X: 0,37, Y: 186,218, one pixel: 21 186
Blob 5 of 19, id: 15, sources: 1, size: 30x30, npix 608, brick X: 117,147, Y: 247,277, one pixel: 127 247
Blob 6 of 19, id: 14, sources: 2, size: 37x29, npix 575, brick X: 233,270, Y: 243,272, one pixel: 244 243
Blob 7 of 19, id: 9, sources: 1, size: 26x26, npix 454, brick X: 270,296, Y: 170,196, one pixel: 280 170
Blob 8 of 19, id: 5, sources: 1, size: 27x26, npix 439, brick X: 94,121, Y: 71,97, one pixel: 104 71
Blob 9 of 19, id: 11, sources: 1, size: 25x26, npix 427, brick X: 62,87, Y: 186,212, one pixel: 71 186
Blob 7 finished, total: Wall: 0.78 s, CPU: 0.68 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146088 MB
Blob 10 of 19, id: 12, sources: 1, size: 17x34, npix 427, brick X: 284,301, Y: 191,225, one pixel: 295 191
Blob 8 finished, total: Wall: 0.83 s, CPU: 0.72 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146956 MB
Blob 11 of 19, id: 1, sources: 1, size: 24x22, npix 338, brick X: 136,160, Y: 41,63, one pixel: 146 41
Blob 5 finished, total: Wall: 1.10 s, CPU: 1.09 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147304 MB
Blob 12 of 19, id: 4, sources: 1, size: 22x23, npix 324, brick X: 209,231, Y: 65,88, one pixel: 217 65
Blob 3 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 926 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14742 MB
Blob 13 of 19, id: 13, sources: 1, size: 22x22, npix 284, brick X: 211,233, Y: 214,236, one pixel: 221 214
Blob 9 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146088 MB
Blob 14 of 19, id: 17, sources: 1, size: 22x22, npix 284, brick X: 209,231, Y: 271,293, one pixel: 219 271
Blob 6 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147644 MB
Blob 15 of 19, id: 3, sources: 1, size: 20x21, npix 238, brick X: 232,252, Y: 56,77, one pixel: 240 56
Blob 4 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145808 MB
Blob 11 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147304 MB
Blob 16 of 19, id: 7, sources: 1, size: 20x19, npix 208, brick X: 272,292, Y: 89,108, one pixel: 282 89
Blob 13 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146088 MB
Blob 17 of 19, id: 2, sources: 1, size: 19x19, npix 181, brick X: 11,30, Y: 50,69, one pixel: 20 50
Blob 18 of 19, id: 18, sources: 1, size: 17x18, npix 162, brick X: 194,211, Y: 282,300, one pixel: 202 282
Blob 15 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147304 MB
Blob 16 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147672 MB
Blob 19 of 19, id: 8, sources: 1, size: 17x17, npix 145, brick X: 230,247, Y: 162,179, one pixel: 238 162
Blob 19 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147672 MB
Blob 12 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 926 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147468 MB
Blob 17 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146088 MB
Blob 2 finished, total: Wall: 2.14 s, CPU: 2.14 s, VmPeak: 931 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147672 MB
Blob 14 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 948 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147644 MB
Blob 10 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.146956 MB
Blob 18 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147304 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.99704, ee1=-0.159053, ee2=0.0419648
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 12.68 s, CPU: 12.64 s, VmPeak: 948 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150096 MB
Old catalog: 35
New catalog: 27
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/blobs-custom-347027p10905.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/all-models-custom-347027p10905.fits
Stage fitblobs : Wall: 13.28 s, CPU: 0.62 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.450024 MB
Stage fitblobs finished: 2020-06-04T09:15:21.408637
Resources for stage fitblobs : 27.520 s worker CPU, 27.824 s worker Wall, Wall: 13.284 s, Cores in use: 2.12, Total efficiency (on 8 cores): 26.5 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T09:15:21.410738
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-resid.jpg
Stage coadds : Wall: 3.21 s, CPU: 2.44 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.450024 MB
Stage coadds finished: 2020-06-04T09:15:24.621137
Resources for stage coadds : 3.903 s worker CPU, 4.317 s worker Wall, Wall: 3.211 s, Cores in use: 1.97, Total efficiency (on 8 cores): 24.7 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T09:15:24.622640
Cut to 1 unWISE tiles
Reading WISE tile 3476p106 band 1
Reading WISE tile 3476p106 band 2
Reading WISE tile 3476p106 band 3
Reading WISE tile 3476p106 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 948 MB, VmSize: 799 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.194812 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 957 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210212 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 932 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.20636 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 948 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208148 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.04 s, CPU: 1.93 s, VmPeak: 1026 MB, VmSize: 1017 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.450024 MB
Stage wise_forced finished: 2020-06-04T09:15:30.667722
Resources for stage wise_forced : 3.056 s worker CPU, 9.551 s worker Wall, Wall: 6.046 s, Cores in use: 0.82, Total efficiency (on 8 cores): 10.3 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T09:15:30.669659
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/tractor-i/cus/tractor-custom-347027p10905.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/tractor/cus/tractor-custom-347027p10905.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/tractor/cus/brick-custom-347027p10905.sha256sum
Stage writecat : Wall: 3.41 s, CPU: 3.17 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 214 MB, VmData: 238 MB, maxrss: 0.450024 MB
Stage writecat finished: 2020-06-04T09:15:34.077864
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.409 s, Cores in use: 0.93, Total efficiency (on 8 cores): 11.6 %
Stage writecat finished
All done: 41.397 s worker CPU, 275.831 s worker Wall, Wall: 109.608 s, Cores in use: 0.56, Total efficiency (on 8 cores): 7.0 %
Finished galaxy PGC1386172 in 1.926 minutes.
Started working on galaxy PGC1386172 at Mon Aug 10 10:16:14 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.02729380972676 10.905530344229913 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T10:16:15.771031
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '347.02729380972676', '10.905530344229913', '--width', '301', '--height', '301', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 347.02729380972676 10.905530344229913 --width 301 --height 301 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 347.02729380972676 10.905530344229913
Starting process 22495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 22496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 22498 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 22500 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 22502 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 22504 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 22508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 22506 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T10:16:16.254771
Keeping 11 CCDs:
  c4d_170917_035203_ooi_r_ls9-S27 r expnum 678354 exptime 48.0 propid 2014B-0404 seeing 1.01 MJD 58013.161 object DECaLS_7884_r 
    decam/CP/V4.8.2a/CP20170916/c4d_170917_035203_ooi_r_ls9.fits.fz
  c4d_171113_005045_ooi_z_ls9-S27 z expnum 695607 exptime 161.0 propid 2014B-0404 seeing 0.84 MJD 58070.035 object DECaLS_7884_z 
    decam/CP/V4.8.2a/CP20171112/c4d_171113_005045_ooi_z_ls9.fits.fz
  c4d_160813_055306_ooi_z_ls9-S21 z expnum 563588 exptime 90.0 propid 2014B-0404 seeing 0.91 MJD 57613.244 object DECaLS_23756_z 
    decam/CP/V4.8.2a/CP20160812/c4d_160813_055306_ooi_z_ls9.fits.fz
  c4d_170916_044805_ooi_g_ls9-S21 g expnum 678025 exptime 127.0 propid 2014B-0404 seeing 1.47 MJD 58012.200 object DECaLS_23756_g 
    decam/CP/V4.8.2a/CP20170915/c4d_170916_044805_ooi_g_ls9.fits.fz
  c4d_180619_084616_ooi_r_ls9-S21 r expnum 754111 exptime 90.0 propid 2014B-0404 seeing 1.44 MJD 58288.365 object DECaLS_23756_r 
    decam/CP/V4.8.2a/CP20180618/c4d_180619_084616_ooi_r_ls9.fits.fz
  c4d_170721_064746_ooi_g_ls9-S20 g expnum 660491 exptime 131.0 propid 2014B-0404 seeing 1.41 MJD 57955.281 object DECaLS_39628_g 
    decam/CP/V4.8.2/CP20170720/c4d_170721_064746_ooi_g_ls9.fits.fz
  c4d_170719_073302_ooi_r_ls9-S20 r expnum 660043 exptime 114.0 propid 2014B-0404 seeing 2.21 MJD 57953.313 object DECaLS_39628_r 
    decam/CP/V4.8.2/CP20170718/c4d_170719_073302_ooi_r_ls9.fits.fz
  c4d_140815_075529_ooi_z_ls9-S20 z expnum 348047 exptime 138.0 propid 2014B-0404 seeing 0.92 MJD 56884.328 object DECaLS_39628_z 
    decam/CP/V4.8.2a/CP20140814/c4d_140815_075529_ooi_z_ls9.fits.fz
  c4d_180910_023807_ooi_r_ls9-S20 r expnum 771443 exptime 46.0 propid 2014B-0404 seeing 1.35 MJD 58371.110 object DECaLS_39628_r 
    decam/CP/V4.8.2a/CP20180909/c4d_180910_023807_ooi_r_ls9.fits.fz
  c4d_170915_025927_ooi_g_ls9-N31 g expnum 677713 exptime 200.0 propid 2014B-0404 seeing 1.07 MJD 58011.125 object DECaLS_39605_g 
    decam/CP/V4.8.2a/CP20170914/c4d_170915_025927_ooi_g_ls9.fits.fz
  c4d_170922_022610_ooi_g_ls9-S27 g expnum 680110 exptime 154.0 propid 2014B-0404 seeing 1.45 MJD 58018.102 object DECaLS_7884_g 
    decam/CP/V4.8.2a/CP20170921/c4d_170922_022610_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171113T005045_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560feb-r-20180619T084616_oi[S21,noinherit][2046,4094][real]: DECaLS_
Clipping 2026 pixels with anomalously large oow values: max 0.010812 vs median 0.00621921
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T064442_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T055045_oi[S21,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T035203_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T075216_oi[S20,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T073015_oi[S20,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180910T023807_oi[S20,noinherit][2046,4094][real]: DECaLS_3962
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T022610_oi[S27,noinherit][2046,4094][real]: DECaLS_
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170915T025927_oi[N31,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170916T044805_oi[S21,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 97.07 s, CPU: 0.99 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 179 MB, VmData: 212 MB, maxrss: 0.182892 MB
Stage tims finished: 2020-08-10T10:17:53.326366
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ccd4-g-20170721T064442_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954fc69-z-20160813T055045_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954cb27-z-20140815T075216_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951beed-r-20170719T073015_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9523600-r-20170917T035203_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170915T025927_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560feb-r-20180619T084616_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180910T023807_oi[S20,noinherit][2046,4094][real]: DECaLS_3962 [astropy.io.fits.card]
Resources for stage tims : 5.670 s worker CPU, 382.420 s worker Wall, Wall: 97.073 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952307c-g-20170916T044805_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-08-10T10:17:53.943148
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04923.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05179.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05052.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05051.fits
Matched 6 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/reference-custom-347027p10905.fits
Stage refs : Wall: 8.41 s, CPU: 2.09 s, VmPeak: 1035 MB, VmSize: 1023 MB, VmRSS: 198 MB, VmData: 230 MB, maxrss: 0.2029 MB
Stage refs finished: 2020-08-10T10:18:02.348789
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952303b-z-20171113T005045_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952528e-g-20170922T022610_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.407 s, Cores in use: 0.25, Total efficiency (on 8 cores): 3.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T10:18:02.377108
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outlier-mask-custom-347027p10905.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-pre-custom-347027p10905.jpg
Image c4d_180619_084616_ooi_r_ls9-S21 r : masking 2524 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outlier-mask-custom-347027p10905.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-post-custom-347027p10905.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-masked-pos-custom-347027p10905.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/outliers-masked-neg-custom-347027p10905.jpg
Stage outliers : Wall: 3.10 s, CPU: 1.40 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 217 MB, VmData: 247 MB, maxrss: 0.221784 MB
Stage outliers finished: 2020-08-10T10:18:05.480689
Resources for stage outliers : 0.937 s worker CPU, 0.942 s worker Wall, Wall: 3.105 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T10:18:05.511176
Stage halos : Wall: 0.45 s, CPU: 0.33 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 217 MB, VmData: 247 MB, maxrss: 0.222116 MB
Stage halos finished: 2020-08-10T10:18:05.958725
Resources for stage halos : 0.193 s worker CPU, 0.667 s worker Wall, Wall: 0.449 s, Cores in use: 1.17, Total efficiency (on 8 cores): 14.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T10:18:05.988345
PSF sigmas in coadd pixels: ['2.38', '2.29', '2.36']
Using average PSF sigma 2.3424632459718997
Gaussian PSF norm 0.12042656048455337 vs pixelized 0.10024985
average tim pixel scale / coadd scale: 1.0011683130203142
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.64', '2.34', '3.60', '2.19']
Using average PSF sigma 2.444542165331849
Gaussian PSF norm 0.11539780159021455 vs pixelized 0.09103669
average tim pixel scale / coadd scale: 1.0012015130482828
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.37', '1.47', '1.49']
Using average PSF sigma 1.4432623553118888
Gaussian PSF norm 0.19545634980059984 vs pixelized 0.1597159
average tim pixel scale / coadd scale: 1.0011003966770269
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.22 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.22478 MB
Stage fit_on_coadds finished: 2020-08-10T10:18:06.243968
Resources for stage fit_on_coadds : 0.269 s worker CPU, 0.284 s worker Wall, Wall: 0.257 s, Cores in use: 1.92, Total efficiency (on 8 cores): 24.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T10:18:06.256784
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 59 potential peaks
Of 59 potential peaks: 33 in veto map, 10 cut by saddle test, 0 cut by aper test, 16 kept
SED z : 16 new peaks
Found 22 potential peaks
Of 22 potential peaks: 15 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 23 potential peaks
Of 23 potential peaks: 15 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept
SED g : 4 new peaks
Found 31 potential peaks
Of 31 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 38 potential peaks
Of 38 potential peaks: 31 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 28 new sources
Median coadd sky for g : 1.8227782e-05
Median coadd sky for r : -2.1277563e-05
Median coadd sky for z : -2.9773855e-05
Stage srcs : Wall: 0.63 s, CPU: 0.57 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.225368 MB
Stage srcs finished: 2020-08-10T10:18:06.883590
Resources for stage srcs : 0.145 s worker CPU, 0.145 s worker Wall, Wall: 0.628 s, Cores in use: 1.15, Total efficiency (on 8 cores): 14.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T10:18:06.897316
Blob 1 of 16, id: 6, sources: 8, size: 161x140, npix 14150, brick X: 76,237, Y: 84,224, one pixel: 179 84
Blob 2 of 16, id: 8, sources: 3, size: 37x69, npix 1501, brick X: 264,301, Y: 160,229, one pixel: 295 160
Blob 3 of 16, id: 0, sources: 3, size: 56x39, npix 1246, brick X: 0,56, Y: 4,43, one pixel: 32 4
Blob 4 of 16, id: 14, sources: 1, size: 34x29, npix 674, brick X: 124,158, Y: 272,301, one pixel: 141 272
Blob 5 of 16, id: 13, sources: 1, size: 30x30, npix 589, brick X: 111,141, Y: 249,279, one pixel: 123 249
Blob 6 of 16, id: 12, sources: 2, size: 38x28, npix 569, brick X: 227,265, Y: 246,274, one pixel: 237 246
Blob 7 of 16, id: 10, sources: 2, size: 26x31, npix 493, brick X: 6,32, Y: 189,220, one pixel: 15 189
Blob 8 of 16, id: 5, sources: 1, size: 26x26, npix 432, brick X: 89,115, Y: 73,99, one pixel: 99 73
Blob 9 of 16, id: 9, sources: 1, size: 25x26, npix 424, brick X: 56,81, Y: 188,214, one pixel: 67 188
Blob 8 finished, total: Wall: 0.80 s, CPU: 0.75 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146204 MB
Blob 10 of 16, id: 1, sources: 1, size: 24x23, npix 341, brick X: 131,155, Y: 43,66, one pixel: 141 43
Blob 5 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146024 MB
Blob 11 of 16, id: 4, sources: 1, size: 22x23, npix 316, brick X: 203,225, Y: 67,90, one pixel: 212 67
Blob 4 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146024 MB
Blob 12 of 16, id: 15, sources: 1, size: 23x21, npix 301, brick X: 203,226, Y: 274,295, one pixel: 212 274
Blob 7 finished, total: Wall: 1.22 s, CPU: 1.15 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14516 MB
Blob 13 of 16, id: 11, sources: 1, size: 23x22, npix 294, brick X: 205,228, Y: 216,238, one pixel: 216 216
Blob 9 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146204 MB
Blob 14 of 16, id: 3, sources: 1, size: 21x20, npix 239, brick X: 226,247, Y: 59,79, one pixel: 234 59
Blob 6 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14626 MB
Blob 15 of 16, id: 2, sources: 1, size: 18x19, npix 198, brick X: 6,24, Y: 52,71, one pixel: 14 52
Blob 14 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14626 MB
Blob 16 of 16, id: 7, sources: 1, size: 19x18, npix 198, brick X: 267,286, Y: 92,110, one pixel: 275 92
Blob 12 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14516 MB
Blob 15 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14626 MB
Blob 10 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146024 MB
Blob 11 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146024 MB
Blob 13 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146204 MB
Blob 16 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 969 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14516 MB
Blob 3 finished, total: Wall: 2.20 s, CPU: 2.14 s, VmPeak: 965 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146456 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 3.67 s, CPU: 3.67 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14794 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.88502, ee1=-0.153474, ee2=0.039449
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 9.20 s, CPU: 9.20 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149844 MB
Old catalog: 31
New catalog: 25
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/blobs-custom-347027p10905.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/metrics/cus/all-models-custom-347027p10905.fits
Stage fitblobs : Wall: 9.67 s, CPU: 0.46 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.225792 MB
Stage fitblobs finished: 2020-08-10T10:18:16.565622
Resources for stage fitblobs : 24.870 s worker CPU, 25.122 s worker Wall, Wall: 9.669 s, Cores in use: 2.62, Total efficiency (on 8 cores): 32.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T10:18:16.588074
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-resid.jpg
Stage coadds : Wall: 1.57 s, CPU: 0.69 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.226244 MB
Stage coadds finished: 2020-08-10T10:18:18.157588
Resources for stage coadds : 4.287 s worker CPU, 5.209 s worker Wall, Wall: 1.571 s, Cores in use: 3.17, Total efficiency (on 8 cores): 39.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T10:18:18.171516
Cut to 1 unWISE tiles
Reading WISE tile 3476p106 band 3
Reading WISE tile 3476p106 band 4
Reading WISE tile 3476p106 band 2
Reading WISE tile 3476p106 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 957 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.194348 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 969 MB, VmSize: 801 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.207628 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.207372 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/347/3476p106/unwise-3476p106-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208312 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/tmp-legacysurvey-custom-347027p10905-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.05 s, CPU: 0.43 s, VmPeak: 1035 MB, VmSize: 1033 MB, VmRSS: 222 MB, VmData: 248 MB, maxrss: 0.226948 MB
Stage wise_forced finished: 2020-08-10T10:18:21.225291
Resources for stage wise_forced : 3.584 s worker CPU, 4.649 s worker Wall, Wall: 3.055 s, Cores in use: 1.32, Total efficiency (on 8 cores): 16.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T10:18:21.240166
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/coadd/cus/custom-347027p10905/legacysurvey-custom-347027p10905-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/tractor-i/cus/tractor-custom-347027p10905.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/tractor/cus/tractor-custom-347027p10905.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/tractor/cus/brick-custom-347027p10905.sha256sum
Stage writecat : Wall: 0.63 s, CPU: 0.47 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 224 MB, VmData: 248 MB, maxrss: 0.359952 MB
Stage writecat finished: 2020-08-10T10:18:21.865647
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.627 s, Cores in use: 0.76, Total efficiency (on 8 cores): 9.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/347/PGC1386172/PGC1386172-largegalaxy-writecat.p
All done: 39.956 s worker CPU, 419.440 s worker Wall, Wall: 125.630 s, Cores in use: 0.38, Total efficiency (on 8 cores): 4.8 %
Finished galaxy PGC1386172 in 2.128 minutes.