Started working on galaxy PGC946404 at Sun Jun  7 08:40:33 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.46370799999994 -12.8696944 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T08:40:34.164079
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.46370799999994', '-12.8696944', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.46370799999994 -12.8696944 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 323.46370799999994 -12.8696944
Starting process 21872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 21873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 21874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 21875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T08:40:39.592023
Keeping 10 CCDs:
   c4d_181003_235432_ooi_z_ls9.fits.fz c4d_181003_235432_ooi_z_ls9-N9 z exptime 250.0 propid 2014B-0404 seeing 0.94 MJD 58394.996 object DECaLS_43465_z
   c4d_180829_031803_ooi_z_ls9.fits.fz c4d_180829_031803_ooi_z_ls9-N11 z exptime 82.0 propid 2014B-0404 seeing 0.81 MJD 58359.138 object DECaLS_11721_z
   c4d_170722_040950_ooi_g_ls9.fits.fz c4d_170722_040950_ooi_g_ls9-N11 g exptime 90.0 propid 2014B-0404 seeing 1.08 MJD 57956.172 object DECaLS_11721_g
   c4d_180912_004307_ooi_z_ls9.fits.fz c4d_180912_004307_ooi_z_ls9-N10 z exptime 104.0 propid 2014B-0404 seeing 1.26 MJD 58373.030 object DECaLS_27593_z
   c4d_180903_011355_ooi_g_ls9.fits.fz c4d_180903_011355_ooi_g_ls9-N10 g exptime 123.0 propid 2014B-0404 seeing 1.16 MJD 58364.051 object DECaLS_27593_g
   c4d_180903_005856_ooi_r_ls9.fits.fz c4d_180903_005856_ooi_r_ls9-N10 r exptime 80.0 propid 2014B-0404 seeing 1.13 MJD 58364.041 object DECaLS_27593_r
   c4d_180915_035410_ooi_r_ls9.fits.fz c4d_180915_035410_ooi_r_ls9-N9 r exptime 40.0 propid 2014B-0404 seeing 0.95 MJD 58376.163 object DECaLS_43465_r
   c4d_160803_041429_ooi_r_ls9.fits.fz c4d_160803_041429_ooi_r_ls9-N11 r exptime 40.0 propid 2014B-0404 seeing 0.92 MJD 57603.176 object DECaLS_11721_r
   c4d_180906_005415_ooi_g_ls9.fits.fz c4d_180906_005415_ooi_g_ls9-S11 g exptime 56.0 propid 2014B-0404 seeing 0.97 MJD 58367.038 object DECaLS_59171_g
   c4d_180905_014851_ooi_g_ls9.fits.fz c4d_180905_014851_ooi_g_ls9-S8 g exptime 66.0 propid 2014B-0404 seeing 1.15 MJD 58366.076 object DECaLS_50910_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530bc0-z-20181003T235432_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f4c3-z-20180829T031803_oi[N11,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180912T004307_oi[N10,noinherit][2046,4094][real]: DECaLS_2759
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d93e-g-20170722T040728_oi[N11,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T011355_oi[N10,noinherit][2046,4094][real]: DECaLS_2759
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T005856_oi[N10,noinherit][2046,4094][real]: DECaLS_2759
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20180915T035410_oi[N9,noinherit][2046,4094][real]: DECaLS_4
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041259_oi[N11,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T014851_oi[S8,noinherit][2046,4094][real]: DECaLS_5
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005415_oi[S11,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 68.24 s, CPU: 6.55 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.454668 MB
Stage tims finished: 2020-06-07T08:41:47.828543
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530bc0-z-20181003T235432_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180903T011355_oi[N10,noinherit][2046,4094][real]: DECaLS_2759 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951d93e-g-20170722T040728_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160803T041259_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-z-20180912T004307_oi[N10,noinherit][2046,4094][real]: DECaLS_2759 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95361c2-r-20180915T035410_oi[N9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T014851_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955f4c3-z-20180829T031803_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-r-20180903T005856_oi[N10,noinherit][2046,4094][real]: DECaLS_2759 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_964e77a-g-20180906T005415_oi[S11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 4.294 s worker CPU, 212.471 s worker Wall, Wall: 68.238 s, Cores in use: 0.16, Total efficiency (on 4 cores): 4.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T08:41:47.849922
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07475.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07474.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07603.fits
Matched 9 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/reference-custom-323463m12869.fits
Stage refs : Wall: 10.96 s, CPU: 10.52 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 204 MB, VmData: 237 MB, maxrss: 0.454668 MB
Stage refs finished: 2020-06-07T08:41:58.810124
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.961 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T08:41:58.811491
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/outlier-mask-custom-323463m12869.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/outliers-pre-custom-323463m12869.jpg
Image c4d_180903_011355_ooi_g_ls9-N10 g : masking 184 positive outlier pixels and 0 negative outlier pixels
Image c4d_180905_014851_ooi_g_ls9-S8 g : masking 284 positive outlier pixels and 0 negative outlier pixels
Image c4d_160803_041429_ooi_r_ls9-N11 r : masking 0 positive outlier pixels and 59 negative outlier pixels
Image c4d_180915_035410_ooi_r_ls9-N9 r : masking 257 positive outlier pixels and 0 negative outlier pixels
Image c4d_181003_235432_ooi_z_ls9-N9 z : masking 237 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/outlier-mask-custom-323463m12869.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/outliers-post-custom-323463m12869.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/outliers-masked-pos-custom-323463m12869.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/outliers-masked-neg-custom-323463m12869.jpg
Stage outliers : Wall: 9.04 s, CPU: 8.74 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage outliers finished: 2020-06-07T08:42:07.852454
Resources for stage outliers : 0.941 s worker CPU, 0.965 s worker Wall, Wall: 9.042 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T08:42:07.854133
Stage halos : Wall: 8.58 s, CPU: 5.36 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage halos finished: 2020-06-07T08:42:16.433452
Resources for stage halos : 0.379 s worker CPU, 10.034 s worker Wall, Wall: 8.580 s, Cores in use: 0.67, Total efficiency (on 4 cores): 16.7 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T08:42:16.435424
PSF sigmas in coadd pixels: ['1.75', '1.89', '1.58', '1.87']
Using average PSF sigma 1.773367893226452
Gaussian PSF norm 0.15907291028069592 vs pixelized 0.1261484
average tim pixel scale / coadd scale: 1.0010798184915608
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.83', '1.54', '1.49']
Using average PSF sigma 1.6206494328445127
Gaussian PSF norm 0.1740628084376979 vs pixelized 0.13623339
average tim pixel scale / coadd scale: 1.0010831010037364
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.53', '1.31', '2.04']
Using average PSF sigma 1.6293917115093481
Gaussian PSF norm 0.1731288982147616 vs pixelized 0.13552165
average tim pixel scale / coadd scale: 1.0009809265638352
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage fit_on_coadds finished: 2020-06-07T08:42:16.650019
Resources for stage fit_on_coadds : 0.221 s worker CPU, 0.239 s worker Wall, Wall: 0.216 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T08:42:16.652767
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 21 kept
SED z : 21 new peaks
Found 22 potential peaks
Of 22 potential peaks: 21 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 22 potential peaks
Of 22 potential peaks: 19 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 32 potential peaks
Of 32 potential peaks: 26 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 32 potential peaks
Of 32 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 25 new sources
Median coadd sky for g : -8.373504e-05
Median coadd sky for r : 1.1864274e-05
Median coadd sky for z : 0.00032146572
Stage srcs : Wall: 8.39 s, CPU: 8.34 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage srcs finished: 2020-06-07T08:42:25.043138
Resources for stage srcs : 0.137 s worker CPU, 0.145 s worker Wall, Wall: 8.391 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/PGC946404-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T08:42:25.056627
Blob 1 of 16, id: 4, sources: 8, size: 101x175, npix 9220, brick X: 105,206, Y: 71,246, one pixel: 123 71
Blob 2 of 16, id: 12, sources: 2, size: 50x48, npix 1393, brick X: 84,134, Y: 219,267, one pixel: 115 219
Blob 3 of 16, id: 11, sources: 2, size: 29x43, npix 834, brick X: 11,40, Y: 213,256, one pixel: 22 213
Blob 4 of 16, id: 10, sources: 2, size: 28x45, npix 825, brick X: 242,270, Y: 175,220, one pixel: 256 175
Blob 5 of 16, id: 5, sources: 1, size: 29x31, npix 577, brick X: 61,90, Y: 72,103, one pixel: 75 72
Blob 4 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14708 MB
Blob 6 of 16, id: 15, sources: 1, size: 31x24, npix 567, brick X: 211,242, Y: 263,287, one pixel: 223 263
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14706 MB
Blob 7 of 16, id: 3, sources: 2, size: 26x37, npix 566, brick X: 253,279, Y: 66,103, one pixel: 264 66
Blob 2 finished, total: Wall: 2.69 s, CPU: 2.69 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14678 MB
Blob 8 of 16, id: 7, sources: 2, size: 25x31, npix 493, brick X: 18,43, Y: 97,128, one pixel: 27 97
Blob 5 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14708 MB
Blob 9 of 16, id: 2, sources: 1, size: 28x27, npix 483, brick X: 209,237, Y: 50,77, one pixel: 220 50
Blob 6 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14706 MB
Blob 10 of 16, id: 1, sources: 1, size: 25x25, npix 410, brick X: 1,26, Y: 29,54, one pixel: 11 29
Blob 8 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14708 MB
Blob 11 of 16, id: 14, sources: 1, size: 24x25, npix 378, brick X: 59,83, Y: 253,278, one pixel: 71 253
Blob 7 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14678 MB
Blob 12 of 16, id: 9, sources: 1, size: 24x23, npix 341, brick X: 85,109, Y: 172,195, one pixel: 94 172
Blob 10 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14708 MB
Blob 13 of 16, id: 13, sources: 1, size: 23x23, npix 316, brick X: 240,263, Y: 221,244, one pixel: 251 221
Blob 11 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14678 MB
Blob 14 of 16, id: 6, sources: 1, size: 20x21, npix 249, brick X: 6,26, Y: 75,96, one pixel: 14 75
Blob 9 finished, total: Wall: 1.70 s, CPU: 1.70 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149064 MB
Blob 15 of 16, id: 0, sources: 1, size: 20x19, npix 217, brick X: 250,270, Y: 18,37, one pixel: 258 18
Blob 13 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14678 MB
Blob 16 of 16, id: 8, sources: 1, size: 19x20, npix 209, brick X: 67,86, Y: 110,130, one pixel: 76 110
Blob 14 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149064 MB
Blob 15 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 955 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14678 MB
Blob 12 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14708 MB
Blob 16 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149064 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.7115, ee1=0.323729, ee2=-0.349342
Blob 1 finished, total: Wall: 10.39 s, CPU: 10.39 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15086 MB
Old catalog: 34
New catalog: 27
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/blobs-custom-323463m12869.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/metrics/cus/all-models-custom-323463m12869.fits
Stage fitblobs : Wall: 18.73 s, CPU: 8.36 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage fitblobs finished: 2020-06-07T08:42:43.787791
Resources for stage fitblobs : 26.275 s worker CPU, 26.296 s worker Wall, Wall: 18.732 s, Cores in use: 1.85, Total efficiency (on 4 cores): 46.2 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T08:42:43.789803
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/tmp-legacysurvey-custom-323463m12869-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/tmp-legacysurvey-custom-323463m12869-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/tmp-legacysurvey-custom-323463m12869-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/tmp-legacysurvey-custom-323463m12869-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-resid.jpg
Stage coadds : Wall: 5.80 s, CPU: 4.94 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage coadds finished: 2020-06-07T08:42:49.592216
Resources for stage coadds : 2.625 s worker CPU, 2.726 s worker Wall, Wall: 5.803 s, Cores in use: 1.30, Total efficiency (on 4 cores): 32.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T08:42:49.593728
Cut to 2 unWISE tiles
Reading WISE tile 3227m137 band 1
Reading WISE tile 3227m137 band 2
Reading WISE tile 3227m137 band 3
Reading WISE tile 3227m137 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3229m122 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3229m122 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 960 MB, VmSize: 801 MB, VmRSS: 155 MB, VmData: 180 MB, maxrss: 0.193248 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 796 MB, VmRSS: 150 MB, VmData: 174 MB, maxrss: 0.210252 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3229m122 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3227m137/unwise-3227m137-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3229m122 band 1
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 955 MB, VmSize: 796 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.213772 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/322/3229m122/unwise-3229m122-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210356 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/tmp-legacysurvey-custom-323463m12869-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/tmp-legacysurvey-custom-323463m12869-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 12.83 s, CPU: 6.72 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 222 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage wise_forced finished: 2020-06-07T08:43:02.428716
Resources for stage wise_forced : 6.197 s worker CPU, 15.182 s worker Wall, Wall: 12.836 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T08:43:02.430346
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/coadd/cus/custom-323463m12869/legacysurvey-custom-323463m12869-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/tractor-i/cus/tractor-custom-323463m12869.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/tractor/cus/tractor-custom-323463m12869.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC946404/tractor/cus/brick-custom-323463m12869.sha256sum
Stage writecat : Wall: 6.19 s, CPU: 6.07 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 224 MB, VmData: 248 MB, maxrss: 0.454668 MB
Stage writecat finished: 2020-06-07T08:43:08.624732
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.195 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.5 %
Stage writecat finished
All done: 41.070 s worker CPU, 268.060 s worker Wall, Wall: 149.037 s, Cores in use: 0.72, Total efficiency (on 4 cores): 17.9 %
Finished galaxy PGC946404 in 2.598 minutes.