Started working on galaxy PGC1903377 at Thu Jun  4 20:59:11 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 176.72726250000002 30.428094800000004 --width 255 --height 255 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T20:59:12.525241
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '176.72726250000002', '30.428094800000004', '--width', '255', '--height', '255', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 176.72726250000002 30.428094800000004 --width 255 --height 255 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 176.72726250000002 30.428094800000004
Starting process 47052 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05746 MB
Starting process 47053 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057396 MB
Starting process 47054 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05746 MB
Starting process 47055 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T20:59:25.051884
Keeping 15 CCDs:
   c4d_160408_021800_ooi_g_ls9.fits.fz c4d_160408_021800_ooi_g_ls9-N15 g exptime 125.0 propid 2014B-0404 seeing 1.74 MJD 57486.094 object DECaLS_19073_g
   c4d_180221_064719_ooi_r_ls9.fits.fz c4d_180221_064719_ooi_r_ls9-N8 r exptime 58.0 propid 2014B-0404 seeing 1.21 MJD 58170.283 object DECaLS_34945_r
   c4d_180221_064330_ooi_g_ls9.fits.fz c4d_180221_064330_ooi_g_ls9-N8 g exptime 200.0 propid 2014B-0404 seeing 1.44 MJD 58170.280 object DECaLS_34945_g
   c4d_170317_045942_ooi_z_ls9.fits.fz c4d_170317_045942_ooi_z_ls9-N8 z exptime 102.0 propid 2014B-0404 seeing 1.08 MJD 57829.206 object DECaLS_34945_z
   c4d_190205_065833_ooi_z_ls9.fits.fz c4d_190205_065833_ooi_z_ls9-N15 z exptime 127.0 propid 2014B-0404 seeing 1.37 MJD 58519.291 object DECaLS_19073_z
   c4d_190205_070108_ooi_g_ls9.fits.fz c4d_190205_070108_ooi_g_ls9-N15 g exptime 130.0 propid 2014B-0404 seeing 1.12 MJD 58519.292 object DECaLS_19073_g
   c4d_180213_065256_ooi_r_ls9.fits.fz c4d_180213_065256_ooi_r_ls9-N16 r exptime 78.0 propid 2014B-0404 seeing 1.14 MJD 58162.287 object DECaLS_3201_r
   c4d_180128_075814_ooi_g_ls9.fits.fz c4d_180128_075814_ooi_g_ls9-N16 g exptime 200.0 propid 2014B-0404 seeing 1.40 MJD 58146.332 object DECaLS_3201_g
   c4d_180210_065146_ooi_z_ls9.fits.fz c4d_180210_065146_ooi_z_ls9-N16 z exptime 120.0 propid 2014B-0404 seeing 1.23 MJD 58159.286 object DECaLS_3201_z
   c4d_180209_063640_ooi_z_ls9.fits.fz c4d_180209_063640_ooi_z_ls9-N16 z exptime 80.0 propid 2014B-0404 seeing 0.93 MJD 58158.275 object DECaLS_3201_z
   c4d_160226_061249_ooi_z_ls9.fits.fz c4d_160226_061249_ooi_z_ls9-N9 z exptime 175.0 propid 2014B-0404 seeing 1.44 MJD 57444.256 object DECaLS_19073_z
   c4d_190205_065833_ooi_z_ls9.fits.fz c4d_190205_065833_ooi_z_ls9-N9 z exptime 127.0 propid 2014B-0404 seeing 1.39 MJD 58519.291 object DECaLS_19073_z
   c4d_190205_070108_ooi_g_ls9.fits.fz c4d_190205_070108_ooi_g_ls9-N9 g exptime 130.0 propid 2014B-0404 seeing 1.72 MJD 58519.292 object DECaLS_19073_g
   c4d_180212_064429_ooi_r_ls9.fits.fz c4d_180212_064429_ooi_r_ls9-N9 r exptime 127.0 propid 2014B-0404 seeing 1.69 MJD 58161.281 object DECaLS_19073_r
   c4d_160226_061249_ooi_z_ls9.fits.fz c4d_160226_061249_ooi_z_ls9-N15 z exptime 175.0 propid 2014B-0404 seeing 1.43 MJD 57444.256 object DECaLS_19073_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956aefa-g-20160408T021505_oi[N15,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fef3-z-20170317T045710_oi[N8,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T064719_oi[N8,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180221T064330_oi[N8,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a3cf-r-20180213T065256_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180210T065146_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180128T075814_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534704-z-20190205T065833_oi[N9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T060903_oi[N9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539fed-g-20190205T070108_oi[N9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a3cf-r-20180212T064429_oi[N9,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526b25-z-20180209T063640_oi[N16,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 114.77 s, CPU: 10.23 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.454612 MB
Stage tims finished: 2020-06-04T21:01:19.822287
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952bd60-g-20180221T064330_oi[N8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180128T075814_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9539fed-g-20190205T070108_oi[N9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ba12-r-20180221T064719_oi[N8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527115-z-20180210T065146_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160226T060903_oi[N9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956aefa-g-20160408T021505_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9526b25-z-20180209T063640_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fef3-z-20170317T045710_oi[N8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a3cf-r-20180213T065256_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534704-z-20190205T065833_oi[N9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952a3cf-r-20180212T064429_oi[N9,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Resources for stage tims : 5.155 s worker CPU, 352.497 s worker Wall, Wall: 114.772 s, Cores in use: 0.13, Total efficiency (on 4 cores): 3.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-04T21:01:19.846658
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03199.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02943.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03070.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03071.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/reference-custom-176727p30428.fits
Stage refs : Wall: 8.31 s, CPU: 7.81 s, VmPeak: 1026 MB, VmSize: 1005 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.454612 MB
Stage refs finished: 2020-06-04T21:01:28.159376
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.314 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T21:01:28.160896
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/outlier-mask-custom-176727p30428.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/outliers-pre-custom-176727p30428.jpg
Image c4d_160408_021800_ooi_g_ls9-N15 g : masking 218 positive outlier pixels and 0 negative outlier pixels
Image c4d_160226_061249_ooi_z_ls9-N9 z : masking 0 positive outlier pixels and 63 negative outlier pixels
Image c4d_180210_065146_ooi_z_ls9-N16 z : masking 0 positive outlier pixels and 64 negative outlier pixels
Image c4d_190205_065833_ooi_z_ls9-N9 z : masking 62 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/outlier-mask-custom-176727p30428.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/outliers-post-custom-176727p30428.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/outliers-masked-pos-custom-176727p30428.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/outliers-masked-neg-custom-176727p30428.jpg
Stage outliers : Wall: 9.04 s, CPU: 6.46 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 195 MB, VmData: 226 MB, maxrss: 0.454612 MB
Stage outliers finished: 2020-06-04T21:01:37.198851
Resources for stage outliers : 0.808 s worker CPU, 0.827 s worker Wall, Wall: 9.039 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T21:01:37.200473
Stage halos : Wall: 7.86 s, CPU: 5.34 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 196 MB, VmData: 226 MB, maxrss: 0.454612 MB
Stage halos finished: 2020-06-04T21:01:45.055849
Resources for stage halos : 0.288 s worker CPU, 9.584 s worker Wall, Wall: 7.856 s, Cores in use: 0.72, Total efficiency (on 4 cores): 17.9 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T21:01:45.057772
PSF sigmas in coadd pixels: ['2.82', '2.35', '2.27', '2.80']
Using average PSF sigma 2.560538688649463
Gaussian PSF norm 0.11017009546638289 vs pixelized 0.096518576
average tim pixel scale / coadd scale: 1.0014062118405505
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.97', '1.86', '2.74']
Using average PSF sigma 2.188980933609808
Gaussian PSF norm 0.12887037408255578 vs pixelized 0.11121617
average tim pixel scale / coadd scale: 1.001413418371088
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.75', '2.00', '1.52', '2.34', '2.26']
Using average PSF sigma 1.9716305754322108
Gaussian PSF norm 0.14307690055579445 vs pixelized 0.12434034
average tim pixel scale / coadd scale: 1.0013477814575757
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 4.16 s, CPU: 0.16 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 197 MB, VmData: 227 MB, maxrss: 0.454612 MB
Stage fit_on_coadds finished: 2020-06-04T21:01:49.219959
Resources for stage fit_on_coadds : 0.170 s worker CPU, 0.170 s worker Wall, Wall: 4.163 s, Cores in use: 0.08, Total efficiency (on 4 cores): 2.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T21:01:49.222974
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 29 potential peaks
Of 29 potential peaks: 19 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept
SED z : 6 new peaks
Found 28 potential peaks
Of 28 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 23 potential peaks
Of 23 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 34 potential peaks
Of 34 potential peaks: 27 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 46 potential peaks
Of 46 potential peaks: 40 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 9 new sources
Median coadd sky for g : 0.00021536983
Median coadd sky for r : 0.00044352727
Median coadd sky for z : 0.001330401
Stage srcs : Wall: 6.03 s, CPU: 5.99 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.454612 MB
Stage srcs finished: 2020-06-04T21:01:55.254873
Resources for stage srcs : 0.100 s worker CPU, 0.103 s worker Wall, Wall: 6.033 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/PGC1903377-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T21:01:58.529395
Blob 1 of 8, id: 3, sources: 2, size: 168x180, npix 16057, brick X: 40,208, Y: 30,210, one pixel: 136 30
Blob 2 of 8, id: 0, sources: 1, size: 56x31, npix 1260, brick X: 148,204, Y: 0,31, one pixel: 153 0
Blob 3 of 8, id: 7, sources: 1, size: 39x26, npix 734, brick X: 194,233, Y: 229,255, one pixel: 214 229
Blob 4 of 8, id: 6, sources: 2, size: 35x41, npix 717, brick X: 89,124, Y: 208,249, one pixel: 110 208
Blob 5 of 8, id: 5, sources: 1, size: 25x23, npix 373, brick X: 212,237, Y: 74,97, one pixel: 223 74
Blob 4 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 959 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146276 MB
Blob 6 of 8, id: 4, sources: 1, size: 25x25, npix 367, brick X: 21,46, Y: 67,92, one pixel: 33 67
Blob 3 finished, total: Wall: 1.30 s, CPU: 1.30 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148468 MB
Blob 7 of 8, id: 2, sources: 1, size: 21x24, npix 321, brick X: 48,69, Y: 28,52, one pixel: 56 28
Blob 6 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148468 MB
Blob 8 of 8, id: 1, sources: 1, size: 20x21, npix 247, brick X: 5,25, Y: 21,42, one pixel: 15 21
Blob 2 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148416 MB
Blob 5 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 959 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146276 MB
Blob 8 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148416 MB
Blob 7 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148468 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.584541, ee1=-0.023388, ee2=-0.282931
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 9.38 s, CPU: 9.37 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150512 MB
Old catalog: 12
New catalog: 14
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/blobs-custom-176727p30428.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/metrics/cus/all-models-custom-176727p30428.fits
Stage fitblobs : Wall: 14.49 s, CPU: 4.80 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.454612 MB
Stage fitblobs finished: 2020-06-04T21:02:13.020855
Resources for stage fitblobs : 14.907 s worker CPU, 14.946 s worker Wall, Wall: 14.493 s, Cores in use: 1.36, Total efficiency (on 4 cores): 34.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T21:02:13.022746
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/tmp-legacysurvey-custom-176727p30428-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/tmp-legacysurvey-custom-176727p30428-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/tmp-legacysurvey-custom-176727p30428-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/tmp-legacysurvey-custom-176727p30428-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-resid.jpg
Stage coadds : Wall: 13.57 s, CPU: 4.36 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.454612 MB
Stage coadds finished: 2020-06-04T21:02:26.593266
Resources for stage coadds : 2.173 s worker CPU, 2.320 s worker Wall, Wall: 13.571 s, Cores in use: 0.48, Total efficiency (on 4 cores): 12.0 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T21:02:26.594845
Cut to 1 unWISE tiles
Reading WISE tile 1773p302 band 1
Reading WISE tile 1773p302 band 2
Reading WISE tile 1773p302 band 3
Reading WISE tile 1773p302 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 964 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210048 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.189176 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 966 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210068 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/177/1773p302/unwise-1773p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 959 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206012 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/tmp-legacysurvey-custom-176727p30428-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/tmp-legacysurvey-custom-176727p30428-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 6.80 s, CPU: 3.60 s, VmPeak: 1026 MB, VmSize: 1014 MB, VmRSS: 199 MB, VmData: 227 MB, maxrss: 0.454612 MB
Stage wise_forced finished: 2020-06-04T21:02:33.399594
Resources for stage wise_forced : 3.909 s worker CPU, 6.978 s worker Wall, Wall: 6.806 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.6 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T21:02:33.401243
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/coadd/cus/custom-176727p30428/legacysurvey-custom-176727p30428-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/tractor-i/cus/tractor-custom-176727p30428.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/tractor/cus/tractor-custom-176727p30428.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/176/PGC1903377/tractor/cus/brick-custom-176727p30428.sha256sum
Stage writecat : Wall: 5.14 s, CPU: 4.91 s, VmPeak: 1146 MB, VmSize: 1018 MB, VmRSS: 201 MB, VmData: 227 MB, maxrss: 0.454612 MB
Stage writecat finished: 2020-06-04T21:02:38.541486
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.141 s, Cores in use: 0.96, Total efficiency (on 4 cores): 23.9 %
Stage writecat finished
All done: 27.512 s worker CPU, 387.427 s worker Wall, Wall: 193.939 s, Cores in use: 0.42, Total efficiency (on 4 cores): 10.5 %
Finished galaxy PGC1903377 in 3.452 minutes.