Started working on galaxy PGC1514118 at Fri Jun  5 10:20:50 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.7541535 16.6675529 --width 307 --height 307 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T10:20:51.687907
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.7541535', '16.6675529', '--width', '307', '--height', '307', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.7541535 16.6675529 --width 307 --height 307 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 267.7541535 16.6675529
Starting process 12815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 12816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 12818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 12817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T10:20:52.065236
Keeping 11 CCDs:
   c4d_170820_012726_ooi_g_ls9.fits.fz c4d_170820_012726_ooi_g_ls9-N28 g exptime 200.0 propid 2014B-0404 seeing 2.11 MJD 57985.061 object DECaLS_31204_g
   c4d_160804_014918_ooi_r_ls9.fits.fz c4d_160804_014918_ooi_r_ls9-N28 r exptime 73.0 propid 2014B-0404 seeing 1.21 MJD 57604.074 object DECaLS_31204_r
   c4d_180619_060641_ooi_g_ls9.fits.fz c4d_180619_060641_ooi_g_ls9-N28 g exptime 200.0 propid 2014B-0404 seeing 1.49 MJD 58288.255 object DECaLS_31204_g
   c4d_160724_044143_ooi_z_ls9.fits.fz c4d_160724_044143_ooi_z_ls9-N28 z exptime 114.0 propid 2016A-0190 seeing 1.48 MJD 57593.194 object DECaLS_31204_z
   c4d_160804_015103_ooi_r_ls9.fits.fz c4d_160804_015103_ooi_r_ls9-S1 r exptime 75.0 propid 2014B-0404 seeing 1.37 MJD 57604.076 object DECaLS_31203_r
   c4d_180514_075741_ooi_g_ls9.fits.fz c4d_180514_075741_ooi_g_ls9-N28 g exptime 200.0 propid 2014B-0404 seeing 1.35 MJD 58252.332 object DECaLS_47076_g
   c4d_180514_080131_ooi_r_ls9.fits.fz c4d_180514_080131_ooi_r_ls9-N28 r exptime 175.0 propid 2014B-0404 seeing 1.22 MJD 58252.334 object DECaLS_47076_r
   c4d_160722_053128_ooi_z_ls9.fits.fz c4d_160722_053128_ooi_z_ls9-N28 z exptime 224.0 propid 2016A-0190 seeing 1.52 MJD 57591.227 object DECaLS_47076_z
   c4d_170724_033018_ooi_g_ls9.fits.fz c4d_170724_033018_ooi_g_ls9-N28 g exptime 200.0 propid 2014B-0404 seeing 1.95 MJD 57958.143 object DECaLS_47076_g
   c4d_160804_015103_ooi_r_ls9.fits.fz c4d_160804_015103_ooi_r_ls9-S8 r exptime 75.0 propid 2014B-0404 seeing 1.37 MJD 57604.076 object DECaLS_31203_r
   c4d_160724_043921_ooi_z_ls9.fits.fz c4d_160724_043921_ooi_z_ls9-S8 z exptime 138.0 propid 2016A-0190 seeing 1.56 MJD 57593.192 object DECaLS_31203_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b419-z-20160724T043858_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180619T060641_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160804T014716_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521c06-g-20170820T012726_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160804T014858_oi[S1,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180514T075741_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f216-g-20170724T032606_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160804T014858_oi[S8,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c242-z-20160722T052655_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955fb7b-r-20180514T080131_oi[N28,noinherit][2046,4094][real]: DECaLS_
WARNING: image median 0.004339379 is more than 1 sigma away from zero!
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b419-z-20160724T043611_oi[S8,noinherit][2046,4094][real]: DECaLS_3
Stage tims : Wall: 62.01 s, CPU: 1.08 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.450052 MB
Stage tims finished: 2020-06-05T10:21:54.075150
WARNING: image median 0.009367189 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530e3b-g-20180619T060641_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f4fa-g-20180514T075741_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160804T014858_oi[S8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9521c06-g-20170820T012726_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c242-z-20160722T052655_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: image median 0.024255743 is more than 1 sigma away from zero!
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160804T014716_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_955fb7b-r-20180514T080131_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b419-z-20160724T043858_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9566d23-r-20160804T014858_oi[S1,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951f216-g-20170724T032606_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954b419-z-20160724T043611_oi[S8,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Resources for stage tims : 4.763 s worker CPU, 209.879 s worker Wall, Wall: 62.011 s, Cores in use: 0.09, Total efficiency (on 4 cores): 2.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T10:21:54.749584
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04511.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04255.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04383.fits
Matched 7 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/reference-custom-267754p16667.fits
Stage refs : Wall: 12.97 s, CPU: 12.19 s, VmPeak: 1124 MB, VmSize: 1118 MB, VmRSS: 301 MB, VmData: 332 MB, maxrss: 0.450052 MB
Stage refs finished: 2020-06-05T10:22:07.723020
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.974 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.5 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T10:22:07.724490
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/outlier-mask-custom-267754p16667.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/outliers-pre-custom-267754p16667.jpg
Image c4d_180514_080131_ooi_r_ls9-N28 r : masking 376 positive outlier pixels and 0 negative outlier pixels
Image c4d_160804_014918_ooi_r_ls9-N28 r : masking 516 positive outlier pixels and 0 negative outlier pixels
Image c4d_160724_044143_ooi_z_ls9-N28 z : masking 225 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/outlier-mask-custom-267754p16667.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/outliers-post-custom-267754p16667.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/outliers-masked-pos-custom-267754p16667.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/outliers-masked-neg-custom-267754p16667.jpg
Stage outliers : Wall: 3.66 s, CPU: 3.30 s, VmPeak: 1128 MB, VmSize: 1128 MB, VmRSS: 316 MB, VmData: 345 MB, maxrss: 0.450052 MB
Stage outliers finished: 2020-06-05T10:22:11.383104
Resources for stage outliers : 1.208 s worker CPU, 1.263 s worker Wall, Wall: 3.660 s, Cores in use: 1.23, Total efficiency (on 4 cores): 30.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T10:22:11.384950
Stage halos : Wall: 5.28 s, CPU: 3.74 s, VmPeak: 1128 MB, VmSize: 1128 MB, VmRSS: 316 MB, VmData: 345 MB, maxrss: 0.450052 MB
Stage halos finished: 2020-06-05T10:22:16.661506
Resources for stage halos : 0.823 s worker CPU, 5.920 s worker Wall, Wall: 5.278 s, Cores in use: 0.87, Total efficiency (on 4 cores): 21.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T10:22:16.663713
PSF sigmas in coadd pixels: ['3.43', '2.43', '2.18', '3.17']
Using average PSF sigma 2.8025980695410997
Gaussian PSF norm 0.10065474419600548 vs pixelized 0.08081029
average tim pixel scale / coadd scale: 1.0011812431190361
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.97', '2.22', '1.97', '2.23']
Using average PSF sigma 2.0995310102222313
Gaussian PSF norm 0.13436085983031942 vs pixelized 0.11386571
average tim pixel scale / coadd scale: 1.0011585737900268
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.40', '2.47', '2.54']
Using average PSF sigma 2.467388923363473
Gaussian PSF norm 0.11432927703563438 vs pixelized 0.09437591
average tim pixel scale / coadd scale: 1.0012612564361276
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 7.68 s, CPU: 0.21 s, VmPeak: 1128 MB, VmSize: 1128 MB, VmRSS: 318 MB, VmData: 345 MB, maxrss: 0.450052 MB
Stage fit_on_coadds finished: 2020-06-05T10:22:24.345753
Resources for stage fit_on_coadds : 0.253 s worker CPU, 0.261 s worker Wall, Wall: 7.683 s, Cores in use: 0.06, Total efficiency (on 4 cores): 1.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T10:22:24.348694
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 73 potential peaks
Of 73 potential peaks: 27 in veto map, 9 cut by saddle test, 0 cut by aper test, 37 kept
SED z : 37 new peaks
Found 78 potential peaks
Of 78 potential peaks: 63 in veto map, 11 cut by saddle test, 0 cut by aper test, 4 kept
SED r : 4 new peaks
Found 57 potential peaks
Of 57 potential peaks: 50 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 76 potential peaks
Of 76 potential peaks: 69 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 77 potential peaks
Of 77 potential peaks: 70 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 46 new sources
Median coadd sky for g : 4.2372016e-05
Median coadd sky for r : 0.00017305974
Median coadd sky for z : -0.00041060767
Stage srcs : Wall: 3.34 s, CPU: 3.28 s, VmPeak: 1128 MB, VmSize: 1128 MB, VmRSS: 318 MB, VmData: 345 MB, maxrss: 0.450052 MB
Stage srcs finished: 2020-06-05T10:22:27.689447
Resources for stage srcs : 0.165 s worker CPU, 0.180 s worker Wall, Wall: 3.342 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/PGC1514118-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T10:22:28.252743
Blob 1 of 4, id: 1, sources: 65, size: 307x307, npix 67406, brick X: 0,307, Y: 0,307, one pixel: 292 0
Blob 2 of 4, id: 0, sources: 10, size: 106x70, npix 3199, brick X: 114,220, Y: 0,70, one pixel: 121 0
Blob 3 of 4, id: 2, sources: 1, size: 23x22, npix 283, brick X: 153,176, Y: 44,66, one pixel: 162 44
Blob 4 of 4, id: 3, sources: 1, size: 21x21, npix 269, brick X: 214,235, Y: 75,96, one pixel: 222 75
Blob 4 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 963 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147628 MB
Blob 3 finished, total: Wall: 0.44 s, CPU: 0.43 s, VmPeak: 960 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147256 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.75336, 16.65569), pm (-0.3, -3.6), parallax 0.157 with NanoMaggies: g=19, r=18.7, z=18.1
Reset brightness to NanoMaggies: g=18.8, r=18.3, z=18.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.75549, 16.65624), pm (-9.9, -14.7), parallax 1.534 with NanoMaggies: g=21.5, r=20.1, z=18
Reset brightness to NanoMaggies: g=21.6, r=20.1, z=18.2
Blob 2 finished, total: Wall: 3.06 s, CPU: 3.06 s, VmPeak: 964 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14764 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.76850, 16.67291), pm (1.2, -6.9), parallax 0.801 with NanoMaggies: g=15.9, r=15.3, z=15.1
Reset brightness to NanoMaggies: g=15.9, r=15.3, z=15.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.76313, 16.67923), pm (-9.5, 9.0), parallax 0.221 with NanoMaggies: g=17.1, r=16.7, z=16.6
Reset brightness to NanoMaggies: g=17.4, r=17, z=16.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.46041, ee1=0.271322, ee2=-0.78392
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.76848, 16.67730), pm (-4.3, -1.4), parallax 0.238 with NanoMaggies: g=18.8, r=18.1, z=17.9
Reset brightness to NanoMaggies: g=18.8, r=18.1, z=17.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.76639, 16.67537), pm (-0.0, -5.2), parallax 0.291 with NanoMaggies: g=19.8, r=18.6, z=16.9
Reset brightness to NanoMaggies: g=19.7, r=18.4, z=17.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.75586, 16.68127), pm (-3.4, -9.4), parallax -0.163 with NanoMaggies: g=19.4, r=18.6, z=18.3
Reset brightness to NanoMaggies: g=19.4, r=18.6, z=18.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (267.76589, 16.67092), pm (0.1, -1.4), parallax 0.296 with NanoMaggies: g=21.2, r=20.1, z=20.4
Reset brightness to NanoMaggies: g=19.9, r=19.7, z=19.7
Measuring 16 iterative sources
Blob 1 finished, total: Wall: 48.19 s, CPU: 48.18 s, VmPeak: 961 MB, VmSize: 761 MB, VmRSS: 196 MB, VmData: 224 MB, maxrss: 0.201104 MB
Old catalog: 84
New catalog: 86
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/blobs-custom-267754p16667.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/metrics/cus/all-models-custom-267754p16667.fits
Stage fitblobs : Wall: 50.86 s, CPU: 2.57 s, VmPeak: 1128 MB, VmSize: 1128 MB, VmRSS: 321 MB, VmData: 348 MB, maxrss: 0.450052 MB
Stage fitblobs finished: 2020-06-05T10:23:19.108521
Resources for stage fitblobs : 52.155 s worker CPU, 52.202 s worker Wall, Wall: 50.858 s, Cores in use: 1.08, Total efficiency (on 4 cores): 26.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T10:23:19.111095
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/tmp-legacysurvey-custom-267754p16667-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/tmp-legacysurvey-custom-267754p16667-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/tmp-legacysurvey-custom-267754p16667-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/tmp-legacysurvey-custom-267754p16667-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-resid.jpg
Stage coadds : Wall: 2.02 s, CPU: 0.67 s, VmPeak: 1128 MB, VmSize: 1128 MB, VmRSS: 322 MB, VmData: 348 MB, maxrss: 0.450052 MB
Stage coadds finished: 2020-06-05T10:23:21.127071
Resources for stage coadds : 4.260 s worker CPU, 4.413 s worker Wall, Wall: 2.017 s, Cores in use: 2.45, Total efficiency (on 4 cores): 61.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T10:23:21.128739
Cut to 1 unWISE tiles
Reading WISE tile 2672p166 band 2
Reading WISE tile 2672p166 band 1
Reading WISE tile 2672p166 band 3
Reading WISE tile 2672p166 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.39 s, CPU: 0.93 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 156 MB, VmData: 191 MB, maxrss: 0.194356 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.54 s, CPU: 0.86 s, VmPeak: 1020 MB, VmSize: 1020 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.233064 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.19 s, CPU: 0.45 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.21434 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2672p166/unwise-2672p166-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.25 s, CPU: 0.54 s, VmPeak: 1128 MB, VmSize: 1000 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.21452 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/tmp-legacysurvey-custom-267754p16667-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/tmp-legacysurvey-custom-267754p16667-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.71 s, CPU: 0.65 s, VmPeak: 1128 MB, VmSize: 1128 MB, VmRSS: 322 MB, VmData: 348 MB, maxrss: 0.450052 MB
Stage wise_forced finished: 2020-06-05T10:23:24.840884
Resources for stage wise_forced : 7.007 s worker CPU, 9.670 s worker Wall, Wall: 3.714 s, Cores in use: 2.06, Total efficiency (on 4 cores): 51.6 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T10:23:24.843137
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/coadd/cus/custom-267754p16667/legacysurvey-custom-267754p16667-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/tractor-i/cus/tractor-custom-267754p16667.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/tractor/cus/tractor-custom-267754p16667.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/267/PGC1514118/tractor/cus/brick-custom-267754p16667.sha256sum
Stage writecat : Wall: 0.96 s, CPU: 0.82 s, VmPeak: 1260 MB, VmSize: 1132 MB, VmRSS: 324 MB, VmData: 348 MB, maxrss: 0.463136 MB
Stage writecat finished: 2020-06-05T10:23:25.804601
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.963 s, Cores in use: 0.85, Total efficiency (on 4 cores): 21.2 %
Stage writecat finished
All done: 70.635 s worker CPU, 283.791 s worker Wall, Wall: 153.745 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.1 %
Finished galaxy PGC1514118 in 2.596 minutes.