Started working on galaxy PGC937410 at Sun Jun  7 08:05:57 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.006833 -13.482472199999998 --width 557 --height 557 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T08:05:58.705130
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.006833', '-13.482472199999998', '--width', '557', '--height', '557', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.006833 -13.482472199999998 --width 557 --height 557 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 313.006833 -13.482472199999998
Starting process 30388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 30389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 30390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 30391 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T08:06:04.455774
Keeping 5 CCDs:
   c4d_180905_000137_ooi_g_ls9.fits.fz c4d_180905_000137_ooi_g_ls9-N16 g exptime 76.0 propid 2014B-0404 seeing 1.26 MJD 58366.001 object DECaLS_50904_g
   c4d_180917_000752_ooi_z_ls9.fits.fz c4d_180917_000752_ooi_z_ls9-N29 z exptime 80.0 propid 2014B-0404 seeing 0.91 MJD 58378.005 object DECaLS_16550_z
   c4d_180908_015740_ooi_r_ls9.fits.fz c4d_180908_015740_ooi_r_ls9-N29 r exptime 40.0 propid 2014B-0404 seeing 1.02 MJD 58369.082 object DECaLS_16550_r
   c4d_180904_003030_ooi_g_ls9.fits.fz c4d_180904_003030_ooi_g_ls9-N29 g exptime 122.0 propid 2014B-0404 seeing 1.40 MJD 58365.021 object DECaLS_16550_g
   c4d_180905_000137_ooi_g_ls9.fits.fz c4d_180905_000137_ooi_g_ls9-N10 g exptime 76.0 propid 2014B-0404 seeing 1.26 MJD 58366.001 object DECaLS_50904_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180904T003030_oi[N29,noinherit][2046,4094][real]: DECaLS_1655
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953502f-r-20180908T015740_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ebf8-z-20180917T000752_oi[N29,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 69.72 s, CPU: 7.13 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 169 MB, VmData: 203 MB, maxrss: 0.454648 MB
Stage tims finished: 2020-06-07T08:07:14.179348
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953502f-r-20180908T015740_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ebf8-z-20180917T000752_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180904T003030_oi[N29,noinherit][2046,4094][real]: DECaLS_1655 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 2.667 s worker CPU, 142.674 s worker Wall, Wall: 69.725 s, Cores in use: 0.14, Total efficiency (on 4 cores): 3.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T08:07:14.195181
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07599.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07471.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07727.fits
Matched 2 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/reference-custom-313006m13482.fits
Stage refs : Wall: 13.69 s, CPU: 13.30 s, VmPeak: 1069 MB, VmSize: 1062 MB, VmRSS: 240 MB, VmData: 271 MB, maxrss: 0.454648 MB
Stage refs finished: 2020-06-07T08:07:27.880457
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 13.686 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T08:07:27.881873
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outlier-mask-custom-313006m13482.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-pre-custom-313006m13482.jpg
Image c4d_180904_003030_ooi_g_ls9-N29 g : masking 581 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outlier-mask-custom-313006m13482.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-post-custom-313006m13482.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-masked-pos-custom-313006m13482.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-masked-neg-custom-313006m13482.jpg
Stage outliers : Wall: 7.58 s, CPU: 7.37 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 260 MB, VmData: 291 MB, maxrss: 0.454648 MB
Stage outliers finished: 2020-06-07T08:07:35.459547
Resources for stage outliers : 0.466 s worker CPU, 0.477 s worker Wall, Wall: 7.579 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T08:07:35.461424
Stage halos : Wall: 8.45 s, CPU: 6.62 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 260 MB, VmData: 291 MB, maxrss: 0.454648 MB
Stage halos finished: 2020-06-07T08:07:43.912848
Resources for stage halos : 0.225 s worker CPU, 5.163 s worker Wall, Wall: 8.453 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T08:07:43.914954
PSF sigmas in coadd pixels: ['2.05', '2.28', '2.04']
Using average PSF sigma 2.122793024814776
Gaussian PSF norm 0.13288850513275655 vs pixelized 0.106998116
average tim pixel scale / coadd scale: 1.001060140081006
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.66']
Using average PSF sigma 1.6554372469523686
Gaussian PSF norm 0.1704050046555433 vs pixelized 0.1350524
average tim pixel scale / coadd scale: 1.0010195835600144
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48']
Using average PSF sigma 1.481675840348115
Gaussian PSF norm 0.19038900688803898 vs pixelized 0.14960453
average tim pixel scale / coadd scale: 1.000974594814461
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.13 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 262 MB, VmData: 291 MB, maxrss: 0.454648 MB
Stage fit_on_coadds finished: 2020-06-07T08:07:44.079916
Resources for stage fit_on_coadds : 0.129 s worker CPU, 0.154 s worker Wall, Wall: 0.166 s, Cores in use: 1.56, Total efficiency (on 4 cores): 39.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T08:07:44.082250
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 244066 potential peaks
Of 244066 potential peaks: 244051 in veto map, 4 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 250267 potential peaks
Of 250267 potential peaks: 250259 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 102310 potential peaks
Of 102310 potential peaks: 102285 in veto map, 9 cut by saddle test, 0 cut by aper test, 16 kept
SED g : 16 new peaks
Found 89882 potential peaks
Of 89882 potential peaks: 89878 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 89901 potential peaks
Of 89901 potential peaks: 89897 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 3.8432554e-05
Median coadd sky for r : 0.00054974627
Median coadd sky for z : 0.0006868881
Stage srcs : Wall: 26.16 s, CPU: 8.30 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 272 MB, VmData: 301 MB, maxrss: 0.454648 MB
Stage srcs finished: 2020-06-07T08:08:10.244358
Resources for stage srcs : 36.101 s worker CPU, 36.103 s worker Wall, Wall: 26.163 s, Cores in use: 1.70, Total efficiency (on 4 cores): 42.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T08:08:10.267144
Blob 1 of 6, id: 0, sources: 66, size: 557x557, npix 290276, brick X: 0,557, Y: 0,557, one pixel: 0 0
Blob 2 of 6, id: 5, sources: 1, size: 51x41, npix 1624, brick X: 431,482, Y: 516,557, one pixel: 452 516
Blob 3 of 6, id: 3, sources: 1, size: 33x32, npix 707, brick X: 483,516, Y: 496,528, one pixel: 497 496
Blob 4 of 6, id: 1, sources: 1, size: 26x27, npix 447, brick X: 484,510, Y: 460,487, one pixel: 495 460
Blob 5 of 6, id: 2, sources: 1, size: 20x21, npix 239, brick X: 378,398, Y: 487,508, one pixel: 386 487
Blob 2 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 929 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14696 MB
Blob 6 of 6, id: 4, sources: 1, size: 19x18, npix 189, brick X: 386,405, Y: 509,527, one pixel: 394 509
Blob 5 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 929 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14696 MB
Blob 6 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 929 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14696 MB
Blob 4 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 930 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143652 MB
Blob 3 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 935 MB, VmSize: 715 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142548 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.04277, -13.51425), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=13.1, r=12.6, z=12.4
Reset brightness to NanoMaggies: g=13.1, r=12.6, z=12.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.04252, -13.44714), pm (-15.7, -32.0), parallax 2.109 with NanoMaggies: g=13.1, r=12.6, z=12.5
Reset brightness to NanoMaggies: g=13.1, r=12.6, z=12.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01914, -13.48594), pm (-31.5, -33.4), parallax 3.434 with NanoMaggies: g=14.1, r=13.3, z=12.9
Reset brightness to NanoMaggies: g=14.1, r=13.3, z=12.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.06251, ee1=0.660716, ee2=-0.198956
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.03471, -13.46094), pm (4.7, 1.7), parallax 0.560 with NanoMaggies: g=16.7, r=16.3, z=16.1
Reset brightness to NanoMaggies: g=16.7, r=16.3, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00799, -13.47142), pm (-0.3, -7.2), parallax 2.082 with NanoMaggies: g=18.9, r=17.5, z=16.4
Reset brightness to NanoMaggies: g=18.9, r=17.5, z=16.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00612, -13.47226), pm (-2.1, -13.2), parallax 0.112 with NanoMaggies: g=17.7, r=17.2, z=17
Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01945, -13.50664), pm (1.3, -10.5), parallax 0.276 with NanoMaggies: g=17.9, r=17.5, z=17.4
Reset brightness to NanoMaggies: g=17.9, r=17.5, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.02411, -13.47903), pm (3.3, -8.1), parallax 0.669 with NanoMaggies: g=19, r=17.9, z=17.4
Reset brightness to NanoMaggies: g=19, r=17.9, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01566, -13.47879), pm (-15.8, -13.4), parallax 0.195 with NanoMaggies: g=19, r=18.5, z=18.3
Reset brightness to NanoMaggies: g=19, r=18.5, z=18.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00189, -13.48048), pm (4.3, -1.1), parallax 0.907 with NanoMaggies: g=21.1, r=19.7, z=(flux -7.73e+04)
Reset brightness to NanoMaggies: g=21.1, r=19.7, z=18.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00429, -13.48148), pm (-11.7, -4.6), parallax -0.026 with NanoMaggies: g=21.2, r=19.8, z=19
Reset brightness to NanoMaggies: g=21.2, r=19.8, z=19
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (312.99434, -13.50423), pm (13.4, -13.0), parallax 0.356 with NanoMaggies: g=19.6, r=19.9, z=19
Reset brightness to NanoMaggies: g=21.2, r=19.9, z=19
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01557, -13.47597), pm (3.6, -4.9), parallax 1.346 with NanoMaggies: g=20.4, r=19.8, z=19.5
Reset brightness to NanoMaggies: g=20.4, r=19.8, z=19.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (312.98418, -13.49749), pm (2.1, -5.2), parallax 1.846 with NanoMaggies: g=18.3, r=20.4, z=19.6
Reset brightness to NanoMaggies: g=21.7, r=20.4, z=19.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01767, -13.48145), pm (-5.4, -5.5), parallax -0.300 with NanoMaggies: g=21.8, r=20.4, z=19.7
Reset brightness to NanoMaggies: g=21.8, r=20.4, z=19.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01345, -13.48224), pm (-1.9, -5.9), parallax 0.881 with NanoMaggies: g=20.8, r=20.4, z=20.2
Reset brightness to NanoMaggies: g=20.8, r=20.4, z=20.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01508, -13.47450), pm (-0.8, -9.5), parallax 1.934 with NanoMaggies: g=21.4, r=20.7, z=20.4
Reset brightness to NanoMaggies: g=21.4, r=20.7, z=20.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.02779, -13.49478), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22.5, r=20.8, z=20.5
Reset brightness to NanoMaggies: g=21.5, r=20.8, z=20.5
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 55.37 s, CPU: 55.36 s, VmPeak: 908 MB, VmSize: 801 MB, VmRSS: 236 MB, VmData: 264 MB, maxrss: 0.325136 MB
Old catalog: 73
New catalog: 73
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/blobs-custom-313006m13482.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/all-models-custom-313006m13482.fits
Stage fitblobs : Wall: 61.63 s, CPU: 6.05 s, VmPeak: 1072 MB, VmSize: 1072 MB, VmRSS: 285 MB, VmData: 312 MB, maxrss: 0.454648 MB
Stage fitblobs finished: 2020-06-07T08:09:11.895330
Resources for stage fitblobs : 59.025 s worker CPU, 59.057 s worker Wall, Wall: 61.632 s, Cores in use: 1.06, Total efficiency (on 4 cores): 26.4 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T08:09:11.899500
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-resid.jpg
Stage coadds : Wall: 31.50 s, CPU: 13.00 s, VmPeak: 1110 MB, VmSize: 1110 MB, VmRSS: 340 MB, VmData: 367 MB, maxrss: 0.454648 MB
Stage coadds finished: 2020-06-07T08:09:43.399580
Resources for stage coadds : 35.313 s worker CPU, 35.438 s worker Wall, Wall: 31.502 s, Cores in use: 1.53, Total efficiency (on 4 cores): 38.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T08:09:43.402397
Cut to 1 unWISE tiles
Reading WISE tile 3134m137 band 1
Reading WISE tile 3134m137 band 3
Reading WISE tile 3134m137 band 2
Reading WISE tile 3134m137 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.38 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.209736 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.28 s, VmPeak: 1066 MB, VmSize: 1002 MB, VmRSS: 148 MB, VmData: 189 MB, maxrss: 0.210584 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.25 s, CPU: 0.82 s, VmPeak: 1139 MB, VmSize: 1075 MB, VmRSS: 229 MB, VmData: 262 MB, maxrss: 0.325136 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.28 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.205204 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 21.19 s, CPU: 12.45 s, VmPeak: 1110 MB, VmSize: 1073 MB, VmRSS: 305 MB, VmData: 330 MB, maxrss: 0.454648 MB
Stage wise_forced finished: 2020-06-07T08:10:04.588564
Resources for stage wise_forced : 4.568 s worker CPU, 17.566 s worker Wall, Wall: 21.187 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.1 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T08:10:04.590148
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/tractor-i/cus/tractor-custom-313006m13482.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/tractor/cus/tractor-custom-313006m13482.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/tractor/cus/brick-custom-313006m13482.sha256sum
Stage writecat : Wall: 12.68 s, CPU: 12.52 s, VmPeak: 1209 MB, VmSize: 1081 MB, VmRSS: 310 MB, VmData: 334 MB, maxrss: 0.454648 MB
Stage writecat finished: 2020-06-07T08:10:17.274171
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.685 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.7 %
Stage writecat finished
All done: 138.495 s worker CPU, 296.633 s worker Wall, Wall: 252.823 s, Cores in use: 0.89, Total efficiency (on 4 cores): 22.3 %
Finished galaxy PGC937410 in 4.330 minutes.
Started working on galaxy PGC937410 at Sat Jul 18 21:52:27 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.006833 -13.482472199999998 --width 557 --height 557 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T21:52:27.873280
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.006833', '-13.482472199999998', '--width', '557', '--height', '557', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.006833 -13.482472199999998 --width 557 --height 557 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 313.006833 -13.482472199999998
Starting process 7402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 7403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 7404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 7405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059156 MB
Starting process 7406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 7407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 7408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 7409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 7410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 7411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 7412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 7413 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 7414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 7415 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 7416 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 7417 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 7418 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 7419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 7420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 7421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 7422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 7423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 7424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 7425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 7426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 7427 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 7428 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 7429 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 7430 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 7431 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 7432 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 7433 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T21:52:28.582324
Keeping 5 CCDs:
   c4d_180905_000137_ooi_g_ls9.fits.fz c4d_180905_000137_ooi_g_ls9-N16 g exptime 76.0 propid 2014B-0404 seeing 1.26 MJD 58366.001 object DECaLS_50904_g
   c4d_180917_000752_ooi_z_ls9.fits.fz c4d_180917_000752_ooi_z_ls9-N29 z exptime 80.0 propid 2014B-0404 seeing 0.91 MJD 58378.005 object DECaLS_16550_z
   c4d_180908_015740_ooi_r_ls9.fits.fz c4d_180908_015740_ooi_r_ls9-N29 r exptime 40.0 propid 2014B-0404 seeing 1.02 MJD 58369.082 object DECaLS_16550_r
   c4d_180904_003030_ooi_g_ls9.fits.fz c4d_180904_003030_ooi_g_ls9-N29 g exptime 122.0 propid 2014B-0404 seeing 1.40 MJD 58365.021 object DECaLS_16550_g
   c4d_180905_000137_ooi_g_ls9.fits.fz c4d_180905_000137_ooi_g_ls9-N10 g exptime 76.0 propid 2014B-0404 seeing 1.26 MJD 58366.001 object DECaLS_50904_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N10,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N16,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ebf8-z-20180917T000752_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953502f-r-20180908T015740_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180904T003030_oi[N29,noinherit][2046,4094][real]: DECaLS_1655
Stage tims : Wall: 5.76 s, CPU: 1.31 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.227376 MB
Stage tims finished: 2020-07-18T21:52:34.337357
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N10,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9534322-g-20180905T000137_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953502f-r-20180908T015740_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180904T003030_oi[N29,noinherit][2046,4094][real]: DECaLS_1655 [astropy.io.fits.card]
Resources for stage tims : 2.724 s worker CPU, 17.938 s worker Wall, Wall: 5.758 s, Cores in use: 0.70, Total efficiency (on 32 cores): 2.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-18T21:52:34.372708
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07599.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07471.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07727.fits
Matched 2 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/reference-custom-313006m13482.fits
Stage refs : Wall: 5.94 s, CPU: 5.39 s, VmPeak: 1072 MB, VmSize: 1066 MB, VmRSS: 241 MB, VmData: 273 MB, maxrss: 0.247196 MB
Stage refs finished: 2020-07-18T21:52:40.314447
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 5.944 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-refs.p
Running stage outliers
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952ebf8-z-20180917T000752_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage outliers at 2020-07-18T21:52:40.331771
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outlier-mask-custom-313006m13482.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-pre-custom-313006m13482.jpg
Image c4d_180904_003030_ooi_g_ls9-N29 g : masking 581 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outlier-mask-custom-313006m13482.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-post-custom-313006m13482.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-masked-pos-custom-313006m13482.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/outliers-masked-neg-custom-313006m13482.jpg
Stage outliers : Wall: 1.32 s, CPU: 0.86 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 263 MB, VmData: 294 MB, maxrss: 0.269536 MB
Stage outliers finished: 2020-07-18T21:52:41.653863
Resources for stage outliers : 0.525 s worker CPU, 0.674 s worker Wall, Wall: 1.324 s, Cores in use: 1.04, Total efficiency (on 32 cores): 3.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T21:52:41.715943
Stage halos : Wall: 0.67 s, CPU: 0.52 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 263 MB, VmData: 294 MB, maxrss: 0.269792 MB
Stage halos finished: 2020-07-18T21:52:42.383932
Resources for stage halos : 0.266 s worker CPU, 0.419 s worker Wall, Wall: 0.670 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-18T21:52:42.411946
PSF sigmas in coadd pixels: ['2.05', '2.28', '2.04']
Using average PSF sigma 2.122793024814776
Gaussian PSF norm 0.13288850513275655 vs pixelized 0.10699813
average tim pixel scale / coadd scale: 1.001060140081006
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.66']
Using average PSF sigma 1.6554372469523686
Gaussian PSF norm 0.1704050046555433 vs pixelized 0.1350524
average tim pixel scale / coadd scale: 1.0010195835600144
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48']
Using average PSF sigma 1.481675840348115
Gaussian PSF norm 0.19038900688803898 vs pixelized 0.14960453
average tim pixel scale / coadd scale: 1.000974594814461
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.12 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 265 MB, VmData: 294 MB, maxrss: 0.271264 MB
Stage fit_on_coadds finished: 2020-07-18T21:52:42.683702
Resources for stage fit_on_coadds : 0.110 s worker CPU, 0.132 s worker Wall, Wall: 0.274 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T21:52:42.750283
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 244064 potential peaks
Of 244064 potential peaks: 244050 in veto map, 3 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 250265 potential peaks
Of 250265 potential peaks: 250259 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 102312 potential peaks
Of 102312 potential peaks: 102288 in veto map, 8 cut by saddle test, 0 cut by aper test, 16 kept
SED g : 16 new peaks
Found 89880 potential peaks
Of 89880 potential peaks: 89877 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 89898 potential peaks
Of 89898 potential peaks: 89895 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 29 new sources
Median coadd sky for g : 3.8432554e-05
Median coadd sky for r : 0.00054974627
Median coadd sky for z : 0.0006868881
Stage srcs : Wall: 17.33 s, CPU: 1.62 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 274 MB, VmData: 303 MB, maxrss: 0.280656 MB
Stage srcs finished: 2020-07-18T21:53:00.081033
Resources for stage srcs : 31.884 s worker CPU, 31.951 s worker Wall, Wall: 17.333 s, Cores in use: 1.93, Total efficiency (on 32 cores): 6.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T21:53:02.666810
Blob 1 of 6, id: 0, sources: 66, size: 557x557, npix 290276, brick X: 0,557, Y: 0,557, one pixel: 0 0
Blob 2 of 6, id: 5, sources: 1, size: 51x41, npix 1624, brick X: 431,482, Y: 516,557, one pixel: 452 516
Blob 3 of 6, id: 3, sources: 1, size: 33x32, npix 707, brick X: 483,516, Y: 496,528, one pixel: 497 496
Blob 4 of 6, id: 1, sources: 1, size: 26x27, npix 447, brick X: 484,510, Y: 460,487, one pixel: 495 460
Blob 5 of 6, id: 2, sources: 1, size: 20x21, npix 239, brick X: 378,398, Y: 487,508, one pixel: 386 487
Blob 6 of 6, id: 4, sources: 1, size: 19x18, npix 189, brick X: 386,405, Y: 509,527, one pixel: 394 509
Blob 2 finished, total: Wall: 0.09 s, CPU: 0.08 s, VmPeak: 663 MB, VmSize: 663 MB, VmRSS: 89 MB, VmData: 141 MB, maxrss: 0.091304 MB
Blob 5 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 109 MB, VmData: 164 MB, maxrss: 0.11194 MB
Blob 6 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 664 MB, VmSize: 664 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096648 MB
Blob 4 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.092104 MB
Blob 3 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092896 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.04277, -13.51425), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=13.1, r=12.6, z=12.4
Reset brightness to NanoMaggies: g=13.1, r=12.6, z=12.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.04252, -13.44714), pm (-15.7, -32.0), parallax 2.109 with NanoMaggies: g=13.1, r=12.6, z=12.5
Reset brightness to NanoMaggies: g=13.1, r=12.6, z=12.5
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.06251, ee1=0.660715, ee2=-0.198956
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.03471, -13.46094), pm (4.7, 1.7), parallax 0.560 with NanoMaggies: g=16.7, r=16.3, z=16.1
Reset brightness to NanoMaggies: g=16.7, r=16.3, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00799, -13.47142), pm (-0.3, -7.2), parallax 2.082 with NanoMaggies: g=18.9, r=17.5, z=16.4
Reset brightness to NanoMaggies: g=18.9, r=17.5, z=16.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00612, -13.47226), pm (-2.1, -13.2), parallax 0.112 with NanoMaggies: g=17.7, r=17.2, z=17
Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01945, -13.50664), pm (1.3, -10.5), parallax 0.276 with NanoMaggies: g=17.9, r=17.5, z=17.4
Reset brightness to NanoMaggies: g=17.9, r=17.5, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.02411, -13.47903), pm (3.3, -8.1), parallax 0.669 with NanoMaggies: g=19, r=17.9, z=17.4
Reset brightness to NanoMaggies: g=19, r=17.9, z=17.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01566, -13.47879), pm (-15.8, -13.4), parallax 0.195 with NanoMaggies: g=19, r=18.5, z=18.3
Reset brightness to NanoMaggies: g=19, r=18.5, z=18.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00189, -13.48048), pm (4.3, -1.1), parallax 0.907 with NanoMaggies: g=21.1, r=19.7, z=(flux -7.73e+04)
Reset brightness to NanoMaggies: g=21.1, r=19.7, z=18.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.00429, -13.48148), pm (-11.7, -4.6), parallax -0.026 with NanoMaggies: g=21.2, r=19.8, z=19
Reset brightness to NanoMaggies: g=21.2, r=19.8, z=19
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (312.99434, -13.50423), pm (13.4, -13.0), parallax 0.356 with NanoMaggies: g=19.6, r=19.9, z=19
Reset brightness to NanoMaggies: g=21.2, r=19.9, z=19
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01557, -13.47597), pm (3.6, -4.9), parallax 1.346 with NanoMaggies: g=20.4, r=19.8, z=19.5
Reset brightness to NanoMaggies: g=20.4, r=19.8, z=19.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (312.98418, -13.49749), pm (2.1, -5.2), parallax 1.846 with NanoMaggies: g=18.3, r=20.4, z=19.6
Reset brightness to NanoMaggies: g=21.7, r=20.4, z=19.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01767, -13.48145), pm (-5.4, -5.5), parallax -0.300 with NanoMaggies: g=21.8, r=20.4, z=19.7
Reset brightness to NanoMaggies: g=21.8, r=20.4, z=19.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01345, -13.48224), pm (-1.9, -5.9), parallax 0.881 with NanoMaggies: g=20.8, r=20.4, z=20.2
Reset brightness to NanoMaggies: g=20.8, r=20.4, z=20.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.01508, -13.47450), pm (-0.8, -9.5), parallax 1.934 with NanoMaggies: g=21.4, r=20.7, z=20.4
Reset brightness to NanoMaggies: g=21.4, r=20.7, z=20.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.02779, -13.49478), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22.5, r=20.8, z=20.5
Reset brightness to NanoMaggies: g=21.5, r=20.8, z=20.5
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 54.00 s, CPU: 54.00 s, VmPeak: 856 MB, VmSize: 773 MB, VmRSS: 216 MB, VmData: 251 MB, maxrss: 0.304092 MB
Old catalog: 73
New catalog: 73
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/blobs-custom-313006m13482.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/metrics/cus/all-models-custom-313006m13482.fits
Stage fitblobs : Wall: 55.61 s, CPU: 0.89 s, VmPeak: 1076 MB, VmSize: 1042 MB, VmRSS: 252 MB, VmData: 280 MB, maxrss: 0.293776 MB
Stage fitblobs finished: 2020-07-18T21:53:58.273433
Resources for stage fitblobs : 56.595 s worker CPU, 56.640 s worker Wall, Wall: 55.609 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T21:53:58.305703
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-resid.jpg
Stage coadds : Wall: 25.00 s, CPU: 1.41 s, VmPeak: 1076 MB, VmSize: 1074 MB, VmRSS: 301 MB, VmData: 328 MB, maxrss: 0.308136 MB
Stage coadds finished: 2020-07-18T21:54:23.303595
Resources for stage coadds : 80.067 s worker CPU, 94.148 s worker Wall, Wall: 25.001 s, Cores in use: 3.26, Total efficiency (on 32 cores): 10.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T21:54:23.373798
Cut to 1 unWISE tiles
Reading WISE tile 3134m137 band 4
Reading WISE tile 3134m137 band 2
Reading WISE tile 3134m137 band 3
Reading WISE tile 3134m137 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.21 s, CPU: 0.66 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 141 MB, VmData: 188 MB, maxrss: 0.178788 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.40 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 142 MB, VmData: 186 MB, maxrss: 0.203464 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.24 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 141 MB, VmData: 186 MB, maxrss: 0.203408 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134m137/unwise-3134m137-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.22 s, VmPeak: 1059 MB, VmSize: 995 MB, VmRSS: 139 MB, VmData: 188 MB, maxrss: 0.199156 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/tmp-legacysurvey-custom-313006m13482-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.70 s, CPU: 2.46 s, VmPeak: 1076 MB, VmSize: 1037 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.308136 MB
Stage wise_forced finished: 2020-07-18T21:54:28.077697
Resources for stage wise_forced : 4.665 s worker CPU, 5.913 s worker Wall, Wall: 4.706 s, Cores in use: 1.51, Total efficiency (on 32 cores): 4.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T21:54:28.119529
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/coadd/cus/custom-313006m13482/legacysurvey-custom-313006m13482-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/tractor-i/cus/tractor-custom-313006m13482.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/tractor/cus/tractor-custom-313006m13482.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/tractor/cus/brick-custom-313006m13482.sha256sum
Stage writecat : Wall: 3.18 s, CPU: 2.24 s, VmPeak: 1185 MB, VmSize: 1057 MB, VmRSS: 283 MB, VmData: 307 MB, maxrss: 0.420472 MB
Stage writecat finished: 2020-07-18T21:54:31.296200
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 3.180 s, Cores in use: 0.70, Total efficiency (on 32 cores): 2.2 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC937410/PGC937410-largegalaxy-writecat.p
All done: 176.844 s worker CPU, 207.824 s worker Wall, Wall: 122.907 s, Cores in use: 1.58, Total efficiency (on 32 cores): 4.9 %
Finished galaxy PGC937410 in 2.102 minutes.