Started working on galaxy PGC1902859 at Fri Jun  5 16:01:20 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.38071499999995 30.415501000000003 --width 345 --height 345 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T16:01:21.769931
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.38071499999995', '30.415501000000003', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.38071499999995 30.415501000000003 --width 345 --height 345 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 276.38071499999995 30.415501000000003
Starting process 13253 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 13254 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 13255 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 13256 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T16:01:22.113797
Keeping 5 CCDs:
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S12 r exptime 250.0 propid 2014B-0404 seeing 1.59 MJD 57486.381 object DECaLS_18790_r
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S6 r exptime 250.0 propid 2014B-0404 seeing 1.60 MJD 57486.381 object DECaLS_18790_r
   c4d_160408_100855_ooi_z_ls9.fits.fz c4d_160408_100855_ooi_z_ls9-S5 z exptime 201.0 propid 2014B-0404 seeing 1.55 MJD 57486.420 object DECaLS_34662_z
   c4d_160803_022806_ooi_g_ls9.fits.fz c4d_160803_022806_ooi_g_ls9-S6 g exptime 129.0 propid 2014B-0404 seeing 1.50 MJD 57603.101 object DECaLS_18790_g
   c4d_160408_100855_ooi_z_ls9.fits.fz c4d_160408_100855_ooi_z_ls9-S12 z exptime 201.0 propid 2014B-0404 seeing 1.55 MJD 57486.420 object DECaLS_34662_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S12,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 61.40 s, CPU: 0.85 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 168 MB, VmData: 202 MB, maxrss: 0.450524 MB
Stage tims finished: 2020-06-05T16:02:23.514544
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 2.903 s worker CPU, 152.569 s worker Wall, Wall: 61.402 s, Cores in use: 0.06, Total efficiency (on 4 cores): 1.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T16:02:23.525539
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02978.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03106.fits
Matched 24 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/reference-custom-276380p30415.fits
Stage refs : Wall: 10.19 s, CPU: 9.20 s, VmPeak: 1120 MB, VmSize: 1114 MB, VmRSS: 290 MB, VmData: 321 MB, maxrss: 0.450524 MB
Stage refs finished: 2020-06-05T16:02:33.714816
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.190 s, Cores in use: 0.90, Total efficiency (on 4 cores): 22.6 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T16:02:33.716220
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outlier-mask-custom-276380p30415.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-pre-custom-276380p30415.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outlier-mask-custom-276380p30415.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-post-custom-276380p30415.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-masked-pos-custom-276380p30415.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-masked-neg-custom-276380p30415.jpg
Stage outliers : Wall: 0.45 s, CPU: 0.30 s, VmPeak: 1124 MB, VmSize: 1124 MB, VmRSS: 304 MB, VmData: 332 MB, maxrss: 0.450524 MB
Stage outliers finished: 2020-06-05T16:02:34.165940
Resources for stage outliers : 0.183 s worker CPU, 0.183 s worker Wall, Wall: 0.451 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.7 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T16:02:34.167327
Stage halos : Wall: 0.64 s, CPU: 0.15 s, VmPeak: 1124 MB, VmSize: 1124 MB, VmRSS: 304 MB, VmData: 332 MB, maxrss: 0.450524 MB
Stage halos finished: 2020-06-05T16:02:34.811439
Resources for stage halos : 0.169 s worker CPU, 1.470 s worker Wall, Wall: 0.645 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T16:02:34.813495
PSF sigmas in coadd pixels: ['2.44']
Using average PSF sigma 2.4398160029651623
Gaussian PSF norm 0.11562133842512802 vs pixelized 0.10542634
average tim pixel scale / coadd scale: 1.0013475015276032
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.58', '2.60']
Using average PSF sigma 2.587724928452231
Gaussian PSF norm 0.10901266540049317 vs pixelized 0.09606614
average tim pixel scale / coadd scale: 1.0014733700401626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.51']
Using average PSF sigma 2.514509627260593
Gaussian PSF norm 0.11218680124172102 vs pixelized 0.0966841
average tim pixel scale / coadd scale: 1.0013681963505578
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.10 s, CPU: 0.07 s, VmPeak: 1124 MB, VmSize: 1124 MB, VmRSS: 305 MB, VmData: 332 MB, maxrss: 0.450524 MB
Stage fit_on_coadds finished: 2020-06-05T16:02:34.910103
Resources for stage fit_on_coadds : 0.049 s worker CPU, 0.049 s worker Wall, Wall: 0.097 s, Cores in use: 1.19, Total efficiency (on 4 cores): 29.8 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T16:02:34.911860
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 71133 potential peaks
Of 71133 potential peaks: 71119 in veto map, 6 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 69437 potential peaks
Of 69437 potential peaks: 69423 in veto map, 4 cut by saddle test, 0 cut by aper test, 10 kept
SED r : 10 new peaks
Found 3665 potential peaks
Of 3665 potential peaks: 3640 in veto map, 12 cut by saddle test, 0 cut by aper test, 13 kept
SED g : 13 new peaks
Found 309 potential peaks
Of 309 potential peaks: 307 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 304 potential peaks
Of 304 potential peaks: 301 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 31 new sources
Median coadd sky for g : 0.00014304562
Median coadd sky for r : 0.0005068806
Median coadd sky for z : 0.00061878155
Stage srcs : Wall: 3.06 s, CPU: 0.75 s, VmPeak: 1124 MB, VmSize: 1124 MB, VmRSS: 306 MB, VmData: 333 MB, maxrss: 0.450524 MB
Stage srcs finished: 2020-06-05T16:02:37.972942
Resources for stage srcs : 3.645 s worker CPU, 3.646 s worker Wall, Wall: 3.062 s, Cores in use: 1.43, Total efficiency (on 4 cores): 35.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T16:02:37.989045
Blob 1 of 2, id: 0, sources: 65, size: 345x345, npix 109940, brick X: 0,345, Y: 0,345, one pixel: 13 0
Blob 2 of 2, id: 1, sources: 1, size: 32x24, npix 577, brick X: 307,339, Y: 0,24, one pixel: 312 0
Blob 2 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 960 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 176 MB, maxrss: 0.140524 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.37884, 30.37087), pm (6.9, -22.7), parallax 2.751 with NanoMaggies: g=11.4, r=10.8, z=10.6
Reset brightness to NanoMaggies: g=11.4, r=10.8, z=10.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.39212, 30.44361), pm (24.1, 5.8), parallax 2.685 with NanoMaggies: g=13.1, r=12.7, z=12.5
Reset brightness to NanoMaggies: g=13.1, r=12.7, z=12.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.38131, 30.43967), pm (1.0, 12.0), parallax 1.035 with NanoMaggies: g=15.4, r=14.8, z=14.6
Reset brightness to NanoMaggies: g=15.4, r=14.8, z=14.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.40012, 30.43719), pm (1.2, -7.4), parallax 0.886 with NanoMaggies: g=15.5, r=14.9, z=14.7
Reset brightness to NanoMaggies: g=15.5, r=14.9, z=14.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.39236, 30.40268), pm (-0.1, -25.5), parallax 2.408 with NanoMaggies: g=17.3, r=16.2, z=15.3
Reset brightness to NanoMaggies: g=17.2, r=15.8, z=14.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.37427, 30.39977), pm (-1.9, -2.1), parallax 0.006 with NanoMaggies: g=15.9, r=15.5, z=15.4
Reset brightness to NanoMaggies: g=15.9, r=15.5, z=15.4
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.28861, ee1=0.172619, ee2=0.115843
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.36574, 30.40699), pm (-3.9, -7.1), parallax 0.204 with NanoMaggies: g=19.3, r=18.6, z=18.2
Reset brightness to NanoMaggies: g=18.5, r=17.9, z=17.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.39796, 30.42388), pm (-1.4, -3.1), parallax -0.066 with NanoMaggies: g=(flux -2.59e+04), r=18.2, z=17.9
Reset brightness to NanoMaggies: g=19, r=18.2, z=17.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.36339, 30.41559), pm (-3.6, -9.9), parallax 0.388 with NanoMaggies: g=20.9, r=19.6, z=18.8
Reset brightness to NanoMaggies: g=20.9, r=19.6, z=18.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.37158, 30.42918), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.8, r=(flux -63.8), z=19.4
Reset brightness to NanoMaggies: g=20.8, r=19.8, z=19.4
Measuring 24 iterative sources
Blob 1 finished, total: Wall: 56.16 s, CPU: 56.16 s, VmPeak: 947 MB, VmSize: 724 MB, VmRSS: 156 MB, VmData: 187 MB, maxrss: 0.2045 MB
Old catalog: 68
New catalog: 85
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/blobs-custom-276380p30415.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/all-models-custom-276380p30415.fits
Stage fitblobs : Wall: 57.12 s, CPU: 0.37 s, VmPeak: 1124 MB, VmSize: 1124 MB, VmRSS: 311 MB, VmData: 337 MB, maxrss: 0.450524 MB
Stage fitblobs finished: 2020-06-05T16:03:35.104939
Resources for stage fitblobs : 56.742 s worker CPU, 56.753 s worker Wall, Wall: 57.118 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T16:03:35.107449
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-resid.jpg
Stage coadds : Wall: 4.77 s, CPU: 1.31 s, VmPeak: 1124 MB, VmSize: 1124 MB, VmRSS: 316 MB, VmData: 342 MB, maxrss: 0.450524 MB
Stage coadds finished: 2020-06-05T16:03:39.879732
Resources for stage coadds : 7.019 s worker CPU, 7.126 s worker Wall, Wall: 4.773 s, Cores in use: 1.74, Total efficiency (on 4 cores): 43.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T16:03:39.881312
Cut to 1 unWISE tiles
Reading WISE tile 2765p302 band 1
Reading WISE tile 2765p302 band 2
Reading WISE tile 2765p302 band 3
Reading WISE tile 2765p302 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.42 s, CPU: 0.61 s, VmPeak: 1063 MB, VmSize: 999 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.2094 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.72 s, CPU: 1.21 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 165 MB, VmData: 200 MB, maxrss: 0.210004 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.36 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 142 MB, VmData: 184 MB, maxrss: 0.2034 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.29 s, CPU: 0.45 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 144 MB, VmData: 187 MB, maxrss: 0.20476 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.73 s, CPU: 1.13 s, VmPeak: 1124 MB, VmSize: 1124 MB, VmRSS: 317 MB, VmData: 342 MB, maxrss: 0.450524 MB
Stage wise_forced finished: 2020-06-05T16:03:43.613874
Resources for stage wise_forced : 6.075 s worker CPU, 8.293 s worker Wall, Wall: 3.734 s, Cores in use: 1.93, Total efficiency (on 4 cores): 48.3 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T16:03:43.615468
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/tractor-i/cus/tractor-custom-276380p30415.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/tractor/cus/tractor-custom-276380p30415.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/tractor/cus/brick-custom-276380p30415.sha256sum
Stage writecat : Wall: 1.93 s, CPU: 1.79 s, VmPeak: 1256 MB, VmSize: 1128 MB, VmRSS: 319 MB, VmData: 343 MB, maxrss: 0.4578 MB
Stage writecat finished: 2020-06-05T16:03:45.541916
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.927 s, Cores in use: 0.93, Total efficiency (on 4 cores): 23.2 %
Stage writecat finished
All done: 76.788 s worker CPU, 230.091 s worker Wall, Wall: 143.433 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Finished galaxy PGC1902859 in 2.427 minutes.
Started working on galaxy PGC1902859 at Sat Jul 18 21:00:23 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.38071499999995 30.415501000000003 --width 345 --height 345 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T21:00:24.645680
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.38071499999995', '30.415501000000003', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.38071499999995 30.415501000000003 --width 345 --height 345 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 276.38071499999995 30.415501000000003
Starting process 35734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 35735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 35736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 35737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB
Starting process 35738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB
Starting process 35739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB
Starting process 35740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 35741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 35742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 35743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 35744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 35745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 35746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 35747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 35748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 35749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 35750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 35751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 35752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 35753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 35754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 35755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 35756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 35757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 35758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 35759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 35760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 35761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 35763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 35764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 35762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 35765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T21:00:25.335474
Keeping 5 CCDs:
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S12 r exptime 250.0 propid 2014B-0404 seeing 1.59 MJD 57486.381 object DECaLS_18790_r
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S6 r exptime 250.0 propid 2014B-0404 seeing 1.60 MJD 57486.381 object DECaLS_18790_r
   c4d_160408_100855_ooi_z_ls9.fits.fz c4d_160408_100855_ooi_z_ls9-S5 z exptime 201.0 propid 2014B-0404 seeing 1.55 MJD 57486.420 object DECaLS_34662_z
   c4d_160803_022806_ooi_g_ls9.fits.fz c4d_160803_022806_ooi_g_ls9-S6 g exptime 129.0 propid 2014B-0404 seeing 1.50 MJD 57603.101 object DECaLS_18790_g
   c4d_160408_100855_ooi_z_ls9.fits.fz c4d_160408_100855_ooi_z_ls9-S12 z exptime 201.0 propid 2014B-0404 seeing 1.55 MJD 57486.420 object DECaLS_34662_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S6,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3
Stage tims : Wall: 4.83 s, CPU: 0.93 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 169 MB, VmData: 203 MB, maxrss: 0.192092 MB
Stage tims finished: 2020-07-18T21:00:30.168112
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S6,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Resources for stage tims : 2.525 s worker CPU, 14.369 s worker Wall, Wall: 4.835 s, Cores in use: 0.72, Total efficiency (on 32 cores): 2.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-07-18T21:00:30.182437
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02978.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03106.fits
Matched 24 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/reference-custom-276380p30415.fits
Stage refs : Wall: 12.61 s, CPU: 10.01 s, VmPeak: 1123 MB, VmSize: 1118 MB, VmRSS: 292 MB, VmData: 324 MB, maxrss: 0.299036 MB
Stage refs finished: 2020-07-18T21:00:42.788555
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 12.609 s, Cores in use: 0.79, Total efficiency (on 32 cores): 2.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-18T21:00:45.453700
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outlier-mask-custom-276380p30415.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-pre-custom-276380p30415.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outlier-mask-custom-276380p30415.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-post-custom-276380p30415.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-masked-pos-custom-276380p30415.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/outliers-masked-neg-custom-276380p30415.jpg
Stage outliers : Wall: 2.57 s, CPU: 0.65 s, VmPeak: 1127 MB, VmSize: 1127 MB, VmRSS: 305 MB, VmData: 334 MB, maxrss: 0.312768 MB
Stage outliers finished: 2020-07-18T21:00:48.019087
Resources for stage outliers : 0.319 s worker CPU, 0.416 s worker Wall, Wall: 2.568 s, Cores in use: 0.38, Total efficiency (on 32 cores): 1.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T21:00:48.748682
Stage halos : Wall: 0.57 s, CPU: 0.42 s, VmPeak: 1127 MB, VmSize: 1127 MB, VmRSS: 305 MB, VmData: 334 MB, maxrss: 0.312812 MB
Stage halos finished: 2020-07-18T21:00:49.315893
Resources for stage halos : 0.237 s worker CPU, 0.360 s worker Wall, Wall: 0.570 s, Cores in use: 1.16, Total efficiency (on 32 cores): 3.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-18T21:00:49.332900
PSF sigmas in coadd pixels: ['2.44']
Using average PSF sigma 2.4398160029651623
Gaussian PSF norm 0.11562133842512802 vs pixelized 0.10542634
average tim pixel scale / coadd scale: 1.0013475015276032
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.58', '2.60']
Using average PSF sigma 2.587724928452231
Gaussian PSF norm 0.10901266540049317 vs pixelized 0.09606614
average tim pixel scale / coadd scale: 1.0014733700401626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.51']
Using average PSF sigma 2.514509627260593
Gaussian PSF norm 0.11218680124172102 vs pixelized 0.0966841
average tim pixel scale / coadd scale: 1.0013681963505578
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.44 s, CPU: 0.07 s, VmPeak: 1127 MB, VmSize: 1127 MB, VmRSS: 307 MB, VmData: 334 MB, maxrss: 0.314284 MB
Stage fit_on_coadds finished: 2020-07-18T21:00:49.772931
Resources for stage fit_on_coadds : 0.059 s worker CPU, 0.085 s worker Wall, Wall: 0.442 s, Cores in use: 0.30, Total efficiency (on 32 cores): 0.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T21:00:50.992471
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 71133 potential peaks
Of 71133 potential peaks: 71119 in veto map, 6 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 69437 potential peaks
Of 69437 potential peaks: 69423 in veto map, 4 cut by saddle test, 0 cut by aper test, 10 kept
SED r : 10 new peaks
Found 3665 potential peaks
Of 3665 potential peaks: 3640 in veto map, 12 cut by saddle test, 0 cut by aper test, 13 kept
SED g : 13 new peaks
Found 309 potential peaks
Of 309 potential peaks: 307 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 304 potential peaks
Of 304 potential peaks: 301 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 31 new sources
Median coadd sky for g : 0.00014304562
Median coadd sky for r : 0.0005068806
Median coadd sky for z : 0.00061878155
Stage srcs : Wall: 3.54 s, CPU: 1.13 s, VmPeak: 1127 MB, VmSize: 1127 MB, VmRSS: 308 MB, VmData: 334 MB, maxrss: 0.315252 MB
Stage srcs finished: 2020-07-18T21:00:54.527806
Resources for stage srcs : 3.785 s worker CPU, 3.814 s worker Wall, Wall: 3.538 s, Cores in use: 1.39, Total efficiency (on 32 cores): 4.3 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T21:00:54.597300
Blob 1 of 2, id: 0, sources: 65, size: 345x345, npix 109940, brick X: 0,345, Y: 0,345, one pixel: 13 0
Blob 2 of 2, id: 1, sources: 1, size: 32x24, npix 577, brick X: 307,339, Y: 0,24, one pixel: 312 0
Blob 2 finished, total: Wall: 0.56 s, CPU: 0.54 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090356 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.37884, 30.37087), pm (6.9, -22.7), parallax 2.751 with NanoMaggies: g=11.4, r=10.8, z=10.6
Reset brightness to NanoMaggies: g=11.4, r=10.8, z=10.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.39212, 30.44361), pm (24.1, 5.8), parallax 2.685 with NanoMaggies: g=13.1, r=12.7, z=12.5
Reset brightness to NanoMaggies: g=13.1, r=12.7, z=12.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.38131, 30.43967), pm (1.0, 12.0), parallax 1.035 with NanoMaggies: g=15.4, r=14.8, z=14.6
Reset brightness to NanoMaggies: g=15.4, r=14.8, z=14.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.40012, 30.43719), pm (1.2, -7.4), parallax 0.886 with NanoMaggies: g=15.5, r=14.9, z=14.7
Reset brightness to NanoMaggies: g=15.5, r=14.9, z=14.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.39236, 30.40268), pm (-0.1, -25.5), parallax 2.408 with NanoMaggies: g=17.3, r=16.2, z=15.3
Reset brightness to NanoMaggies: g=17.2, r=15.8, z=14.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.37427, 30.39977), pm (-1.9, -2.1), parallax 0.006 with NanoMaggies: g=15.9, r=15.5, z=15.4
Reset brightness to NanoMaggies: g=15.9, r=15.5, z=15.4
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.28861, ee1=0.172619, ee2=0.115843
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.36574, 30.40699), pm (-3.9, -7.1), parallax 0.204 with NanoMaggies: g=19.3, r=18.6, z=18.2
Reset brightness to NanoMaggies: g=18.5, r=17.9, z=17.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.39796, 30.42388), pm (-1.4, -3.1), parallax -0.066 with NanoMaggies: g=(flux -2.59e+04), r=18.2, z=17.9
Reset brightness to NanoMaggies: g=19, r=18.2, z=17.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.36339, 30.41559), pm (-3.6, -9.9), parallax 0.388 with NanoMaggies: g=20.9, r=19.6, z=18.8
Reset brightness to NanoMaggies: g=20.9, r=19.6, z=18.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.37158, 30.42918), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.8, r=(flux -63.8), z=19.4
Reset brightness to NanoMaggies: g=20.8, r=19.8, z=19.4
Measuring 9 iterative sources
Blob 1 finished, total: Wall: 51.52 s, CPU: 51.52 s, VmPeak: 952 MB, VmSize: 726 MB, VmRSS: 156 MB, VmData: 188 MB, maxrss: 0.20474 MB
Old catalog: 68
New catalog: 69
T_dup:
tabledata object with 1 rows and 62 columns:
   a_g_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise_sig (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_n_good_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_n_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_params_solved (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   astrometric_sigma5d_max (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_weight_al (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ba (<class 'numpy.ndarray'>) shape (1,) dtype float32
   dec (<class 'numpy.ndarray'>) shape (1,) dtype float64
   dec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_g (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_r (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_z (<class 'numpy.ndarray'>) shape (1,) dtype float32
   donotfit (<class 'numpy.ndarray'>) shape (1,) dtype bool
   duplicated_source (<class 'numpy.ndarray'>) shape (1,) dtype bool
   e_bp_min_rp_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   freezeparams (<class 'numpy.ndarray'>) shape (1,) dtype bool
   hmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ibx (<class 'numpy.ndarray'>) shape (1,) dtype int32
   iby (<class 'numpy.ndarray'>) shape (1,) dtype int32
   in_bounds (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isbright (<class 'numpy.ndarray'>) shape (1,) dtype bool
   iscluster (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgaia (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgalaxy (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   islargegalaxy (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ismedium (<class 'numpy.ndarray'>) shape (1,) dtype bool
   istycho (<class 'numpy.ndarray'>) shape (1,) dtype bool
   jmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   keep_radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   kmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mask_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pa (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_bp_rp_excess_factor (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_rp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_variable_flag (<class 'numpy.ndarray'>) shape (1,) dtype bool
   pmdec (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmdec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pointsource (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ra (<class 'numpy.ndarray'>) shape (1,) dtype float64
   ra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius_pix (<class 'numpy.ndarray'>) shape (1,) dtype int64
   ref_cat (<class 'numpy.ndarray'>) shape (1,) dtype <U2
   ref_epoch (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ref_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   source_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   zguess (<class 'numpy.ndarray'>) shape (1,) dtype float32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/blobs-custom-276380p30415.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/metrics/cus/all-models-custom-276380p30415.fits
Stage fitblobs : Wall: 58.07 s, CPU: 0.59 s, VmPeak: 1127 MB, VmSize: 1127 MB, VmRSS: 312 MB, VmData: 339 MB, maxrss: 0.31988 MB
Stage fitblobs finished: 2020-07-18T21:01:52.662637
Resources for stage fitblobs : 52.123 s worker CPU, 52.156 s worker Wall, Wall: 58.068 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T21:01:52.686349
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-resid.jpg
Stage coadds : Wall: 19.17 s, CPU: 0.96 s, VmPeak: 1127 MB, VmSize: 1127 MB, VmRSS: 318 MB, VmData: 344 MB, maxrss: 0.325796 MB
Stage coadds finished: 2020-07-18T21:02:11.853285
Resources for stage coadds : 46.544 s worker CPU, 55.181 s worker Wall, Wall: 19.169 s, Cores in use: 2.48, Total efficiency (on 32 cores): 7.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T21:02:11.916936
Cut to 1 unWISE tiles
Reading WISE tile 2765p302 band 1
Reading WISE tile 2765p302 band 2
Reading WISE tile 2765p302 band 3
Reading WISE tile 2765p302 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.49 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 142 MB, VmData: 188 MB, maxrss: 0.18244 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.39 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 141 MB, VmData: 186 MB, maxrss: 0.199064 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.26 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 137 MB, VmData: 183 MB, maxrss: 0.195008 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.24 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 139 MB, VmData: 186 MB, maxrss: 0.197812 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/tmp-legacysurvey-custom-276380p30415-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.19 s, CPU: 0.74 s, VmPeak: 1127 MB, VmSize: 1127 MB, VmRSS: 319 MB, VmData: 344 MB, maxrss: 0.326308 MB
Stage wise_forced finished: 2020-07-18T21:02:14.108441
Resources for stage wise_forced : 4.524 s worker CPU, 4.088 s worker Wall, Wall: 2.194 s, Cores in use: 2.40, Total efficiency (on 32 cores): 7.5 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T21:02:14.130545
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/coadd/cus/custom-276380p30415/legacysurvey-custom-276380p30415-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/tractor-i/cus/tractor-custom-276380p30415.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/tractor/cus/tractor-custom-276380p30415.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/tractor/cus/brick-custom-276380p30415.sha256sum
Stage writecat : Wall: 0.95 s, CPU: 0.74 s, VmPeak: 1259 MB, VmSize: 1131 MB, VmRSS: 320 MB, VmData: 344 MB, maxrss: 0.459084 MB
Stage writecat finished: 2020-07-18T21:02:15.078063
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.951 s, Cores in use: 0.78, Total efficiency (on 32 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902859/PGC1902859-largegalaxy-writecat.p
All done: 110.121 s worker CPU, 130.475 s worker Wall, Wall: 109.831 s, Cores in use: 1.15, Total efficiency (on 32 cores): 3.6 %
Finished galaxy PGC1902859 in 1.868 minutes.