Started working on galaxy PGC1913347 at Thu Jun  4 16:00:29 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.04648499999996 30.677999 --width 275 --height 275 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T16:00:30.359332
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.04648499999996', '30.677999', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.04648499999996 30.677999 --width 275 --height 275 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 276.04648499999996 30.677999
Starting process 28623 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB
Starting process 28624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 28625 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 28626 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 28627 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 28628 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 28629 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Starting process 28630 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T16:00:35.087608
Keeping 4 CCDs:
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S18 r exptime 250.0 propid 2014B-0404 seeing 1.60 MJD 57486.381 object DECaLS_18790_r
   c4d_160408_100855_ooi_z_ls9.fits.fz c4d_160408_100855_ooi_z_ls9-S17 z exptime 201.0 propid 2014B-0404 seeing 1.56 MJD 57486.420 object DECaLS_34662_z
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S17 r exptime 250.0 propid 2014B-0404 seeing 1.61 MJD 57486.381 object DECaLS_18790_r
   c4d_160803_022806_ooi_g_ls9.fits.fz c4d_160803_022806_ooi_g_ls9-S17 g exptime 129.0 propid 2014B-0404 seeing 1.52 MJD 57603.101 object DECaLS_18790_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S17,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 26.45 s, CPU: 6.76 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 167 MB, VmData: 201 MB, maxrss: 0.455312 MB
Stage tims finished: 2020-06-04T16:01:01.542377
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 2.067 s worker CPU, 74.314 s worker Wall, Wall: 26.457 s, Cores in use: 0.33, Total efficiency (on 8 cores): 4.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-04T16:01:01.950889
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02978.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03106.fits
Matched 20 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/reference-custom-276046p30677.fits
Stage refs : Wall: 16.96 s, CPU: 16.53 s, VmPeak: 1113 MB, VmSize: 1107 MB, VmRSS: 283 MB, VmData: 314 MB, maxrss: 0.455312 MB
Stage refs finished: 2020-06-04T16:01:18.913358
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 16.964 s, Cores in use: 0.97, Total efficiency (on 8 cores): 12.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T16:01:18.915264
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outlier-mask-custom-276046p30677.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-pre-custom-276046p30677.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outlier-mask-custom-276046p30677.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-post-custom-276046p30677.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-masked-pos-custom-276046p30677.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-masked-neg-custom-276046p30677.jpg
Stage outliers : Wall: 8.66 s, CPU: 7.28 s, VmPeak: 1117 MB, VmSize: 1117 MB, VmRSS: 294 MB, VmData: 323 MB, maxrss: 0.455312 MB
Stage outliers finished: 2020-06-04T16:01:27.572496
Resources for stage outliers : 0.211 s worker CPU, 0.231 s worker Wall, Wall: 8.658 s, Cores in use: 0.86, Total efficiency (on 8 cores): 10.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T16:01:27.574534
Stage halos : Wall: 5.72 s, CPU: 4.08 s, VmPeak: 1117 MB, VmSize: 1117 MB, VmRSS: 294 MB, VmData: 323 MB, maxrss: 0.455312 MB
Stage halos finished: 2020-06-04T16:01:33.292491
Resources for stage halos : 0.177 s worker CPU, 3.416 s worker Wall, Wall: 5.719 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.3 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T16:01:33.294906
PSF sigmas in coadd pixels: ['2.47']
Using average PSF sigma 2.4657833807166414
Gaussian PSF norm 0.11440372012398418 vs pixelized 0.10620698
average tim pixel scale / coadd scale: 1.0013475015276032
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.61', '2.62']
Using average PSF sigma 2.6118813257773654
Gaussian PSF norm 0.10800444453191964 vs pixelized 0.09482799
average tim pixel scale / coadd scale: 1.0014733700401626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.53']
Using average PSF sigma 2.530459607417131
Gaussian PSF norm 0.1114796659654313 vs pixelized 0.09563902
average tim pixel scale / coadd scale: 1.0013681963505578
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.09 s, CPU: 0.07 s, VmPeak: 1117 MB, VmSize: 1117 MB, VmRSS: 295 MB, VmData: 323 MB, maxrss: 0.455312 MB
Stage fit_on_coadds finished: 2020-06-04T16:01:33.384148
Resources for stage fit_on_coadds : 0.046 s worker CPU, 0.046 s worker Wall, Wall: 0.090 s, Cores in use: 1.24, Total efficiency (on 8 cores): 15.5 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T16:01:33.386117
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 26 potential peaks
Of 26 potential peaks: 10 in veto map, 6 cut by saddle test, 0 cut by aper test, 10 kept
SED z : 10 new peaks
Found 41886 potential peaks
Of 41886 potential peaks: 41881 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 4882 potential peaks
Of 4882 potential peaks: 4880 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 254 potential peaks
Of 254 potential peaks: 251 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 224 potential peaks
Of 224 potential peaks: 221 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 12 new sources
Median coadd sky for g : 0.00015401313
Median coadd sky for r : 0.00032620793
Median coadd sky for z : -0.00045279865
Stage srcs : Wall: 5.72 s, CPU: 5.11 s, VmPeak: 1117 MB, VmSize: 1117 MB, VmRSS: 296 MB, VmData: 323 MB, maxrss: 0.455312 MB
Stage srcs finished: 2020-06-04T16:01:39.110712
Resources for stage srcs : 0.757 s worker CPU, 0.758 s worker Wall, Wall: 5.726 s, Cores in use: 1.03, Total efficiency (on 8 cores): 12.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T16:01:39.864730
Blob 1 of 3, id: 0, sources: 30, size: 263x275, npix 64056, brick X: 0,263, Y: 0,275, one pixel: 0 0
Blob 2 of 3, id: 1, sources: 3, size: 47x73, npix 2483, brick X: 228,275, Y: 57,130, one pixel: 246 57
Blob 3 of 3, id: 2, sources: 1, size: 15x26, npix 279, brick X: 260,275, Y: 243,269, one pixel: 270 243
Blob 3 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 106 MB, VmData: 165 MB, maxrss: 0.108544 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.03466, 30.67515), pm (-1.0, -9.0), parallax 0.330 with NanoMaggies: g=16.4, r=15.9, z=15.8
Reset brightness to NanoMaggies: g=16.2, r=15.9, z=15.8
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.22 s, CPU: 1.21 s, VmPeak: 943 MB, VmSize: 714 MB, VmRSS: 137 MB, VmData: 177 MB, maxrss: 0.140772 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15162, 30.80141), pm (-4.9, -20.2), parallax 2.813 with NanoMaggies: g=8.12, r=7.13, z=6.66
Reset brightness to NanoMaggies: g=8.12, r=7.13, z=6.66
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.07886, 30.70775), pm (0.0, 0.0), parallax 0.471 with NanoMaggies: g=14.1, r=13.3, z=12.9
Reset brightness to NanoMaggies: g=14.1, r=13.3, z=12.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.06928, 30.66729), pm (4.8, 2.8), parallax 0.631 with NanoMaggies: g=15.6, r=15.1, z=14.9
Reset brightness to NanoMaggies: g=15.6, r=15.1, z=14.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.741789, ee1=0.2047, ee2=-0.544437
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.06087, 30.67830), pm (-2.0, 2.8), parallax 0.450 with NanoMaggies: g=17.8, r=17.1, z=16.8
Reset brightness to NanoMaggies: g=17.8, r=17.1, z=16.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05937, 30.68203), pm (-2.7, -1.1), parallax 0.313 with NanoMaggies: g=18.2, r=17.1, z=17.7
Reset brightness to NanoMaggies: g=18.2, r=17.4, z=17.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05521, 30.66398), pm (-3.6, -14.9), parallax 0.645 with NanoMaggies: g=19.3, r=18, z=17.3
Reset brightness to NanoMaggies: g=19.3, r=18, z=17.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05278, 30.69139), pm (0.6, -2.1), parallax 0.391 with NanoMaggies: g=19.1, r=18.3, z=18
Reset brightness to NanoMaggies: g=19.1, r=18.3, z=18
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05211, 30.66722), pm (6.6, 0.2), parallax 2.067 with NanoMaggies: g=(flux -20.8), r=19.4, z=17.1
Reset brightness to NanoMaggies: g=20.8, r=19.4, z=17.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.06153, 30.66779), pm (-2.7, -9.7), parallax 0.155 with NanoMaggies: g=19.5, r=18.9, z=18.6
Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05495, 30.68955), pm (-0.7, -9.0), parallax 0.426 with NanoMaggies: g=(flux -7.45e+03), r=(flux -3.33e+03), z=13.5
Reset brightness to NanoMaggies: g=21, r=19.5, z=18.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05903, 30.67712), pm (-5.6, -5.0), parallax -0.798 with NanoMaggies: g=21.1, r=19.7, z=19.3
Reset brightness to NanoMaggies: g=21.1, r=20.2, z=19.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.04252, 30.66620), pm (-1.1, -9.1), parallax 0.581 with NanoMaggies: g=(flux -494), r=(flux -1.65e+14), z=16.1
Reset brightness to NanoMaggies: g=21.8, r=20.6, z=19.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.04616, 30.66759), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -0.878), r=20.9, z=19.8
Reset brightness to NanoMaggies: g=21.9, r=20.9, z=20.5
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 15.94 s, CPU: 15.93 s, VmPeak: 952 MB, VmSize: 743 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.177556 MB
Old catalog: 40
New catalog: 33
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/blobs-custom-276046p30677.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/all-models-custom-276046p30677.fits
Stage fitblobs : Wall: 19.53 s, CPU: 3.54 s, VmPeak: 1117 MB, VmSize: 1117 MB, VmRSS: 297 MB, VmData: 324 MB, maxrss: 0.455312 MB
Stage fitblobs finished: 2020-06-04T16:01:59.392471
Resources for stage fitblobs : 17.449 s worker CPU, 17.473 s worker Wall, Wall: 19.529 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T16:01:59.394535
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-resid.jpg
Stage coadds : Wall: 3.75 s, CPU: 2.03 s, VmPeak: 1117 MB, VmSize: 1117 MB, VmRSS: 301 MB, VmData: 327 MB, maxrss: 0.455312 MB
Stage coadds finished: 2020-06-04T16:02:03.147814
Resources for stage coadds : 7.067 s worker CPU, 7.655 s worker Wall, Wall: 3.754 s, Cores in use: 2.42, Total efficiency (on 8 cores): 30.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T16:02:03.149829
Cut to 1 unWISE tiles
Reading WISE tile 2765p302 band 1
Reading WISE tile 2765p302 band 2
Reading WISE tile 2765p302 band 4
Reading WISE tile 2765p302 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 790 MB, VmSize: 787 MB, VmRSS: 137 MB, VmData: 169 MB, maxrss: 0.19928 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 788 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.176628 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 947 MB, VmSize: 790 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.202176 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 947 MB, VmSize: 786 MB, VmRSS: 136 MB, VmData: 169 MB, maxrss: 0.198828 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.47 s, CPU: 3.90 s, VmPeak: 1117 MB, VmSize: 1117 MB, VmRSS: 302 MB, VmData: 327 MB, maxrss: 0.455312 MB
Stage wise_forced finished: 2020-06-04T16:02:08.624738
Resources for stage wise_forced : 3.227 s worker CPU, 4.814 s worker Wall, Wall: 5.476 s, Cores in use: 1.30, Total efficiency (on 8 cores): 16.3 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T16:02:08.626988
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/tractor-i/cus/tractor-custom-276046p30677.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/tractor/cus/tractor-custom-276046p30677.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/tractor/cus/brick-custom-276046p30677.sha256sum
Stage writecat : Wall: 3.72 s, CPU: 3.52 s, VmPeak: 1249 MB, VmSize: 1121 MB, VmRSS: 303 MB, VmData: 327 MB, maxrss: 0.455312 MB
Stage writecat finished: 2020-06-04T16:02:12.347182
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.721 s, Cores in use: 0.95, Total efficiency (on 8 cores): 11.8 %
Stage writecat finished
All done: 31.004 s worker CPU, 108.710 s worker Wall, Wall: 97.265 s, Cores in use: 0.86, Total efficiency (on 8 cores): 10.8 %
Finished galaxy PGC1913347 in 1.728 minutes.
Started working on galaxy PGC1913347 at Sat Jul 18 20:04:57 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.04648499999996 30.677999 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T20:04:58.168971
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.04648499999996', '30.677999', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.04648499999996 30.677999 --width 275 --height 275 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 276.04648499999996 30.677999
Starting process 56661 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 56662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 56663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 56664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB
Starting process 56665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB
Starting process 56666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB
Starting process 56667 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 56668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 56669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 56670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 56671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 56672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 56673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 56674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 56675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 56676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 56677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 56678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 56679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 56680 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 56681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 56682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 56683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 56684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 56685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 56686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 56687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 56688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 56689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 56690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 56691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 56692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T20:04:58.847813
Keeping 4 CCDs:
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S18 r exptime 250.0 propid 2014B-0404 seeing 1.60 MJD 57486.381 object DECaLS_18790_r
   c4d_160408_100855_ooi_z_ls9.fits.fz c4d_160408_100855_ooi_z_ls9-S17 z exptime 201.0 propid 2014B-0404 seeing 1.56 MJD 57486.420 object DECaLS_34662_z
   c4d_160408_091305_ooi_r_ls9.fits.fz c4d_160408_091305_ooi_r_ls9-S17 r exptime 250.0 propid 2014B-0404 seeing 1.61 MJD 57486.381 object DECaLS_18790_r
   c4d_160803_022806_ooi_g_ls9.fits.fz c4d_160803_022806_ooi_g_ls9-S17 g exptime 129.0 propid 2014B-0404 seeing 1.52 MJD 57603.101 object DECaLS_18790_g
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S18,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S17,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S17,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 4.03 s, CPU: 0.89 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 169 MB, VmData: 204 MB, maxrss: 0.220064 MB
Stage tims finished: 2020-07-18T20:05:02.875308
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 1.929 s worker CPU, 8.769 s worker Wall, Wall: 4.030 s, Cores in use: 0.70, Total efficiency (on 32 cores): 2.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-18T20:05:05.059236
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02978.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03106.fits
Matched 20 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/reference-custom-276046p30677.fits
Stage refs : Wall: 9.77 s, CPU: 9.49 s, VmPeak: 1116 MB, VmSize: 1111 MB, VmRSS: 285 MB, VmData: 317 MB, maxrss: 0.292284 MB
Stage refs finished: 2020-07-18T20:05:14.833940
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.777 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-refs.p
Running stage outliers
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage outliers at 2020-07-18T20:05:14.848809
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outlier-mask-custom-276046p30677.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-pre-custom-276046p30677.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outlier-mask-custom-276046p30677.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-post-custom-276046p30677.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-masked-pos-custom-276046p30677.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/outliers-masked-neg-custom-276046p30677.jpg
Stage outliers : Wall: 0.85 s, CPU: 0.56 s, VmPeak: 1120 MB, VmSize: 1120 MB, VmRSS: 295 MB, VmData: 325 MB, maxrss: 0.302508 MB
Stage outliers finished: 2020-07-18T20:05:15.701639
Resources for stage outliers : 0.278 s worker CPU, 0.350 s worker Wall, Wall: 0.856 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T20:05:15.716689
Stage halos : Wall: 0.46 s, CPU: 0.33 s, VmPeak: 1120 MB, VmSize: 1120 MB, VmRSS: 296 MB, VmData: 325 MB, maxrss: 0.30286 MB
Stage halos finished: 2020-07-18T20:05:16.176018
Resources for stage halos : 0.204 s worker CPU, 0.294 s worker Wall, Wall: 0.462 s, Cores in use: 1.16, Total efficiency (on 32 cores): 3.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-18T20:05:16.193341
PSF sigmas in coadd pixels: ['2.47']
Using average PSF sigma 2.4657833807166414
Gaussian PSF norm 0.11440372012398418 vs pixelized 0.10620698
average tim pixel scale / coadd scale: 1.0013475015276032
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.61', '2.62']
Using average PSF sigma 2.6118813257773654
Gaussian PSF norm 0.10800444453191964 vs pixelized 0.09482799
average tim pixel scale / coadd scale: 1.0014733700401626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.53']
Using average PSF sigma 2.530459607417131
Gaussian PSF norm 0.1114796659654313 vs pixelized 0.09563902
average tim pixel scale / coadd scale: 1.0013681963505578
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.14 s, CPU: 0.07 s, VmPeak: 1120 MB, VmSize: 1120 MB, VmRSS: 297 MB, VmData: 325 MB, maxrss: 0.304332 MB
Stage fit_on_coadds finished: 2020-07-18T20:05:16.333268
Resources for stage fit_on_coadds : 0.063 s worker CPU, 0.087 s worker Wall, Wall: 0.142 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T20:05:16.347097
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 23 potential peaks
Of 23 potential peaks: 9 in veto map, 4 cut by saddle test, 0 cut by aper test, 10 kept
SED z : 10 new peaks
Found 41886 potential peaks
Of 41886 potential peaks: 41881 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 4882 potential peaks
Of 4882 potential peaks: 4880 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 254 potential peaks
Of 254 potential peaks: 251 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 224 potential peaks
Of 224 potential peaks: 221 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 12 new sources
Median coadd sky for g : 0.00015401313
Median coadd sky for r : 0.00032620793
Median coadd sky for z : -0.00045279865
Stage srcs : Wall: 1.22 s, CPU: 0.58 s, VmPeak: 1120 MB, VmSize: 1120 MB, VmRSS: 298 MB, VmData: 325 MB, maxrss: 0.304856 MB
Stage srcs finished: 2020-07-18T20:05:17.565024
Resources for stage srcs : 0.758 s worker CPU, 0.787 s worker Wall, Wall: 1.220 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T20:05:17.579165
Blob 1 of 3, id: 0, sources: 30, size: 263x275, npix 64056, brick X: 0,263, Y: 0,275, one pixel: 0 0
Blob 2 of 3, id: 1, sources: 3, size: 47x73, npix 2483, brick X: 228,275, Y: 57,130, one pixel: 246 57
Blob 3 of 3, id: 2, sources: 1, size: 15x26, npix 279, brick X: 260,275, Y: 243,269, one pixel: 270 243
Blob 3 finished, total: Wall: 0.28 s, CPU: 0.25 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 83 MB, VmData: 136 MB, maxrss: 0.084628 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.03466, 30.67515), pm (-1.0, -9.0), parallax 0.330 with NanoMaggies: g=16.4, r=15.9, z=15.8
Reset brightness to NanoMaggies: g=16.2, r=15.9, z=15.8
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.22 s, CPU: 2.20 s, VmPeak: 662 MB, VmSize: 661 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.09322 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15162, 30.80141), pm (-4.9, -20.2), parallax 2.813 with NanoMaggies: g=8.12, r=7.13, z=6.66
Reset brightness to NanoMaggies: g=8.12, r=7.13, z=6.66
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.07886, 30.70775), pm (0.0, 0.0), parallax 0.471 with NanoMaggies: g=14.1, r=13.3, z=12.9
Reset brightness to NanoMaggies: g=14.1, r=13.3, z=12.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.06928, 30.66729), pm (4.8, 2.8), parallax 0.631 with NanoMaggies: g=15.6, r=15.1, z=14.9
Reset brightness to NanoMaggies: g=15.6, r=15.1, z=14.9
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.741789, ee1=0.2047, ee2=-0.544437
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.06087, 30.67830), pm (-2.0, 2.8), parallax 0.450 with NanoMaggies: g=17.8, r=17.1, z=16.8
Reset brightness to NanoMaggies: g=17.8, r=17.1, z=16.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05937, 30.68203), pm (-2.7, -1.1), parallax 0.313 with NanoMaggies: g=18.2, r=17.1, z=17.7
Reset brightness to NanoMaggies: g=18.2, r=17.4, z=17.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05521, 30.66398), pm (-3.6, -14.9), parallax 0.645 with NanoMaggies: g=19.3, r=18, z=17.3
Reset brightness to NanoMaggies: g=19.3, r=18, z=17.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05278, 30.69139), pm (0.6, -2.1), parallax 0.391 with NanoMaggies: g=19.1, r=18.3, z=18
Reset brightness to NanoMaggies: g=19.1, r=18.3, z=18
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05211, 30.66722), pm (6.6, 0.2), parallax 2.067 with NanoMaggies: g=(flux -20.8), r=19.4, z=17.1
Reset brightness to NanoMaggies: g=20.8, r=19.4, z=17.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.06153, 30.66779), pm (-2.7, -9.7), parallax 0.155 with NanoMaggies: g=19.5, r=18.9, z=18.6
Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05495, 30.68955), pm (-0.7, -9.0), parallax 0.426 with NanoMaggies: g=(flux -7.45e+03), r=(flux -3.33e+03), z=13.5
Reset brightness to NanoMaggies: g=21, r=19.5, z=18.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.05903, 30.67712), pm (-5.6, -5.0), parallax -0.798 with NanoMaggies: g=21.1, r=19.7, z=19.3
Reset brightness to NanoMaggies: g=21.1, r=20.2, z=19.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.04252, 30.66620), pm (-1.1, -9.1), parallax 0.581 with NanoMaggies: g=(flux -494), r=(flux -1.65e+14), z=16.1
Reset brightness to NanoMaggies: g=21.8, r=20.6, z=19.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.04616, 30.66759), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -0.878), r=20.9, z=19.8
Reset brightness to NanoMaggies: g=21.9, r=20.9, z=20.5
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 16.03 s, CPU: 16.00 s, VmPeak: 712 MB, VmSize: 700 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1546 MB
Old catalog: 40
New catalog: 33
T_dup:
tabledata object with 1 rows and 62 columns:
   a_g_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise_sig (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_n_good_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_n_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_params_solved (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   astrometric_sigma5d_max (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_weight_al (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ba (<class 'numpy.ndarray'>) shape (1,) dtype float32
   dec (<class 'numpy.ndarray'>) shape (1,) dtype float64
   dec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_g (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_r (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_z (<class 'numpy.ndarray'>) shape (1,) dtype float32
   donotfit (<class 'numpy.ndarray'>) shape (1,) dtype bool
   duplicated_source (<class 'numpy.ndarray'>) shape (1,) dtype bool
   e_bp_min_rp_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   freezeparams (<class 'numpy.ndarray'>) shape (1,) dtype bool
   hmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ibx (<class 'numpy.ndarray'>) shape (1,) dtype int32
   iby (<class 'numpy.ndarray'>) shape (1,) dtype int32
   in_bounds (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isbright (<class 'numpy.ndarray'>) shape (1,) dtype bool
   iscluster (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgaia (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgalaxy (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   islargegalaxy (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ismedium (<class 'numpy.ndarray'>) shape (1,) dtype bool
   istycho (<class 'numpy.ndarray'>) shape (1,) dtype bool
   jmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   keep_radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   kmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mask_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pa (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_bp_rp_excess_factor (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_rp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_variable_flag (<class 'numpy.ndarray'>) shape (1,) dtype bool
   pmdec (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmdec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pointsource (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ra (<class 'numpy.ndarray'>) shape (1,) dtype float64
   ra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius_pix (<class 'numpy.ndarray'>) shape (1,) dtype int64
   ref_cat (<class 'numpy.ndarray'>) shape (1,) dtype <U2
   ref_epoch (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ref_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   source_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   zguess (<class 'numpy.ndarray'>) shape (1,) dtype float32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/blobs-custom-276046p30677.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/metrics/cus/all-models-custom-276046p30677.fits
Stage fitblobs : Wall: 21.96 s, CPU: 0.52 s, VmPeak: 1120 MB, VmSize: 1120 MB, VmRSS: 299 MB, VmData: 326 MB, maxrss: 0.306656 MB
Stage fitblobs finished: 2020-07-18T20:05:39.535744
Resources for stage fitblobs : 18.511 s worker CPU, 18.594 s worker Wall, Wall: 21.960 s, Cores in use: 0.87, Total efficiency (on 32 cores): 2.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T20:05:39.556028
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-resid.jpg
Stage coadds : Wall: 3.86 s, CPU: 0.77 s, VmPeak: 1120 MB, VmSize: 1120 MB, VmRSS: 303 MB, VmData: 329 MB, maxrss: 0.310352 MB
Stage coadds finished: 2020-07-18T20:05:43.415444
Resources for stage coadds : 48.157 s worker CPU, 60.179 s worker Wall, Wall: 3.862 s, Cores in use: 12.67, Total efficiency (on 32 cores): 39.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T20:05:43.447388
Cut to 1 unWISE tiles
Reading WISE tile 2765p302 band 1
Reading WISE tile 2765p302 band 2
Reading WISE tile 2765p302 band 3
Reading WISE tile 2765p302 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 948 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.187456 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 785 MB, VmSize: 785 MB, VmRSS: 135 MB, VmData: 169 MB, maxrss: 0.193272 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 952 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 173 MB, maxrss: 0.201892 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 794 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.202444 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/tmp-legacysurvey-custom-276046p30677-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.09 s, CPU: 0.72 s, VmPeak: 1120 MB, VmSize: 1120 MB, VmRSS: 304 MB, VmData: 329 MB, maxrss: 0.310864 MB
Stage wise_forced finished: 2020-07-18T20:05:45.535912
Resources for stage wise_forced : 3.167 s worker CPU, 3.832 s worker Wall, Wall: 2.091 s, Cores in use: 1.86, Total efficiency (on 32 cores): 5.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T20:05:45.551999
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/coadd/cus/custom-276046p30677/legacysurvey-custom-276046p30677-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/tractor-i/cus/tractor-custom-276046p30677.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/tractor/cus/tractor-custom-276046p30677.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/tractor/cus/brick-custom-276046p30677.sha256sum
Stage writecat : Wall: 0.82 s, CPU: 0.65 s, VmPeak: 1253 MB, VmSize: 1125 MB, VmRSS: 305 MB, VmData: 329 MB, maxrss: 0.443412 MB
Stage writecat finished: 2020-07-18T20:05:46.368893
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.820 s, Cores in use: 0.80, Total efficiency (on 32 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1913347/PGC1913347-largegalaxy-writecat.p
All done: 73.073 s worker CPU, 92.899 s worker Wall, Wall: 47.546 s, Cores in use: 1.85, Total efficiency (on 32 cores): 5.8 %
Finished galaxy PGC1913347 in 0.829 minutes.