Started working on galaxy PGC987209 at Thu Jun 25 03:23:51 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.83091649999997 -9.729638900000001 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-25T03:23:58.228495
legacypipe git version: DR9.5.2-150-g3ed0fdf5
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '163.83091649999997', '-9.729638900000001', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.83091649999997 -9.729638900000001 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 163.83091649999997 -9.729638900000001
Starting process 42971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057752 MB
Starting process 42975 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057756 MB
Starting process 42979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057756 MB
Starting process 42983 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057756 MB
Starting process 42987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057756 MB
Starting process 42991 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057756 MB
Starting process 42997 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.057756 MB
Starting process 43001 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 130 MB, maxrss: 0.05776 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-25T03:24:03.012258
Keeping 3 CCDs:
   c4d_170302_043537_ooi_r_ls9.fits.fz c4d_170302_043537_ooi_r_ls9-N29 r exptime 40.0 propid 2014B-0404 seeing 0.83 MJD 57814.190 object DECaLS_7110_r
   c4d_170301_044101_ooi_g_ls9.fits.fz c4d_170301_044101_ooi_g_ls9-N29 g exptime 129.0 propid 2014B-0404 seeing 1.29 MJD 57813.193 object DECaLS_7110_g
   c4d_151227_062906_ooi_z_ls9.fits.fz c4d_151227_062906_ooi_z_ls9-N29 z exptime 90.0 propid 2014B-0404 seeing 1.09 MJD 57383.269 object DECaLS_7110_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T043405_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950c43f-g-20170301T043804_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95527d4-z-20151227T062643_oi[N29,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 51.66 s, CPU: 3.95 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 168 MB, VmData: 201 MB, maxrss: 0.172128 MB
Stage tims finished: 2020-06-25T03:24:54.674020
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T043405_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950c43f-g-20170301T043804_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 1.637 s worker CPU, 69.908 s worker Wall, Wall: 51.663 s, Cores in use: 0.11, Total efficiency (on 8 cores): 1.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95527d4-z-20151227T062643_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-25T03:24:54.684968
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07162.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07034.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07290.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/reference-custom-163830m09729.fits
Stage refs : Wall: 6.53 s, CPU: 5.67 s, VmPeak: 1025 MB, VmSize: 1012 MB, VmRSS: 187 MB, VmData: 220 MB, maxrss: 0.191596 MB
Stage refs finished: 2020-06-25T03:25:01.215548
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.532 s, Cores in use: 0.87, Total efficiency (on 8 cores): 10.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-06-25T03:25:01.227390
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outlier-mask-custom-163830m09729.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-pre-custom-163830m09729.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outlier-mask-custom-163830m09729.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-post-custom-163830m09729.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-masked-pos-custom-163830m09729.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-masked-neg-custom-163830m09729.jpg
Stage outliers : Wall: 2.95 s, CPU: 2.34 s, VmPeak: 1025 MB, VmSize: 1022 MB, VmRSS: 195 MB, VmData: 226 MB, maxrss: 0.199936 MB
Stage outliers finished: 2020-06-25T03:25:04.179309
Resources for stage outliers : 0.189 s worker CPU, 0.459 s worker Wall, Wall: 2.953 s, Cores in use: 0.86, Total efficiency (on 8 cores): 10.7 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-06-25T03:25:04.189975
Stage halos : Wall: 1.53 s, CPU: 1.40 s, VmPeak: 1025 MB, VmSize: 1022 MB, VmRSS: 196 MB, VmData: 226 MB, maxrss: 0.200272 MB
Stage halos finished: 2020-06-25T03:25:05.718461
Resources for stage halos : 0.097 s worker CPU, 0.255 s worker Wall, Wall: 1.530 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-25T03:25:09.681480
PSF sigmas in coadd pixels: ['2.09']
Using average PSF sigma 2.094365009376471
Gaussian PSF norm 0.13469227690060706 vs pixelized 0.11153091
average tim pixel scale / coadd scale: 1.0010836675286805
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.35']
Using average PSF sigma 1.3470492291721436
Gaussian PSF norm 0.20941683916574097 vs pixelized 0.17640328
average tim pixel scale / coadd scale: 1.0011080614262693
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.76']
Using average PSF sigma 1.7625932249309328
Gaussian PSF norm 0.1600453171972972 vs pixelized 0.12710768
average tim pixel scale / coadd scale: 1.0011812431190361
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.06 s, VmPeak: 1025 MB, VmSize: 1022 MB, VmRSS: 197 MB, VmData: 226 MB, maxrss: 0.2017 MB
Stage fit_on_coadds finished: 2020-06-25T03:25:09.799636
Resources for stage fit_on_coadds : 0.032 s worker CPU, 0.032 s worker Wall, Wall: 0.119 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-06-25T03:25:09.807612
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 13 in veto map, 4 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 43 potential peaks
Of 43 potential peaks: 34 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 23 potential peaks
Of 23 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 33 potential peaks
Of 33 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 44 potential peaks
Of 44 potential peaks: 38 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 14 new sources
Median coadd sky for g : 0.000320045
Median coadd sky for r : 0.00047024945
Median coadd sky for z : 0.0013944075
Stage srcs : Wall: 2.34 s, CPU: 2.26 s, VmPeak: 1025 MB, VmSize: 1022 MB, VmRSS: 197 MB, VmData: 226 MB, maxrss: 0.20216 MB
Stage srcs finished: 2020-06-25T03:25:12.145525
Resources for stage srcs : 0.074 s worker CPU, 0.089 s worker Wall, Wall: 2.339 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-25T03:25:12.175731
Blob 1 of 8, id: 3, sources: 5, size: 124x136, npix 10041, brick X: 55,179, Y: 55,191, one pixel: 99 55
Blob 2 of 8, id: 0, sources: 4, size: 79x40, npix 1993, brick X: 81,160, Y: 0,40, one pixel: 102 0
Blob 3 of 8, id: 4, sources: 2, size: 41x38, npix 808, brick X: 156,197, Y: 55,93, one pixel: 164 55
Blob 4 of 8, id: 5, sources: 2, size: 43x31, npix 703, brick X: 11,54, Y: 109,140, one pixel: 24 109
Blob 5 of 8, id: 7, sources: 1, size: 28x29, npix 541, brick X: 21,49, Y: 195,224, one pixel: 32 195
Blob 6 of 8, id: 6, sources: 1, size: 24x25, npix 377, brick X: 119,143, Y: 192,217, one pixel: 129 192
Blob 7 of 8, id: 2, sources: 1, size: 18x17, npix 162, brick X: 29,47, Y: 17,34, one pixel: 37 17
Blob 8 of 8, id: 1, sources: 1, size: 17x17, npix 145, brick X: 168,185, Y: 4,21, one pixel: 176 4
Blob 7 finished, total: Wall: 0.14 s, CPU: 0.07 s, VmPeak: 751 MB, VmSize: 751 MB, VmRSS: 105 MB, VmData: 166 MB, maxrss: 0.10788 MB
Blob 8 finished, total: Wall: 0.16 s, CPU: 0.07 s, VmPeak: 723 MB, VmSize: 723 MB, VmRSS: 84 MB, VmData: 139 MB, maxrss: 0.085592 MB
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 0.90 s, CPU: 0.84 s, VmPeak: 725 MB, VmSize: 725 MB, VmRSS: 90 MB, VmData: 140 MB, maxrss: 0.092076 MB
Blob 4 finished, total: Wall: 1.03 s, CPU: 0.92 s, VmPeak: 751 MB, VmSize: 751 MB, VmRSS: 110 MB, VmData: 166 MB, maxrss: 0.112716 MB
Blob 5 finished, total: Wall: 1.06 s, CPU: 0.96 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 140 MB, VmData: 182 MB, maxrss: 0.143608 MB
Blob 3 finished, total: Wall: 1.63 s, CPU: 1.56 s, VmPeak: 752 MB, VmSize: 752 MB, VmRSS: 112 MB, VmData: 167 MB, maxrss: 0.114468 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (163.83018, -9.73871), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=14.9, r=14.6, z=14.2
Reset brightness to NanoMaggies: g=14.5, r=14.1, z=14
Blob 2 finished, total: Wall: 2.70 s, CPU: 2.59 s, VmPeak: 1000 MB, VmSize: 783 MB, VmRSS: 140 MB, VmData: 182 MB, maxrss: 0.143556 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.927193, ee1=0.013462, ee2=-0.132896
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 7.28 s, CPU: 7.26 s, VmPeak: 1001 MB, VmSize: 783 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14636 MB
Old catalog: 21
New catalog: 17
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/blobs-custom-163830m09729.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/all-models-custom-163830m09729.fits
Stage fitblobs : Wall: 9.82 s, CPU: 2.38 s, VmPeak: 1025 MB, VmSize: 1022 MB, VmRSS: 198 MB, VmData: 226 MB, maxrss: 0.202316 MB
Stage fitblobs finished: 2020-06-25T03:25:22.000102
Resources for stage fitblobs : 14.408 s worker CPU, 15.909 s worker Wall, Wall: 9.826 s, Cores in use: 1.71, Total efficiency (on 8 cores): 21.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-06-25T03:25:22.028561
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-resid.jpg
Stage coadds : Wall: 2.55 s, CPU: 0.66 s, VmPeak: 1025 MB, VmSize: 1022 MB, VmRSS: 199 MB, VmData: 227 MB, maxrss: 0.204024 MB
Stage coadds finished: 2020-06-25T03:25:24.575803
Resources for stage coadds : 6.098 s worker CPU, 7.449 s worker Wall, Wall: 2.548 s, Cores in use: 2.65, Total efficiency (on 8 cores): 33.2 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-06-25T03:25:24.585570
Cut to 1 unWISE tiles
Reading WISE tile 1639m091 band 2
Reading WISE tile 1639m091 band 3
Reading WISE tile 1639m091 band 4
Reading WISE tile 1639m091 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.05 s, VmPeak: 1000 MB, VmSize: 860 MB, VmRSS: 143 MB, VmData: 175 MB, maxrss: 0.207644 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.17 s, CPU: 0.09 s, VmPeak: 859 MB, VmSize: 859 MB, VmRSS: 145 MB, VmData: 177 MB, maxrss: 0.184472 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 1001 MB, VmSize: 860 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.208932 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 1000 MB, VmSize: 860 MB, VmRSS: 143 MB, VmData: 175 MB, maxrss: 0.207548 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.12 s, CPU: 0.45 s, VmPeak: 1025 MB, VmSize: 1022 MB, VmRSS: 200 MB, VmData: 227 MB, maxrss: 0.204732 MB
Stage wise_forced finished: 2020-06-25T03:25:26.708746
Resources for stage wise_forced : 3.191 s worker CPU, 4.898 s worker Wall, Wall: 2.124 s, Cores in use: 1.71, Total efficiency (on 8 cores): 21.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-06-25T03:25:26.782383
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/tractor-i/cus/tractor-custom-163830m09729.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/tractor/cus/tractor-custom-163830m09729.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/tractor/cus/brick-custom-163830m09729.sha256sum
Stage writecat : Wall: 0.73 s, CPU: 0.55 s, VmPeak: 1154 MB, VmSize: 1026 MB, VmRSS: 202 MB, VmData: 227 MB, maxrss: 0.33752 MB
Stage writecat finished: 2020-06-25T03:25:27.513493
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.732 s, Cores in use: 0.75, Total efficiency (on 8 cores): 9.3 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-writecat.p
All done: 25.729 s worker CPU, 99.002 s worker Wall, Wall: 84.546 s, Cores in use: 0.54, Total efficiency (on 8 cores): 6.7 %
Finished galaxy PGC987209 in 1.608 minutes.
Started working on galaxy PGC987209 at Fri Jul 17 07:26:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.83091649999997 -9.729638900000001 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-17T07:27:00.459397
legacypipe git version: DR9.5.4-57-g2fd66136
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '163.83091649999997', '-9.729638900000001', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.83091649999997 -9.729638900000001 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 163.83091649999997 -9.729638900000001
Starting process 25472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 25473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 25474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 25475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059152 MB
Starting process 25476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 25477 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 25478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 25479 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 25480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 25481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 25482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 25483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 25484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 25485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 25486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 25487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-17T07:27:04.321640
Keeping 3 CCDs:
   c4d_170302_043537_ooi_r_ls9.fits.fz c4d_170302_043537_ooi_r_ls9-N29 r exptime 40.0 propid 2014B-0404 seeing 0.83 MJD 57814.190 object DECaLS_7110_r
   c4d_170301_044101_ooi_g_ls9.fits.fz c4d_170301_044101_ooi_g_ls9-N29 g exptime 129.0 propid 2014B-0404 seeing 1.29 MJD 57813.193 object DECaLS_7110_g
   c4d_151227_062906_ooi_z_ls9.fits.fz c4d_151227_062906_ooi_z_ls9-N29 z exptime 90.0 propid 2014B-0404 seeing 1.09 MJD 57383.269 object DECaLS_7110_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T043405_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95527d4-z-20151227T062643_oi[N29,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950c43f-g-20170301T043804_oi[N29,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 16.41 s, CPU: 2.77 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 169 MB, VmData: 203 MB, maxrss: 0.172744 MB
Stage tims finished: 2020-07-17T07:27:20.733473
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950d81b-r-20170302T043405_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95527d4-z-20151227T062643_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950c43f-g-20170301T043804_oi[N29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 1.699 s worker CPU, 29.558 s worker Wall, Wall: 16.414 s, Cores in use: 0.27, Total efficiency (on 16 cores): 1.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-17T07:27:20.783651
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07162.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07034.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07290.fits
Matched 6 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/reference-custom-163830m09729.fits
Stage refs : Wall: 7.23 s, CPU: 3.18 s, VmPeak: 1027 MB, VmSize: 1015 MB, VmRSS: 187 MB, VmData: 221 MB, maxrss: 0.19196 MB
Stage refs finished: 2020-07-17T07:27:28.017534
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.235 s, Cores in use: 0.44, Total efficiency (on 16 cores): 2.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-17T07:27:28.041621
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outlier-mask-custom-163830m09729.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-pre-custom-163830m09729.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outlier-mask-custom-163830m09729.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-post-custom-163830m09729.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-masked-pos-custom-163830m09729.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/outliers-masked-neg-custom-163830m09729.jpg
Stage outliers : Wall: 5.07 s, CPU: 0.46 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.200888 MB
Stage outliers finished: 2020-07-17T07:27:33.116341
Resources for stage outliers : 0.222 s worker CPU, 0.340 s worker Wall, Wall: 5.076 s, Cores in use: 0.13, Total efficiency (on 16 cores): 0.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-17T07:27:33.130297
Stage halos : Wall: 0.66 s, CPU: 0.54 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 196 MB, VmData: 227 MB, maxrss: 0.200928 MB
Stage halos finished: 2020-07-17T07:27:33.791319
Resources for stage halos : 0.100 s worker CPU, 0.292 s worker Wall, Wall: 0.663 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-17T07:27:33.846606
PSF sigmas in coadd pixels: ['2.09']
Using average PSF sigma 2.094365009376471
Gaussian PSF norm 0.13469227690060706 vs pixelized 0.11153091
average tim pixel scale / coadd scale: 1.0010836675286805
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.35']
Using average PSF sigma 1.3470492291721436
Gaussian PSF norm 0.20941683916574097 vs pixelized 0.17640328
average tim pixel scale / coadd scale: 1.0011080614262693
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.76']
Using average PSF sigma 1.7625932249309328
Gaussian PSF norm 0.1600453171972972 vs pixelized 0.12710768
average tim pixel scale / coadd scale: 1.0011812431190361
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.08 s, CPU: 0.06 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.20254 MB
Stage fit_on_coadds finished: 2020-07-17T07:27:33.924611
Resources for stage fit_on_coadds : 0.031 s worker CPU, 0.031 s worker Wall, Wall: 0.079 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-17T07:27:33.934134
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 13 in veto map, 4 cut by saddle test, 0 cut by aper test, 8 kept
SED z : 8 new peaks
Found 43 potential peaks
Of 43 potential peaks: 34 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 23 potential peaks
Of 23 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 33 potential peaks
Of 33 potential peaks: 29 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 44 potential peaks
Of 44 potential peaks: 38 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 14 new sources
Median coadd sky for g : 0.000320045
Median coadd sky for r : 0.00047024945
Median coadd sky for z : 0.0013944075
Stage srcs : Wall: 0.67 s, CPU: 0.62 s, VmPeak: 1027 MB, VmSize: 1024 MB, VmRSS: 198 MB, VmData: 227 MB, maxrss: 0.202944 MB
Stage srcs finished: 2020-07-17T07:27:34.603125
Resources for stage srcs : 0.081 s worker CPU, 0.105 s worker Wall, Wall: 0.670 s, Cores in use: 1.05, Total efficiency (on 16 cores): 6.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-17T07:27:34.671093
Blob 1 of 8, id: 3, sources: 5, size: 124x136, npix 10041, brick X: 55,179, Y: 55,191, one pixel: 99 55
Blob 2 of 8, id: 0, sources: 4, size: 79x40, npix 1993, brick X: 81,160, Y: 0,40, one pixel: 102 0
Blob 3 of 8, id: 4, sources: 2, size: 41x38, npix 808, brick X: 156,197, Y: 55,93, one pixel: 164 55
Blob 4 of 8, id: 5, sources: 2, size: 43x31, npix 703, brick X: 11,54, Y: 109,140, one pixel: 24 109
Blob 5 of 8, id: 7, sources: 1, size: 28x29, npix 541, brick X: 21,49, Y: 195,224, one pixel: 32 195
Blob 6 of 8, id: 6, sources: 1, size: 24x25, npix 377, brick X: 119,143, Y: 192,217, one pixel: 129 192
Blob 7 of 8, id: 2, sources: 1, size: 18x17, npix 162, brick X: 29,47, Y: 17,34, one pixel: 37 17
Blob 8 of 8, id: 1, sources: 1, size: 17x17, npix 145, brick X: 168,185, Y: 4,21, one pixel: 176 4
Blob 7 finished, total: Wall: 0.14 s, CPU: 0.08 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 139 MB, VmData: 181 MB, maxrss: 0.14232 MB
Blob 8 finished, total: Wall: 0.15 s, CPU: 0.09 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.086876 MB
Blob 6 finished, total: Wall: 0.63 s, CPU: 0.56 s, VmPeak: 663 MB, VmSize: 663 MB, VmRSS: 92 MB, VmData: 141 MB, maxrss: 0.094584 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 1.05 s, CPU: 0.99 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093804 MB
Blob 5 finished, total: Wall: 1.06 s, CPU: 0.99 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093548 MB
Blob 3 finished, total: Wall: 1.44 s, CPU: 1.38 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112576 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (163.83018, -9.73871), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=14.9, r=14.6, z=14.2
Reset brightness to NanoMaggies: g=14.5, r=14.1, z=14
Blob 2 finished, total: Wall: 2.36 s, CPU: 2.29 s, VmPeak: 936 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144416 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.927193, ee1=0.013462, ee2=-0.132896
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 7.00 s, CPU: 6.99 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 110 MB, VmData: 155 MB, maxrss: 0.112892 MB
Old catalog: 21
New catalog: 17
T_dup:
tabledata object with 1 rows and 62 columns:
   a_g_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_excess_noise_sig (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_n_good_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_n_obs_al (<class 'numpy.ndarray'>) shape (1,) dtype int16
   astrometric_params_solved (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   astrometric_sigma5d_max (<class 'numpy.ndarray'>) shape (1,) dtype float32
   astrometric_weight_al (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ba (<class 'numpy.ndarray'>) shape (1,) dtype float32
   dec (<class 'numpy.ndarray'>) shape (1,) dtype float64
   dec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_g (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_r (<class 'numpy.ndarray'>) shape (1,) dtype float32
   decam_mag_z (<class 'numpy.ndarray'>) shape (1,) dtype float32
   donotfit (<class 'numpy.ndarray'>) shape (1,) dtype bool
   duplicated_source (<class 'numpy.ndarray'>) shape (1,) dtype bool
   e_bp_min_rp_val (<class 'numpy.ndarray'>) shape (1,) dtype float32
   freezeparams (<class 'numpy.ndarray'>) shape (1,) dtype bool
   hmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ibx (<class 'numpy.ndarray'>) shape (1,) dtype int32
   iby (<class 'numpy.ndarray'>) shape (1,) dtype int32
   in_bounds (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isbright (<class 'numpy.ndarray'>) shape (1,) dtype bool
   iscluster (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgaia (<class 'numpy.ndarray'>) shape (1,) dtype bool
   isgalaxy (<class 'numpy.ndarray'>) shape (1,) dtype uint8
   islargegalaxy (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ismedium (<class 'numpy.ndarray'>) shape (1,) dtype bool
   istycho (<class 'numpy.ndarray'>) shape (1,) dtype bool
   jmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   keep_radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   kmag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   mask_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pa (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax (<class 'numpy.ndarray'>) shape (1,) dtype float32
   parallax_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_bp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_bp_rp_excess_factor (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_g_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_rp_mean_flux_over_error (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_mean_mag (<class 'numpy.ndarray'>) shape (1,) dtype float32
   phot_rp_n_obs (<class 'numpy.ndarray'>) shape (1,) dtype int16
   phot_variable_flag (<class 'numpy.ndarray'>) shape (1,) dtype bool
   pmdec (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmdec_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pmra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   pointsource (<class 'numpy.ndarray'>) shape (1,) dtype bool
   ra (<class 'numpy.ndarray'>) shape (1,) dtype float64
   ra_ivar (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius (<class 'numpy.ndarray'>) shape (1,) dtype float32
   radius_pix (<class 'numpy.ndarray'>) shape (1,) dtype int64
   ref_cat (<class 'numpy.ndarray'>) shape (1,) dtype <U2
   ref_epoch (<class 'numpy.ndarray'>) shape (1,) dtype float32
   ref_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   source_id (<class 'numpy.ndarray'>) shape (1,) dtype int64
   zguess (<class 'numpy.ndarray'>) shape (1,) dtype float32
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/blobs-custom-163830m09729.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/metrics/cus/all-models-custom-163830m09729.fits
Stage fitblobs : Wall: 7.62 s, CPU: 0.55 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 194 MB, VmData: 223 MB, maxrss: 0.2031 MB
Stage fitblobs finished: 2020-07-17T07:27:42.289815
Resources for stage fitblobs : 13.505 s worker CPU, 14.067 s worker Wall, Wall: 7.621 s, Cores in use: 1.84, Total efficiency (on 16 cores): 11.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-17T07:27:42.323556
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-resid.jpg
Stage coadds : Wall: 8.21 s, CPU: 0.61 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 195 MB, VmData: 224 MB, maxrss: 0.2031 MB
Stage coadds finished: 2020-07-17T07:27:50.535455
Resources for stage coadds : 15.818 s worker CPU, 16.131 s worker Wall, Wall: 8.214 s, Cores in use: 2.00, Total efficiency (on 16 cores): 12.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-17T07:27:50.564218
Cut to 1 unWISE tiles
Reading WISE tile 1639m091 band 1
Reading WISE tile 1639m091 band 2
Reading WISE tile 1639m091 band 3
Reading WISE tile 1639m091 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 792 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 176 MB, maxrss: 0.178024 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 854 MB, VmSize: 854 MB, VmRSS: 202 MB, VmData: 234 MB, maxrss: 0.206996 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 849 MB, VmSize: 849 MB, VmRSS: 199 MB, VmData: 234 MB, maxrss: 0.204264 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/163/1639m091/unwise-1639m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 936 MB, VmSize: 796 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.206984 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/tmp-legacysurvey-custom-163830m09729-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.76 s, CPU: 0.50 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 196 MB, VmData: 224 MB, maxrss: 0.2031 MB
Stage wise_forced finished: 2020-07-17T07:27:52.328653
Resources for stage wise_forced : 3.131 s worker CPU, 4.119 s worker Wall, Wall: 1.766 s, Cores in use: 2.06, Total efficiency (on 16 cores): 12.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-17T07:27:52.340084
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/coadd/cus/custom-163830m09729/legacysurvey-custom-163830m09729-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/tractor-i/cus/tractor-custom-163830m09729.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/tractor/cus/tractor-custom-163830m09729.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/tractor/cus/brick-custom-163830m09729.sha256sum
Stage writecat : Wall: 0.67 s, CPU: 0.55 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 198 MB, VmData: 224 MB, maxrss: 0.33322 MB
Stage writecat finished: 2020-07-17T07:27:53.010169
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.672 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/PGC987209/PGC987209-largegalaxy-writecat.p
All done: 34.590 s worker CPU, 64.648 s worker Wall, Wall: 48.765 s, Cores in use: 0.91, Total efficiency (on 16 cores): 5.7 %
Finished galaxy PGC987209 in 0.905 minutes.