Started working on galaxy PGC992514 at Thu Jun  4 07:20:33 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.10787450000004 -9.3208056 --width 337 --height 337 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-04T07:20:35.069696
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '208.10787450000004', '-9.3208056', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.10787450000004 -9.3208056 --width 337 --height 337 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 208.10787450000004 -9.3208056
Starting process 27187 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 27188 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057532 MB
Starting process 27189 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057532 MB
Starting process 27190 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057472 MB
Starting process 27191 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05754 MB
Starting process 27192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057544 MB
Starting process 27193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057484 MB
Starting process 27194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057484 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-04T07:20:38.222515
Keeping 4 CCDs:
   c4d_170305_074357_ooi_r_ls9.fits.fz c4d_170305_074357_ooi_r_ls9-S4 r exptime 66.0 propid 2014B-0404 seeing 1.01 MJD 57817.321 object DECaLS_1295_r
   c4d_180128_085802_ooi_z_ls9.fits.fz c4d_180128_085802_ooi_z_ls9-S4 z exptime 104.0 propid 2014B-0404 seeing 0.91 MJD 58146.374 object DECaLS_1295_z
   c4d_160410_050306_ooi_g_ls9.fits.fz c4d_160410_050306_ooi_g_ls9-S4 g exptime 71.0 propid 2014B-0404 seeing 1.25 MJD 57488.209 object DECaLS_1295_g
   c4d_180128_085802_ooi_z_ls9.fits.fz c4d_180128_085802_ooi_z_ls9-N4 z exptime 104.0 propid 2014B-0404 seeing 0.93 MJD 58146.374 object DECaLS_1295_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[N4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fbcc-r-20170305T074201_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9568910-g-20160410T050107_oi[S4,noinherit][2046,4094][real]: DECaLS_1
Stage tims : Wall: 17.56 s, CPU: 3.12 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 167 MB, VmData: 200 MB, maxrss: 0.448376 MB
Stage tims finished: 2020-06-04T07:20:55.779611
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fbcc-r-20170305T074201_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Resources for stage tims : 1.891 s worker CPU, 52.320 s worker Wall, Wall: 17.558 s, Cores in use: 0.29, Total efficiency (on 8 cores): 3.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9568910-g-20160410T050107_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[N4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Running stage refs at 2020-06-04T07:20:55.791602
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07177.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07178.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07050.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07306.fits
Matched 2 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/reference-custom-208107m09320.fits
Stage refs : Wall: 5.68 s, CPU: 4.36 s, VmPeak: 1024 MB, VmSize: 1016 MB, VmRSS: 190 MB, VmData: 223 MB, maxrss: 0.448376 MB
Stage refs finished: 2020-06-04T07:21:01.473083
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.683 s, Cores in use: 0.77, Total efficiency (on 8 cores): 9.6 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-04T07:21:01.474886
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outlier-mask-custom-208107m09320.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-pre-custom-208107m09320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outlier-mask-custom-208107m09320.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-post-custom-208107m09320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-masked-pos-custom-208107m09320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-masked-neg-custom-208107m09320.jpg
Stage outliers : Wall: 2.59 s, CPU: 2.14 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.448376 MB
Stage outliers finished: 2020-06-04T07:21:04.067609
Resources for stage outliers : 0.166 s worker CPU, 0.428 s worker Wall, Wall: 2.594 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-04T07:21:04.069763
Stage halos : Wall: 3.04 s, CPU: 2.49 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 201 MB, VmData: 230 MB, maxrss: 0.448376 MB
Stage halos finished: 2020-06-04T07:21:07.110712
Resources for stage halos : 0.090 s worker CPU, 1.638 s worker Wall, Wall: 3.042 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.6 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-04T07:21:07.112775
PSF sigmas in coadd pixels: ['2.03']
Using average PSF sigma 2.028590061572034
Gaussian PSF norm 0.1390595355452308 vs pixelized 0.11230652
average tim pixel scale / coadd scale: 1.0010929652027614
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.64']
Using average PSF sigma 1.637278244808796
Gaussian PSF norm 0.17229496126776037 vs pixelized 0.14702384
average tim pixel scale / coadd scale: 1.0011469516974254
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48']
Using average PSF sigma 1.4843667873408786
Gaussian PSF norm 0.190043858552796 vs pixelized 0.15409781
average tim pixel scale / coadd scale: 1.0011089612011805
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.07 s, CPU: 0.06 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 202 MB, VmData: 230 MB, maxrss: 0.448376 MB
Stage fit_on_coadds finished: 2020-06-04T07:21:07.187121
Resources for stage fit_on_coadds : 0.025 s worker CPU, 0.025 s worker Wall, Wall: 0.076 s, Cores in use: 1.10, Total efficiency (on 8 cores): 13.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-04T07:21:07.189391
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 67952 potential peaks
Of 67952 potential peaks: 67945 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept
SED z : 5 new peaks
Found 56461 potential peaks
Of 56461 potential peaks: 56456 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 58018 potential peaks
Of 58018 potential peaks: 58016 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 56537 potential peaks
Of 56537 potential peaks: 56531 in veto map, 1 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 56550 potential peaks
Of 56550 potential peaks: 56548 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 11 new sources
Median coadd sky for g : 7.961663e-05
Median coadd sky for r : 0.00023421877
Median coadd sky for z : 0.000120079385
Stage srcs : Wall: 5.87 s, CPU: 3.58 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.448376 MB
Stage srcs finished: 2020-06-04T07:21:13.058832
Resources for stage srcs : 5.866 s worker CPU, 5.866 s worker Wall, Wall: 5.871 s, Cores in use: 1.61, Total efficiency (on 8 cores): 20.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-04T07:21:13.072133
Blob 1 of 9, id: 0, sources: 10, size: 337x266, npix 82916, brick X: 0,337, Y: 0,266, one pixel: 0 0
Blob 2 of 9, id: 3, sources: 1, size: 39x41, npix 1091, brick X: 151,190, Y: 246,287, one pixel: 166 246
Blob 3 of 9, id: 6, sources: 2, size: 43x34, npix 885, brick X: 159,202, Y: 303,337, one pixel: 167 303
Blob 4 of 9, id: 8, sources: 1, size: 32x23, npix 512, brick X: 99,131, Y: 314,337, one pixel: 112 314
Blob 5 of 9, id: 7, sources: 1, size: 23x23, npix 325, brick X: 297,320, Y: 304,327, one pixel: 307 304
Blob 6 of 9, id: 4, sources: 1, size: 20x21, npix 239, brick X: 45,65, Y: 256,277, one pixel: 55 256
Blob 7 of 9, id: 5, sources: 1, size: 19x19, npix 199, brick X: 298,317, Y: 266,285, one pixel: 306 266
Blob 8 of 9, id: 2, sources: 1, size: 18x18, npix 180, brick X: 71,89, Y: 246,264, one pixel: 79 246
Blob 9 of 9, id: 1, sources: 1, size: 17x19, npix 179, brick X: 250,267, Y: 244,263, one pixel: 258 244
Blob 7 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 949 MB, VmSize: 718 MB, VmRSS: 137 MB, VmData: 181 MB, maxrss: 0.139852 MB
Blob 8 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 88 MB, VmData: 139 MB, maxrss: 0.090188 MB
Blob 2 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 926 MB, VmSize: 714 MB, VmRSS: 137 MB, VmData: 177 MB, maxrss: 0.140276 MB
Blob 9 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 949 MB, VmSize: 718 MB, VmRSS: 137 MB, VmData: 181 MB, maxrss: 0.139852 MB
Blob 6 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09492 MB
Blob 5 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 685 MB, VmSize: 685 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.113988 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 950 MB, VmSize: 714 MB, VmRSS: 137 MB, VmData: 177 MB, maxrss: 0.140316 MB
Blob 4 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 931 MB, VmSize: 714 MB, VmRSS: 140 MB, VmData: 177 MB, maxrss: 0.143612 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.10356, -9.32571), pm (-9.1, 7.6), parallax 1.482 with NanoMaggies: g=15.1, r=14.5, z=14.2
Reset brightness to NanoMaggies: g=15.1, r=14.5, z=14.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.10089, -9.32662), pm (-4.8, -5.9), parallax 0.122 with NanoMaggies: g=17.2, r=16.8, z=16.6
Reset brightness to NanoMaggies: g=17.2, r=16.8, z=16.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.09137, -9.32709), pm (3.2, -6.6), parallax 0.375 with NanoMaggies: g=17.6, r=17.1, z=16.9
Reset brightness to NanoMaggies: g=17.6, r=17.1, z=16.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.10223, -9.32564), pm (-24.5, -5.2), parallax 1.251 with NanoMaggies: g=21.7, r=20.3, z=18.9
Reset brightness to NanoMaggies: g=21.7, r=20.3, z=18.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.11155, -9.32049), pm (-19.7, -4.8), parallax -1.459 with NanoMaggies: g=(flux -2.21e+03), r=(flux -638), z=19.2
Reset brightness to NanoMaggies: g=22, r=20.6, z=19.2
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 8.78 s, CPU: 8.78 s, VmPeak: 712 MB, VmSize: 702 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.158 MB
Old catalog: 20
New catalog: 17
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/blobs-custom-208107m09320.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/all-models-custom-208107m09320.fits
Stage fitblobs : Wall: 11.06 s, CPU: 2.22 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.448376 MB
Stage fitblobs finished: 2020-06-04T07:21:24.135120
Resources for stage fitblobs : 13.440 s worker CPU, 13.471 s worker Wall, Wall: 11.064 s, Cores in use: 1.42, Total efficiency (on 8 cores): 17.7 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-04T07:21:24.138516
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-resid.jpg
Stage coadds : Wall: 6.44 s, CPU: 2.64 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.448376 MB
Stage coadds finished: 2020-06-04T07:21:30.581121
Resources for stage coadds : 11.328 s worker CPU, 11.579 s worker Wall, Wall: 6.444 s, Cores in use: 2.17, Total efficiency (on 8 cores): 27.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-04T07:21:30.582948
Cut to 1 unWISE tiles
Reading WISE tile 2083m091 band 1
Reading WISE tile 2083m091 band 4
Reading WISE tile 2083m091 band 3
Reading WISE tile 2083m091 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 926 MB, VmSize: 795 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.18828 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 949 MB, VmSize: 794 MB, VmRSS: 142 MB, VmData: 173 MB, maxrss: 0.204324 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 789 MB, VmSize: 787 MB, VmRSS: 136 MB, VmData: 168 MB, maxrss: 0.20006 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 950 MB, VmSize: 794 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.207332 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.39 s, CPU: 2.92 s, VmPeak: 1025 MB, VmSize: 1025 MB, VmRSS: 215 MB, VmData: 241 MB, maxrss: 0.448376 MB
Stage wise_forced finished: 2020-06-04T07:21:34.970457
Resources for stage wise_forced : 3.288 s worker CPU, 4.543 s worker Wall, Wall: 4.389 s, Cores in use: 1.42, Total efficiency (on 8 cores): 17.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-04T07:21:34.972417
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/tractor-i/cus/tractor-custom-208107m09320.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/tractor/cus/tractor-custom-208107m09320.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/tractor/cus/brick-custom-208107m09320.sha256sum
Stage writecat : Wall: 4.00 s, CPU: 3.82 s, VmPeak: 1158 MB, VmSize: 1030 MB, VmRSS: 217 MB, VmData: 241 MB, maxrss: 0.448376 MB
Stage writecat finished: 2020-06-04T07:21:38.968644
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.997 s, Cores in use: 0.96, Total efficiency (on 8 cores): 11.9 %
Stage writecat finished
All done: 36.097 s worker CPU, 89.873 s worker Wall, Wall: 60.751 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.1 %
Finished galaxy PGC992514 in 1.092 minutes.
Started working on galaxy PGC992514 at Sat Jul 18 22:19:56 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.10787450000004 -9.3208056 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T22:19:57.597656
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '208.10787450000004', '-9.3208056', '--width', '337', '--height', '337', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 208.10787450000004 -9.3208056 --width 337 --height 337 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 208.10787450000004 -9.3208056
Starting process 24276 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB
Starting process 24277 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB
Starting process 24278 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 24279 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05902 MB
Starting process 24280 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059024 MB
Starting process 24281 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059024 MB
Starting process 24282 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 24283 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 24284 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 24285 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 24286 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 24287 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 24288 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 24289 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 24290 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 24291 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 24292 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 24293 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 24294 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 24295 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 24296 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 24297 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 24298 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 24299 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 24300 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 24301 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 24302 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 24303 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 24304 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 24305 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 24306 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 24307 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T22:19:58.091478
Keeping 4 CCDs:
   c4d_170305_074357_ooi_r_ls9.fits.fz c4d_170305_074357_ooi_r_ls9-S4 r exptime 66.0 propid 2014B-0404 seeing 1.01 MJD 57817.321 object DECaLS_1295_r
   c4d_180128_085802_ooi_z_ls9.fits.fz c4d_180128_085802_ooi_z_ls9-S4 z exptime 104.0 propid 2014B-0404 seeing 0.91 MJD 58146.374 object DECaLS_1295_z
   c4d_160410_050306_ooi_g_ls9.fits.fz c4d_160410_050306_ooi_g_ls9-S4 g exptime 71.0 propid 2014B-0404 seeing 1.25 MJD 57488.209 object DECaLS_1295_g
   c4d_180128_085802_ooi_z_ls9.fits.fz c4d_180128_085802_ooi_z_ls9-N4 z exptime 104.0 propid 2014B-0404 seeing 0.93 MJD 58146.374 object DECaLS_1295_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[N4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fbcc-r-20170305T074201_oi[S4,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9568910-g-20160410T050107_oi[S4,noinherit][2046,4094][real]: DECaLS_1
Stage tims : Wall: 4.06 s, CPU: 0.85 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 168 MB, VmData: 202 MB, maxrss: 0.19226 MB
Stage tims finished: 2020-07-18T22:20:02.150257
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950fbcc-r-20170305T074201_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Resources for stage tims : 1.955 s worker CPU, 10.894 s worker Wall, Wall: 4.062 s, Cores in use: 0.69, Total efficiency (on 32 cores): 2.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9568910-g-20160410T050107_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Running stage refs at 2020-07-18T22:20:03.557091
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07177.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07178.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07050.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07306.fits
Matched 2 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/reference-custom-208107m09320.fits
Stage refs : Wall: 4.79 s, CPU: 2.28 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 193 MB, VmData: 225 MB, maxrss: 0.197156 MB
Stage refs finished: 2020-07-18T22:20:08.345407
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.791 s, Cores in use: 0.48, Total efficiency (on 32 cores): 1.5 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-refs.p
Running stage outliers
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180128T085802_oi[N4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
/opt/conda/lib/python3.7/site-packages/numpy/core/fromnumeric.py:3257: RuntimeWarning: Mean of empty slice.
  out=out, **kwargs)
/opt/conda/lib/python3.7/site-packages/numpy/core/_methods.py:161: RuntimeWarning: invalid value encountered in true_divide
  ret = ret.dtype.type(ret / rcount)
/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py:858: RuntimeWarning: invalid value encountered in greater
  n = np.sum(invvar > thresh)
Running stage outliers at 2020-07-18T22:20:08.364907
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outlier-mask-custom-208107m09320.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-pre-custom-208107m09320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outlier-mask-custom-208107m09320.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-post-custom-208107m09320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-masked-pos-custom-208107m09320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/outliers-masked-neg-custom-208107m09320.jpg
Stage outliers : Wall: 0.85 s, CPU: 0.49 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.207756 MB
Stage outliers finished: 2020-07-18T22:20:09.219343
Resources for stage outliers : 0.206 s worker CPU, 0.266 s worker Wall, Wall: 0.857 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T22:20:09.232044
Stage halos : Wall: 0.35 s, CPU: 0.28 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 203 MB, VmData: 233 MB, maxrss: 0.2081 MB
Stage halos finished: 2020-07-18T22:20:09.585578
Resources for stage halos : 0.110 s worker CPU, 0.189 s worker Wall, Wall: 0.356 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-07-18T22:20:09.600774
PSF sigmas in coadd pixels: ['2.03']
Using average PSF sigma 2.028590061572034
Gaussian PSF norm 0.1390595355452308 vs pixelized 0.11230652
average tim pixel scale / coadd scale: 1.0010929652027614
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.64']
Using average PSF sigma 1.637278244808796
Gaussian PSF norm 0.17229496126776037 vs pixelized 0.14702384
average tim pixel scale / coadd scale: 1.0011469516974254
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.48']
Using average PSF sigma 1.4843667873408786
Gaussian PSF norm 0.190043858552796 vs pixelized 0.15409781
average tim pixel scale / coadd scale: 1.0011089612011805
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.11 s, CPU: 0.06 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.2097 MB
Stage fit_on_coadds finished: 2020-07-18T22:20:09.707949
Resources for stage fit_on_coadds : 0.044 s worker CPU, 0.059 s worker Wall, Wall: 0.110 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T22:20:09.738993
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 67952 potential peaks
Of 67952 potential peaks: 67945 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept
SED z : 5 new peaks
Found 56461 potential peaks
Of 56461 potential peaks: 56456 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 58018 potential peaks
Of 58018 potential peaks: 58016 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 56537 potential peaks
Of 56537 potential peaks: 56531 in veto map, 1 cut by saddle test, 0 cut by aper test, 5 kept
SED Flat : 5 new peaks
Found 56550 potential peaks
Of 56550 potential peaks: 56548 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 11 new sources
Median coadd sky for g : 7.961663e-05
Median coadd sky for r : 0.00023421877
Median coadd sky for z : 0.000120079385
Stage srcs : Wall: 2.91 s, CPU: 0.71 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.212376 MB
Stage srcs finished: 2020-07-18T22:20:12.649629
Resources for stage srcs : 5.622 s worker CPU, 5.695 s worker Wall, Wall: 2.913 s, Cores in use: 2.17, Total efficiency (on 32 cores): 6.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T22:20:12.695054
Blob 1 of 9, id: 0, sources: 10, size: 337x266, npix 82916, brick X: 0,337, Y: 0,266, one pixel: 0 0
Blob 2 of 9, id: 3, sources: 1, size: 39x41, npix 1091, brick X: 151,190, Y: 246,287, one pixel: 166 246
Blob 3 of 9, id: 6, sources: 2, size: 43x34, npix 885, brick X: 159,202, Y: 303,337, one pixel: 167 303
Blob 4 of 9, id: 8, sources: 1, size: 32x23, npix 512, brick X: 99,131, Y: 314,337, one pixel: 112 314
Blob 5 of 9, id: 7, sources: 1, size: 23x23, npix 325, brick X: 297,320, Y: 304,327, one pixel: 307 304
Blob 6 of 9, id: 4, sources: 1, size: 20x21, npix 239, brick X: 45,65, Y: 256,277, one pixel: 55 256
Blob 7 of 9, id: 5, sources: 1, size: 19x19, npix 199, brick X: 298,317, Y: 266,285, one pixel: 306 266
Blob 8 of 9, id: 2, sources: 1, size: 18x18, npix 180, brick X: 71,89, Y: 246,264, one pixel: 79 246
Blob 9 of 9, id: 1, sources: 1, size: 17x19, npix 179, brick X: 250,267, Y: 244,263, one pixel: 258 244
Blob 9 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 86 MB, VmData: 139 MB, maxrss: 0.087992 MB
Blob 8 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 88 MB, VmData: 140 MB, maxrss: 0.089632 MB
Blob 7 finished, total: Wall: 0.11 s, CPU: 0.08 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 82 MB, VmData: 136 MB, maxrss: 0.083976 MB
Blob 2 finished, total: Wall: 0.13 s, CPU: 0.09 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 83 MB, VmData: 137 MB, maxrss: 0.085416 MB
Blob 6 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 138 MB, VmData: 180 MB, maxrss: 0.141728 MB
Blob 5 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 937 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144544 MB
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 1.28 s, CPU: 1.24 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091672 MB
Blob 3 finished, total: Wall: 1.49 s, CPU: 1.46 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091208 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.10356, -9.32571), pm (-9.1, 7.6), parallax 1.482 with NanoMaggies: g=15.1, r=14.5, z=14.2
Reset brightness to NanoMaggies: g=15.1, r=14.5, z=14.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.10089, -9.32662), pm (-4.8, -5.9), parallax 0.122 with NanoMaggies: g=17.2, r=16.8, z=16.6
Reset brightness to NanoMaggies: g=17.2, r=16.8, z=16.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.09137, -9.32709), pm (3.2, -6.6), parallax 0.375 with NanoMaggies: g=17.6, r=17.1, z=16.9
Reset brightness to NanoMaggies: g=17.6, r=17.1, z=16.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.10223, -9.32564), pm (-24.5, -5.2), parallax 1.251 with NanoMaggies: g=21.7, r=20.3, z=18.9
Reset brightness to NanoMaggies: g=21.7, r=20.3, z=18.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (208.11155, -9.32049), pm (-19.7, -4.8), parallax -1.459 with NanoMaggies: g=(flux -2.21e+03), r=(flux -638), z=19.2
Reset brightness to NanoMaggies: g=22, r=20.6, z=19.2
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 8.56 s, CPU: 8.56 s, VmPeak: 931 MB, VmSize: 734 MB, VmRSS: 163 MB, VmData: 196 MB, maxrss: 0.181976 MB
Old catalog: 20
New catalog: 17
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/blobs-custom-208107m09320.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/metrics/cus/all-models-custom-208107m09320.fits
Stage fitblobs : Wall: 9.06 s, CPU: 0.45 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.215384 MB
Stage fitblobs finished: 2020-07-18T22:20:21.750335
Resources for stage fitblobs : 12.478 s worker CPU, 12.647 s worker Wall, Wall: 9.058 s, Cores in use: 1.43, Total efficiency (on 32 cores): 4.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T22:20:21.811469
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-resid.jpg
Stage coadds : Wall: 5.73 s, CPU: 0.74 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 217 MB, VmData: 244 MB, maxrss: 0.222172 MB
Stage coadds finished: 2020-07-18T22:20:27.536601
Resources for stage coadds : 53.832 s worker CPU, 66.858 s worker Wall, Wall: 5.728 s, Cores in use: 9.53, Total efficiency (on 32 cores): 29.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T22:20:27.552049
Cut to 1 unWISE tiles
Reading WISE tile 2083m091 band 1
Reading WISE tile 2083m091 band 2
Reading WISE tile 2083m091 band 3
Reading WISE tile 2083m091 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 937 MB, VmSize: 799 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.191604 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 931 MB, VmSize: 796 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.21332 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 792 MB, VmSize: 790 MB, VmRSS: 139 MB, VmData: 170 MB, maxrss: 0.201016 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/208/2083m091/unwise-2083m091-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 801 MB, VmSize: 799 MB, VmRSS: 147 MB, VmData: 179 MB, maxrss: 0.20756 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/tmp-legacysurvey-custom-208107m09320-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.72 s, CPU: 0.50 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 218 MB, VmData: 244 MB, maxrss: 0.22288 MB
Stage wise_forced finished: 2020-07-18T22:20:29.275180
Resources for stage wise_forced : 3.069 s worker CPU, 3.978 s worker Wall, Wall: 1.725 s, Cores in use: 2.07, Total efficiency (on 32 cores): 6.5 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T22:20:29.292314
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/coadd/cus/custom-208107m09320/legacysurvey-custom-208107m09320-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/tractor-i/cus/tractor-custom-208107m09320.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/tractor/cus/tractor-custom-208107m09320.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/tractor/cus/brick-custom-208107m09320.sha256sum
Stage writecat : Wall: 1.81 s, CPU: 0.56 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 219 MB, VmData: 244 MB, maxrss: 0.35548 MB
Stage writecat finished: 2020-07-18T22:20:31.099590
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.810 s, Cores in use: 0.31, Total efficiency (on 32 cores): 1.0 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/208/PGC992514/PGC992514-largegalaxy-writecat.p
All done: 77.322 s worker CPU, 100.593 s worker Wall, Wall: 33.031 s, Cores in use: 2.55, Total efficiency (on 32 cores): 8.0 %
Finished galaxy PGC992514 in 0.827 minutes.