Started working on galaxy PGC2750973 at Sun Jun  7 19:12:48 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 289.3035465 72.68657809999999 --width 397 --height 397 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:12:49.781109
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '289.3035465', '72.68657809999999', '--width', '397', '--height', '397', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 289.3035465 72.68657809999999 --width 397 --height 397 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 289.3035465 72.68657809999999
Starting process 34265 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 34266 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 34267 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 34268 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:12:50.320552
Keeping 4 CCDs:
   k4m_171117_043011_ooi_zd_ls9.fits.fz k4m_171117_043011_ooi_zd_ls9-CCD2 z exptime 180.105 propid 2016A-0453 seeing 1.12 MJD 58074.188 object MzLS_718950_z
   k4m_171117_043011_ooi_zd_ls9.fits.fz k4m_171117_043011_ooi_zd_ls9-CCD4 z exptime 180.105 propid 2016A-0453 seeing 1.11 MJD 58074.188 object MzLS_718950_z
   ksb_180703_091326_ooi_r_ls9.fits.fz ksb_180703_091326_ooi_r_ls9-CCD3 r exptime 250.0 propid NOTBASS seeing 1.23 MJD 58302.384 object 47752
   ksb_171110_035453_ooi_g_ls9.fits.fz ksb_171110_035453_ooi_g_ls9-CCD3 g exptime 250.0 propid 2015A-0801 seeing 1.50 MJD 58067.163 object 47752
mosaic get_fwhm: self.fwhm = 4.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3071 3476 and amp range 2048 4095 and image y 0 49 and amp range 0 2021
Range in image: x 0 406 , y 0 50 (with image size 406 x 50)
dzp -0.029506588 -> scaling image by 0.9731893881648719
Faked up EXPNUM 83020134
Faked up EXPNUM 83020134
Faked up EXPNUM 83020134
90prime get_fwhm: self.fwhm = 2.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 542 774 and amp range 0 2015 and image y 15 100 and amp range 0 2047
Range in image: x 0 233 , y 0 86 (with image size 233 x 86)
dzp -0.039144866 -> scaling image by 0.9645884414840357
mosaic get_fwhm: self.fwhm = 4.31
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3059 3465 and amp range 2048 4095 and image y 3957 4072 and amp range 2040 4078
Range in image: x 0 407 , y 0 116 (with image size 407 x 116)
dzp -0.036442947 -> scaling image by 0.9669918668439786
Faked up EXPNUM 80670066
Faked up EXPNUM 80670066
Faked up EXPNUM 80670066
90prime get_fwhm: self.fwhm = 3.31
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 560 792 and amp range 0 2015 and image y 15 100 and amp range 0 2047
Range in image: x 0 233 , y 0 86 (with image size 233 x 86)
dzp -0.03692675 -> scaling image by 0.9665610717922232
Stage tims : Wall: 4.98 s, CPU: 0.99 s, VmPeak: 940 MB, VmSize: 940 MB, VmRSS: 167 MB, VmData: 200 MB, maxrss: 0.56786 MB
Stage tims finished: 2020-06-07T19:12:55.301743
Resources for stage tims : 2.821 s worker CPU, 8.062 s worker Wall, Wall: 4.982 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:12:55.314568
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00302.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00255.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/reference-custom-289303p72686.fits
Stage refs : Wall: 5.50 s, CPU: 4.26 s, VmPeak: 987 MB, VmSize: 981 MB, VmRSS: 210 MB, VmData: 241 MB, maxrss: 0.56786 MB
Stage refs finished: 2020-06-07T19:13:00.817447
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.504 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:13:00.819056
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outlier-mask-custom-289303p72686.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-pre-custom-289303p72686.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outlier-mask-custom-289303p72686.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-post-custom-289303p72686.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-masked-pos-custom-289303p72686.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-masked-neg-custom-289303p72686.jpg
Stage outliers : Wall: 1.07 s, CPU: 0.66 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 220 MB, VmData: 249 MB, maxrss: 0.56786 MB
Stage outliers finished: 2020-06-07T19:13:01.890664
Resources for stage outliers : 0.208 s worker CPU, 0.209 s worker Wall, Wall: 1.073 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:13:01.892609
Stage halos : Wall: 0.39 s, CPU: 0.37 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 221 MB, VmData: 249 MB, maxrss: 0.56786 MB
Stage halos finished: 2020-06-07T19:13:02.284583
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.393 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T19:13:02.286363
PSF sigmas in coadd pixels: ['2.44']
Using average PSF sigma 2.4373187607890006
Gaussian PSF norm 0.11573980240588612 vs pixelized 0.09220653
average tim pixel scale / coadd scale: 1.7304227150663847
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.99']
Using average PSF sigma 1.9948656867565486
Gaussian PSF norm 0.14141041857937614 vs pixelized 0.1249267
average tim pixel scale / coadd scale: 1.7298650545715033
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.82', '1.81']
Using average PSF sigma 1.8135547174701045
Gaussian PSF norm 0.15554799039501732 vs pixelized 0.14490724
average tim pixel scale / coadd scale: 0.9911287078751208
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.11 s, CPU: 0.08 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.56786 MB
Stage fit_on_coadds finished: 2020-06-07T19:13:02.397073
Resources for stage fit_on_coadds : 0.068 s worker CPU, 0.069 s worker Wall, Wall: 0.112 s, Cores in use: 1.35, Total efficiency (on 4 cores): 33.7 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:13:02.399322
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 83662 potential peaks
Of 83662 potential peaks: 83652 in veto map, 3 cut by saddle test, 0 cut by aper test, 7 kept
SED z : 7 new peaks
Found 87354 potential peaks
Of 87354 potential peaks: 87351 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 87021 potential peaks
Of 87021 potential peaks: 87018 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 70034 potential peaks
Of 70034 potential peaks: 70032 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 70068 potential peaks
Of 70068 potential peaks: 70065 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 10 new sources
Median coadd sky for g : 0.0001581841
Median coadd sky for r : -5.6350684e-05
Median coadd sky for z : 0.0003254977
Stage srcs : Wall: 5.85 s, CPU: 0.92 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 227 MB, VmData: 254 MB, maxrss: 0.56786 MB
Stage srcs finished: 2020-06-07T19:13:08.245797
Resources for stage srcs : 11.727 s worker CPU, 11.728 s worker Wall, Wall: 5.847 s, Cores in use: 2.16, Total efficiency (on 4 cores): 54.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:13:09.539958
Blob 1 of 2, id: 0, sources: 20, size: 337x397, npix 118820, brick X: 0,337, Y: 0,397, one pixel: 0 0
Blob 2 of 2, id: 1, sources: 4, size: 76x35, npix 1316, brick X: 321,397, Y: 72,107, one pixel: 330 72
Measuring 3 iterative sources
Blob 2 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 789 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.55331, 72.73608), pm (14.2, -10.0), parallax 2.441 with NanoMaggies: g=8.87, r=7.78, z=7.24
Reset brightness to NanoMaggies: g=8.87, r=7.78, z=7.24
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.34143, 72.69505), pm (0.5, 1.1), parallax 0.719 with NanoMaggies: g=13.3, r=12.5, z=13.3
Reset brightness to NanoMaggies: g=13.3, r=12.5, z=12.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.31771, 72.66970), pm (-4.4, -9.3), parallax 0.767 with NanoMaggies: g=16.2, r=15.5, z=15.2
Reset brightness to NanoMaggies: g=16.2, r=15.5, z=15.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.31595, 72.68894), pm (-11.1, 3.9), parallax 2.672 with NanoMaggies: g=18.4, r=17, z=15.6
Reset brightness to NanoMaggies: g=18.4, r=17, z=15.6
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.24316, ee1=0.943358, ee2=0.157029
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.36465, 72.66974), pm (-0.1, 1.7), parallax 0.496 with NanoMaggies: g=19, r=18.1, z=17.7
Reset brightness to NanoMaggies: g=19, r=18.1, z=17.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.30297, 72.67547), pm (-0.6, -1.5), parallax 0.479 with NanoMaggies: g=19, r=18.3, z=18
Reset brightness to NanoMaggies: g=19, r=18.3, z=18
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.29880, 72.67520), pm (-0.5, -2.3), parallax 0.410 with NanoMaggies: g=18.9, r=18.4, z=18.2
Reset brightness to NanoMaggies: g=18.9, r=18.4, z=18.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.35489, 72.69401), pm (-1.9, -10.0), parallax 0.951 with NanoMaggies: g=22.3, r=20.9, z=(flux -68.4)
Reset brightness to NanoMaggies: g=22.3, r=20.9, z=19.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.30782, 72.67363), pm (0.5, 6.1), parallax -0.328 with NanoMaggies: g=21.9, r=20.6, z=19.9
Reset brightness to NanoMaggies: g=21.9, r=20.6, z=19.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.35609, 72.68830), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.9, r=20.9, z=19
Reset brightness to NanoMaggies: g=21.9, r=20.9, z=20.4
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 18.07 s, CPU: 18.07 s, VmPeak: 789 MB, VmSize: 734 MB, VmRSS: 167 MB, VmData: 199 MB, maxrss: 0.20992 MB
Old catalog: 25
New catalog: 29
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/blobs-custom-289303p72686.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/all-models-custom-289303p72686.fits
Stage fitblobs : Wall: 18.75 s, CPU: 0.55 s, VmPeak: 990 MB, VmSize: 990 MB, VmRSS: 233 MB, VmData: 260 MB, maxrss: 0.56786 MB
Stage fitblobs finished: 2020-06-07T19:13:28.287729
Resources for stage fitblobs : 19.649 s worker CPU, 19.672 s worker Wall, Wall: 18.749 s, Cores in use: 1.08, Total efficiency (on 4 cores): 26.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:13:28.289636
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-resid.jpg
Stage coadds : Wall: 6.27 s, CPU: 0.87 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.56786 MB
Stage coadds finished: 2020-06-07T19:13:34.555364
Resources for stage coadds : 13.188 s worker CPU, 13.467 s worker Wall, Wall: 6.267 s, Cores in use: 2.24, Total efficiency (on 4 cores): 56.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:13:34.557228
Cut to 2 unWISE tiles
Reading WISE tile 2870p726 band 1
Reading WISE tile 2870p726 band 3
Reading WISE tile 2870p726 band 2
Reading WISE tile 2870p726 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 159 MB, VmData: 182 MB, maxrss: 0.20992 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 797 MB, VmSize: 787 MB, VmRSS: 138 MB, VmData: 173 MB, maxrss: 0.201136 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.20666 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 795 MB, VmSize: 787 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.201456 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.31 s, CPU: 0.47 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.56786 MB
Stage wise_forced finished: 2020-06-07T19:13:38.864652
Resources for stage wise_forced : 8.976 s worker CPU, 12.494 s worker Wall, Wall: 4.309 s, Cores in use: 2.19, Total efficiency (on 4 cores): 54.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:13:38.866534
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/tractor-i/cus/tractor-custom-289303p72686.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/tractor/cus/tractor-custom-289303p72686.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/tractor/cus/brick-custom-289303p72686.sha256sum
Stage writecat : Wall: 0.76 s, CPU: 0.55 s, VmPeak: 1130 MB, VmSize: 1002 MB, VmRSS: 251 MB, VmData: 276 MB, maxrss: 0.56786 MB
Stage writecat finished: 2020-06-07T19:13:39.621931
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.756 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.1 %
Stage writecat finished
All done: 56.640 s worker CPU, 65.702 s worker Wall, Wall: 49.307 s, Cores in use: 1.35, Total efficiency (on 4 cores): 33.7 %
Finished galaxy PGC2750973 in 0.863 minutes.
Started working on galaxy PGC2750973 at Sat Jul 18 21:21:17 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 289.3035465 72.68657809999999 --width 397 --height 397 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T21:21:17.885681
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '289.3035465', '72.68657809999999', '--width', '397', '--height', '397', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 289.3035465 72.68657809999999 --width 397 --height 397 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 289.3035465 72.68657809999999
Starting process 22524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB
Starting process 22525 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 22526 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058924 MB
Starting process 22527 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 22528 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058844 MB
Starting process 22529 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058844 MB
Starting process 22530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 22531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 22532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 22533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 22534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 22535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 22536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 22537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 22538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB
Starting process 22539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 22540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 22541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 22542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB
Starting process 22543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 22544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 22545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 22546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB
Starting process 22547 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 22548 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 22549 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 22550 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 22551 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 22552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 22553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 22554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 22555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T21:21:18.539124
Keeping 4 CCDs:
   k4m_171117_043011_ooi_zd_ls9.fits.fz k4m_171117_043011_ooi_zd_ls9-CCD2 z exptime 180.105 propid 2016A-0453 seeing 1.12 MJD 58074.188 object MzLS_718950_z
   k4m_171117_043011_ooi_zd_ls9.fits.fz k4m_171117_043011_ooi_zd_ls9-CCD4 z exptime 180.105 propid 2016A-0453 seeing 1.11 MJD 58074.188 object MzLS_718950_z
   ksb_180703_091326_ooi_r_ls9.fits.fz ksb_180703_091326_ooi_r_ls9-CCD3 r exptime 250.0 propid NOTBASS seeing 1.23 MJD 58302.384 object 47752
   ksb_171110_035453_ooi_g_ls9.fits.fz ksb_171110_035453_ooi_g_ls9-CCD3 g exptime 250.0 propid 2015A-0801 seeing 1.50 MJD 58067.163 object 47752
mosaic get_fwhm: self.fwhm = 4.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3071 3476 and amp range 2048 4095 and image y 0 49 and amp range 0 2021
Range in image: x 0 406 , y 0 50 (with image size 406 x 50)
dzp -0.029506588 -> scaling image by 0.9731893881648719
mosaic get_fwhm: self.fwhm = 4.31
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3059 3465 and amp range 2048 4095 and image y 3957 4072 and amp range 2040 4078
Range in image: x 0 407 , y 0 116 (with image size 407 x 116)
dzp -0.036442947 -> scaling image by 0.9669918668439786
Faked up EXPNUM 83020134
Faked up EXPNUM 83020134
Faked up EXPNUM 83020134
90prime get_fwhm: self.fwhm = 2.71
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 542 774 and amp range 0 2015 and image y 15 100 and amp range 0 2047
Range in image: x 0 233 , y 0 86 (with image size 233 x 86)
dzp -0.039144866 -> scaling image by 0.9645884414840357
Faked up EXPNUM 80670066
Faked up EXPNUM 80670066
Faked up EXPNUM 80670066
90prime get_fwhm: self.fwhm = 3.31
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 560 792 and amp range 0 2015 and image y 15 100 and amp range 0 2047
Range in image: x 0 233 , y 0 86 (with image size 233 x 86)
dzp -0.03692675 -> scaling image by 0.9665610717922232
Stage tims : Wall: 2.73 s, CPU: 0.91 s, VmPeak: 943 MB, VmSize: 943 MB, VmRSS: 168 MB, VmData: 202 MB, maxrss: 0.207664 MB
Stage tims finished: 2020-07-18T21:21:21.266539
Resources for stage tims : 1.761 s worker CPU, 4.491 s worker Wall, Wall: 2.730 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-18T21:21:23.565647
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00302.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00255.fits
Matched 3 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/reference-custom-289303p72686.fits
Stage refs : Wall: 6.93 s, CPU: 3.79 s, VmPeak: 990 MB, VmSize: 984 MB, VmRSS: 211 MB, VmData: 243 MB, maxrss: 0.21616 MB
Stage refs finished: 2020-07-18T21:21:30.495452
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 6.933 s, Cores in use: 0.55, Total efficiency (on 32 cores): 1.7 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-18T21:21:30.560177
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outlier-mask-custom-289303p72686.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-pre-custom-289303p72686.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outlier-mask-custom-289303p72686.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-post-custom-289303p72686.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-masked-pos-custom-289303p72686.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/outliers-masked-neg-custom-289303p72686.jpg
Stage outliers : Wall: 5.70 s, CPU: 0.61 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.227608 MB
Stage outliers finished: 2020-07-18T21:21:36.255361
Resources for stage outliers : 0.301 s worker CPU, 0.384 s worker Wall, Wall: 5.698 s, Cores in use: 0.16, Total efficiency (on 32 cores): 0.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T21:21:36.340738
Stage halos : Wall: 0.43 s, CPU: 0.42 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.22778 MB
Stage halos finished: 2020-07-18T21:21:36.769197
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.431 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-07-18T21:21:36.901600
PSF sigmas in coadd pixels: ['2.44']
Using average PSF sigma 2.4373187607890006
Gaussian PSF norm 0.11573980240588612 vs pixelized 0.09220653
average tim pixel scale / coadd scale: 1.7304227150663847
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.99']
Using average PSF sigma 1.9948656867565486
Gaussian PSF norm 0.14141041857937614 vs pixelized 0.1249267
average tim pixel scale / coadd scale: 1.7298650545715033
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.82', '1.81']
Using average PSF sigma 1.8135547174701045
Gaussian PSF norm 0.15554799039501732 vs pixelized 0.14490724
average tim pixel scale / coadd scale: 0.9911287078751208
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.08 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.22936 MB
Stage fit_on_coadds finished: 2020-07-18T21:21:37.121815
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.076 s worker CPU, 0.110 s worker Wall, Wall: 0.222 s, Cores in use: 0.70, Total efficiency (on 32 cores): 2.2 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T21:21:37.179365
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 83662 potential peaks
Of 83662 potential peaks: 83652 in veto map, 3 cut by saddle test, 0 cut by aper test, 7 kept
SED z : 7 new peaks
Found 87354 potential peaks
Of 87354 potential peaks: 87351 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 87021 potential peaks
Of 87021 potential peaks: 87018 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 70034 potential peaks
Of 70034 potential peaks: 70032 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 70068 potential peaks
Of 70068 potential peaks: 70065 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 10 new sources
Median coadd sky for g : 0.0001581841
Median coadd sky for r : -5.6350684e-05
Median coadd sky for z : 0.0003254977
Stage srcs : Wall: 3.96 s, CPU: 0.89 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234668 MB
Stage srcs finished: 2020-07-18T21:21:41.139703
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage srcs : 7.519 s worker CPU, 7.567 s worker Wall, Wall: 3.963 s, Cores in use: 2.12, Total efficiency (on 32 cores): 6.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T21:21:41.155961
Blob 1 of 2, id: 0, sources: 20, size: 337x397, npix 118820, brick X: 0,337, Y: 0,397, one pixel: 0 0
Blob 2 of 2, id: 1, sources: 4, size: 76x35, npix 1316, brick X: 321,397, Y: 72,107, one pixel: 330 72
Measuring 3 iterative sources
Blob 2 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 803 MB, VmSize: 718 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144568 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.55331, 72.73608), pm (14.2, -10.0), parallax 2.441 with NanoMaggies: g=8.87, r=7.78, z=7.24
Reset brightness to NanoMaggies: g=8.87, r=7.78, z=7.24
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.31771, 72.66970), pm (-4.4, -9.3), parallax 0.767 with NanoMaggies: g=16.2, r=15.5, z=15.2
Reset brightness to NanoMaggies: g=16.2, r=15.5, z=15.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.31595, 72.68894), pm (-11.1, 3.9), parallax 2.672 with NanoMaggies: g=18.4, r=17, z=15.6
Reset brightness to NanoMaggies: g=18.4, r=17, z=15.6
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.24316, ee1=0.943358, ee2=0.157029
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.36465, 72.66974), pm (-0.1, 1.7), parallax 0.496 with NanoMaggies: g=19, r=18.1, z=17.7
Reset brightness to NanoMaggies: g=19, r=18.1, z=17.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.30297, 72.67547), pm (-0.6, -1.5), parallax 0.479 with NanoMaggies: g=19, r=18.3, z=18
Reset brightness to NanoMaggies: g=19, r=18.3, z=18
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.29880, 72.67520), pm (-0.5, -2.3), parallax 0.410 with NanoMaggies: g=18.9, r=18.4, z=18.2
Reset brightness to NanoMaggies: g=18.9, r=18.4, z=18.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.35489, 72.69401), pm (-1.9, -10.0), parallax 0.951 with NanoMaggies: g=22.3, r=20.9, z=(flux -68.4)
Reset brightness to NanoMaggies: g=22.3, r=20.9, z=19.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.30782, 72.67363), pm (0.5, 6.1), parallax -0.328 with NanoMaggies: g=21.9, r=20.6, z=19.9
Reset brightness to NanoMaggies: g=21.9, r=20.6, z=19.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (289.35609, 72.68830), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.9, r=20.9, z=19
Reset brightness to NanoMaggies: g=21.9, r=20.9, z=20.4
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 20.85 s, CPU: 20.85 s, VmPeak: 741 MB, VmSize: 708 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.185816 MB
Old catalog: 25
New catalog: 29
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/blobs-custom-289303p72686.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/metrics/cus/all-models-custom-289303p72686.fits
Stage fitblobs : Wall: 25.28 s, CPU: 0.54 s, VmPeak: 993 MB, VmSize: 993 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.240496 MB
Stage fitblobs finished: 2020-07-18T21:22:06.440288
Resources for stage fitblobs : 21.866 s worker CPU, 21.886 s worker Wall, Wall: 25.287 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T21:22:07.128753
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-resid.jpg
Stage coadds : Wall: 11.61 s, CPU: 0.95 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 251 MB, VmData: 277 MB, maxrss: 0.256864 MB
Stage coadds finished: 2020-07-18T21:22:18.738482
Resources for stage coadds : 48.628 s worker CPU, 55.951 s worker Wall, Wall: 11.612 s, Cores in use: 4.27, Total efficiency (on 32 cores): 13.3 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T21:22:18.807520
Cut to 2 unWISE tiles
Reading WISE tile 2870p726 band 2
Reading WISE tile 2870p726 band 1
Reading WISE tile 2870p726 band 3
Reading WISE tile 2870p726 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/287/2870p726/unwise-2870p726-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2919p726 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 794 MB, VmSize: 794 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.177368 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 801 MB, VmSize: 789 MB, VmRSS: 140 MB, VmData: 173 MB, maxrss: 0.20138 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 786 MB, VmSize: 786 MB, VmRSS: 134 MB, VmData: 170 MB, maxrss: 0.19316 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/291/2919p726/unwise-2919p726-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 789 MB, VmSize: 789 MB, VmRSS: 137 MB, VmData: 173 MB, maxrss: 0.195064 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/tmp-legacysurvey-custom-289303p72686-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.31 s, CPU: 0.90 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 251 MB, VmData: 277 MB, maxrss: 0.257376 MB
Stage wise_forced finished: 2020-07-18T21:22:24.116993
Resources for stage wise_forced : 6.030 s worker CPU, 12.777 s worker Wall, Wall: 5.312 s, Cores in use: 1.30, Total efficiency (on 32 cores): 4.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T21:22:24.141931
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/coadd/cus/custom-289303p72686/legacysurvey-custom-289303p72686-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/tractor-i/cus/tractor-custom-289303p72686.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/tractor/cus/tractor-custom-289303p72686.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/tractor/cus/brick-custom-289303p72686.sha256sum
Stage writecat : Wall: 4.40 s, CPU: 2.23 s, VmPeak: 1133 MB, VmSize: 1005 MB, VmRSS: 253 MB, VmData: 277 MB, maxrss: 0.389928 MB
Stage writecat finished: 2020-07-18T21:22:28.544365
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.406 s, Cores in use: 0.51, Total efficiency (on 32 cores): 1.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/289/PGC2750973/PGC2750973-largegalaxy-writecat.p
All done: 86.188 s worker CPU, 103.176 s worker Wall, Wall: 70.050 s, Cores in use: 1.39, Total efficiency (on 32 cores): 4.4 %
Finished galaxy PGC2750973 in 1.211 minutes.