Started working on galaxy PGC2694907 at Wed Jun 10 13:09:11 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.47129100000001 67.0889444 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-10T13:09:12.440907
legacypipe git version: DR9.5.2-11-g917b309b
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '93.47129100000001', '67.0889444', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 93.47129100000001 67.0889444 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 93.47129100000001 67.0889444
Starting process 61599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 61600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057472 MB
Starting process 61601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05754 MB
Starting process 61602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057476 MB
Starting process 61603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05748 MB
Starting process 61604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057484 MB
Starting process 61605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057484 MB
Starting process 61606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057484 MB
Starting process 61607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057488 MB
Starting process 61608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057492 MB
Starting process 61609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057492 MB
Starting process 61610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05756 MB
Starting process 61611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05756 MB
Starting process 61612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05756 MB
Starting process 61613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05756 MB
Starting process 61614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05756 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-10T13:09:12.754846
Keeping 13 CCDs:
   k4m_170210_023228_ooi_zd_ls9.fits.fz k4m_170210_023228_ooi_zd_ls9-CCD1 z exptime 211.104 propid 2016A-0453 seeing 1.23 MJD 57794.106 object MzLS_707497_z
   k4m_170130_022418_ooi_zd_ls9.fits.fz k4m_170130_022418_ooi_zd_ls9-CCD2 z exptime 83.103 propid 2016A-0453 seeing 1.36 MJD 57783.100 object MzLS_706512_z
   k4m_170314_033628_ooi_zd_ls9.fits.fz k4m_170314_033628_ooi_zd_ls9-CCD1 z exptime 94.105 propid 2016A-0453 seeing 0.86 MJD 57826.150 object MzLS_707007_z
   k4m_180204_023624_ooi_zd_ls9.fits.fz k4m_180204_023624_ooi_zd_ls9-CCD3 z exptime 92.105 propid 2016A-0453 seeing 1.02 MJD 58153.109 object MzLS_707496_z
   k4m_160203_042249_ooi_zd_ls9.fits.fz k4m_160203_042249_ooi_zd_ls9-CCD3 z exptime 227.104 propid 2016A-0453 seeing 1.81 MJD 57421.183 object MzLS_707496_z
   ksb_180115_021134_ooi_g_ls9.fits.fz ksb_180115_021134_ooi_g_ls9-CCD4 g exptime 250.0 propid BASS seeing 1.27 MJD 58133.091 object 43282
   ksb_180409_030653_ooi_g_ls9.fits.fz ksb_180409_030653_ooi_g_ls9-CCD1 g exptime 180.8 propid BASS seeing 1.31 MJD 58217.130 object 43283
   ksb_180116_015638_ooi_g_ls9.fits.fz ksb_180116_015638_ooi_g_ls9-CCD1 g exptime 250.0 propid BASS seeing 1.58 MJD 58134.081 object 43283
   ksb_190115_044616_ooi_r_ls9.fits.fz ksb_190115_044616_ooi_r_ls9-CCD1 r exptime 250.0 propid NOTBASS seeing 1.85 MJD 58498.199 object 
   ksb_170127_035958_ooi_r_ls9.fits.fz ksb_170127_035958_ooi_r_ls9-CCD4 r exptime 192.5 propid BASS seeing 2.09 MJD 57780.167 object 43282
   ksb_181213_051600_ooi_r_ls9.fits.fz ksb_181213_051600_ooi_r_ls9-CCD1 r exptime 222.956 propid NOTBASS seeing 1.95 MJD 58465.219 object 
   ksb_180114_015401_ooi_g_ls9.fits.fz ksb_180114_015401_ooi_g_ls9-CCD1 g exptime 180.8 propid BASS seeing 1.55 MJD 58132.079 object 43281
   ksb_180114_015938_ooi_g_ls9.fits.fz ksb_180114_015938_ooi_g_ls9-CCD1 g exptime 250.0 propid BASS seeing 1.74 MJD 58132.083 object 43281
Faked up EXPNUM 81320034
Faked up EXPNUM 81320034
Faked up EXPNUM 81320034
90prime get_fwhm: self.fwhm = 3.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3329 3489 and amp range 2016 4031 and image y 3290 3450 and amp range 2048 4095
Range in image: x 0 161 , y 0 161 (with image size 161 x 161)
dzp 0.016257986 -> scaling image by 1.01508683329102
mosaic get_fwhm: self.fwhm = 3.33
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2973 3252 and amp range 2006 4053 and image y 1580 1862 and amp range 0 2039
Range in image: x 0 280 , y 0 283 (with image size 280 x 283)
dzp 0.000620604 -> scaling image by 1.0005717608254892
Faked up EXPNUM 81330037
Faked up EXPNUM 81330037
Faked up EXPNUM 81330037
90prime get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1148 1308 and amp range 0 2015 and image y 795 955 and amp range 0 2047
Range in image: x 0 161 , y 0 161 (with image size 161 x 161)
dzp 0.0059804036 -> scaling image by 1.0055233530762397
Faked up EXPNUM 81340026
Faked up EXPNUM 81340026
Faked up EXPNUM 81340026
90prime get_fwhm: self.fwhm = 3.49
Swapping in SKY_JOHN values for 1 splinesky cells; 8.767813 -> 8.747175
mosaic get_fwhm: self.fwhm = 4.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 248 533 and amp range 0 2005 and image y 7 258 and amp range 0 2039
Range in image: x 0 286 , y 0 252 (with image size 286 x 252)
dzp 0.007397243 -> scaling image by 1.006836374469654
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1306 1469 and amp range 0 2015 and image y 1355 1517 and amp range 0 2047
Range in image: x 0 164 , y 0 163 (with image size 164 x 163)
dzp -0.030770088 -> scaling image by 0.9720575212609548
mosaic get_fwhm: self.fwhm = 6.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 181 469 and amp range 0 2005 and image y 3724 4016 and amp range 2040 4078
Range in image: x 0 289 , y 0 293 (with image size 289 x 293)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
Faked up EXPNUM 81320033
Faked up EXPNUM 81320033
Faked up EXPNUM 81320033
90prime get_fwhm: self.fwhm = 3.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3327 3487 and amp range 2016 4031 and image y 3291 3451 and amp range 2048 4095
Range in image: x 0 161 , y 0 161 (with image size 161 x 161)
dzp 0.016257986 -> scaling image by 1.01508683329102
Faked up EXPNUM 77800060
Faked up EXPNUM 77800060
Faked up EXPNUM 77800060
90prime get_fwhm: self.fwhm = 4.61
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1165 1325 and amp range 0 2015 and image y 938 1098 and amp range 0 2047
Range in image: x 0 161 , y 0 161 (with image size 161 x 161)
dzp 0.004145757 -> scaling image by 1.0038256824624485
mosaic get_fwhm: self.fwhm = 5.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1397 1680 and amp range 0 2047 and image y 1084 1366 and amp range 0 2039
Range in image: x 0 284 , y 0 283 (with image size 284 x 283)
dzp -0.0096683735 -> scaling image by 0.9911346301237048
Faked up EXPNUM 84980072
Faked up EXPNUM 84980072
Faked up EXPNUM 84980072
90prime get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1306 1469 and amp range 0 2015 and image y 1295 1457 and amp range 0 2047
Range in image: x 0 164 , y 0 163 (with image size 164 x 163)
dzp -0.035150982 -> scaling image by 0.9681432169373447
Faked up EXPNUM 84650040
Faked up EXPNUM 84650040
Faked up EXPNUM 84650040
90prime get_fwhm: self.fwhm = 4.31
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3308 3468 and amp range 2016 4031 and image y 3297 3457 and amp range 2048 4095
Range in image: x 0 161 , y 0 161 (with image size 161 x 161)
dzp 0.017774878 -> scaling image by 1.0165060112155746
Faked up EXPNUM 82170038
Faked up EXPNUM 82170038
Faked up EXPNUM 82170038
90prime get_fwhm: self.fwhm = 2.89
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1313 1477 and amp range 0 2015 and image y 1364 1526 and amp range 0 2047
Range in image: x 0 165 , y 0 163 (with image size 165 x 163)
dzp -0.030770088 -> scaling image by 0.9720575212609548
mosaic get_fwhm: self.fwhm = 3.91
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 203 491 and amp range 0 2005 and image y 3711 4003 and amp range 2040 4078
Range in image: x 0 289 , y 0 293 (with image size 289 x 293)
dzp 0.01523814 -> scaling image by 1.014133796220052
Stage tims : Wall: 2.67 s, CPU: 0.75 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.1792 MB
Stage tims finished: 2020-06-10T13:09:15.421861
Resources for stage tims : 8.451 s worker CPU, 16.942 s worker Wall, Wall: 2.669 s, Cores in use: 3.45, Total efficiency (on 16 cores): 21.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-10T13:09:15.446439
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00496.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00435.fits
Matched 0 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/reference-custom-093471p67088.fits
Stage refs : Wall: 4.36 s, CPU: 3.37 s, VmPeak: 992 MB, VmSize: 986 MB, VmRSS: 221 MB, VmData: 252 MB, maxrss: 0.225832 MB
Stage refs finished: 2020-06-10T13:09:19.811317
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.367 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-10T13:09:19.814074
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/outlier-mask-custom-093471p67088.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/outliers-pre-custom-093471p67088.jpg
Image ksb_180115_021134_ooi_g_ls9-CCD4 g : masking 92 positive outlier pixels and 0 negative outlier pixels
Image ksb_180409_030653_ooi_g_ls9-CCD1 g : masking 93 positive outlier pixels and 0 negative outlier pixels
Image ksb_170127_035958_ooi_r_ls9-CCD4 r : masking 83 positive outlier pixels and 0 negative outlier pixels
Image k4m_170130_022418_ooi_zd_ls9-CCD2 z : masking 447 positive outlier pixels and 0 negative outlier pixels
Image k4m_180204_023624_ooi_zd_ls9-CCD3 z : masking 696 positive outlier pixels and 0 negative outlier pixels
Image k4m_160203_042249_ooi_zd_ls9-CCD3 z : masking 3140 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/outlier-mask-custom-093471p67088.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/outliers-post-custom-093471p67088.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/outliers-masked-pos-custom-093471p67088.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/outliers-masked-neg-custom-093471p67088.jpg
Stage outliers : Wall: 0.92 s, CPU: 0.66 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 240 MB, VmData: 269 MB, maxrss: 0.245716 MB
Stage outliers finished: 2020-06-10T13:09:20.730148
Resources for stage outliers : 1.325 s worker CPU, 1.398 s worker Wall, Wall: 0.918 s, Cores in use: 2.17, Total efficiency (on 16 cores): 13.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-10T13:09:20.732954
Stage halos : Wall: 0.14 s, CPU: 0.13 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 240 MB, VmData: 269 MB, maxrss: 0.245716 MB
Stage halos finished: 2020-06-10T13:09:20.875007
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.144 s, Cores in use: 0.94, Total efficiency (on 16 cores): 5.9 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-10T13:09:20.877629
PSF sigmas in coadd pixels: ['2.07', '2.13', '2.57', '2.53', '2.82']
Using average PSF sigma 2.4223574711550198
Gaussian PSF norm 0.11645465012204442 vs pixelized 0.09578653
average tim pixel scale / coadd scale: 1.7302835498801397
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['3.01', '3.40', '3.17']
Using average PSF sigma 3.1934472510854746
Gaussian PSF norm 0.08833551005985528 vs pixelized 0.0743781
average tim pixel scale / coadd scale: 1.730487098960021
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.99', '2.21', '1.40', '1.65', '2.95']
Using average PSF sigma 2.0399696434353523
Gaussian PSF norm 0.13828381842919218 vs pixelized 0.09811853
average tim pixel scale / coadd scale: 0.990883419236865
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.21 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 242 MB, VmData: 270 MB, maxrss: 0.248308 MB
Stage fit_on_coadds finished: 2020-06-10T13:09:21.091863
Resources for stage fit_on_coadds : 0.256 s worker CPU, 0.256 s worker Wall, Wall: 0.216 s, Cores in use: 2.17, Total efficiency (on 16 cores): 13.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-10T13:09:21.095927
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 30 potential peaks
Of 30 potential peaks: 8 in veto map, 5 cut by saddle test, 0 cut by aper test, 17 kept
SED z : 17 new peaks
Found 22 potential peaks
Of 22 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED r : 3 new peaks
Found 28 potential peaks
Of 28 potential peaks: 20 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 28 potential peaks
Of 28 potential peaks: 22 in veto map, 5 cut by saddle test, 1 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 31 potential peaks
Of 31 potential peaks: 23 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 22 new sources
Median coadd sky for g : 0.0001852878
Median coadd sky for r : 0.00018297184
Median coadd sky for z : -8.467999e-05
Stage srcs : Wall: 0.43 s, CPU: 0.38 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 243 MB, VmData: 270 MB, maxrss: 0.248604 MB
Stage srcs finished: 2020-06-10T13:09:21.521200
Resources for stage srcs : 0.101 s worker CPU, 0.101 s worker Wall, Wall: 0.427 s, Cores in use: 1.14, Total efficiency (on 16 cores): 7.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/PGC2694907-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-10T13:09:21.533616
Blob 1 of 11, id: 0, sources: 10, size: 196x213, npix 24525, brick X: 64,260, Y: 0,213, one pixel: 126 0
Blob 2 of 11, id: 6, sources: 5, size: 72x64, npix 2528, brick X: 120,192, Y: 206,270, one pixel: 169 206
Blob 3 of 11, id: 9, sources: 4, size: 64x36, npix 1356, brick X: 196,260, Y: 239,275, one pixel: 208 239
Blob 4 of 11, id: 2, sources: 2, size: 36x51, npix 1082, brick X: 30,66, Y: 24,75, one pixel: 47 24
Blob 5 of 11, id: 10, sources: 1, size: 26x26, npix 452, brick X: 64,90, Y: 243,269, one pixel: 75 243
Blob 6 of 11, id: 8, sources: 1, size: 26x25, npix 402, brick X: 23,49, Y: 222,247, one pixel: 32 222
Blob 7 of 11, id: 5, sources: 1, size: 23x25, npix 374, brick X: 245,268, Y: 151,176, one pixel: 254 151
Blob 8 of 11, id: 3, sources: 1, size: 24x24, npix 332, brick X: 39,63, Y: 103,127, one pixel: 50 103
Blob 9 of 11, id: 4, sources: 1, size: 21x21, npix 250, brick X: 229,250, Y: 116,137, one pixel: 239 116
Blob 10 of 11, id: 7, sources: 1, size: 21x20, npix 248, brick X: 232,253, Y: 219,239, one pixel: 240 219
Blob 11 of 11, id: 1, sources: 1, size: 18x18, npix 171, brick X: 20,38, Y: 4,22, one pixel: 29 4
Blob 11 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.140124 MB
Blob 10 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 800 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142584 MB
Blob 7 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 799 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.140728 MB
Blob 5 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.092576 MB
Blob 8 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 657 MB, VmSize: 657 MB, VmRSS: 89 MB, VmData: 136 MB, maxrss: 0.091564 MB
Blob 9 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 796 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142644 MB
Blob 6 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 801 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142716 MB
Blob 4 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 796 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142668 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.45464, 67.10091), pm (-3.3, -3.7), parallax 0.675 with NanoMaggies: g=12, r=11.8, z=(flux -584)
Reset brightness to NanoMaggies: g=18.1, r=17.1, z=16.7
Blob 3 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 792 MB, VmSize: 712 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142108 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.81 s, CPU: 1.81 s, VmPeak: 798 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143812 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.40893, ee1=0.0156229, ee2=0.367723
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (93.46262, 67.07837), pm (-1.8, 6.5), parallax 1.322 with NanoMaggies: g=18.4, r=17.5, z=16.5
Reset brightness to NanoMaggies: g=20.7, r=19.6, z=19
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 18.11 s, CPU: 18.11 s, VmPeak: 796 MB, VmSize: 719 MB, VmRSS: 153 MB, VmData: 185 MB, maxrss: 0.156676 MB
Old catalog: 33
New catalog: 34
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/blobs-custom-093471p67088.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/metrics/cus/all-models-custom-093471p67088.fits
Stage fitblobs : Wall: 18.38 s, CPU: 0.24 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 243 MB, VmData: 270 MB, maxrss: 0.24894 MB
Stage fitblobs finished: 2020-06-10T13:09:39.912235
Resources for stage fitblobs : 23.586 s worker CPU, 23.621 s worker Wall, Wall: 18.380 s, Cores in use: 1.30, Total efficiency (on 16 cores): 8.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-10T13:09:39.915176
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/tmp-legacysurvey-custom-093471p67088-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/tmp-legacysurvey-custom-093471p67088-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/tmp-legacysurvey-custom-093471p67088-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/tmp-legacysurvey-custom-093471p67088-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-resid.jpg
Stage coadds : Wall: 1.54 s, CPU: 0.51 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 243 MB, VmData: 270 MB, maxrss: 0.249328 MB
Stage coadds finished: 2020-06-10T13:09:41.456899
Resources for stage coadds : 7.277 s worker CPU, 7.591 s worker Wall, Wall: 1.543 s, Cores in use: 5.05, Total efficiency (on 16 cores): 31.5 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-10T13:09:41.459332
Cut to 1 unWISE tiles
Reading WISE tile 0927p666 band 1
Reading WISE tile 0927p666 band 3
Reading WISE tile 0927p666 band 2
Reading WISE tile 0927p666 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 794 MB, VmSize: 790 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.187924 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 799 MB, VmSize: 788 MB, VmRSS: 143 MB, VmData: 170 MB, maxrss: 0.208056 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 801 MB, VmSize: 783 MB, VmRSS: 138 MB, VmData: 169 MB, maxrss: 0.19762 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0927p666/unwise-0927p666-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206244 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/tmp-legacysurvey-custom-093471p67088-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/tmp-legacysurvey-custom-093471p67088-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 1.70 s, CPU: 0.39 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 244 MB, VmData: 270 MB, maxrss: 0.249904 MB
Stage wise_forced finished: 2020-06-10T13:09:43.158781
Resources for stage wise_forced : 3.165 s worker CPU, 4.305 s worker Wall, Wall: 1.701 s, Cores in use: 2.09, Total efficiency (on 16 cores): 13.1 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-10T13:09:43.161656
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/coadd/cus/custom-093471p67088/legacysurvey-custom-093471p67088-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/tractor-i/cus/tractor-custom-093471p67088.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/tractor/cus/tractor-custom-093471p67088.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/093/PGC2694907/tractor/cus/brick-custom-093471p67088.sha256sum
Stage writecat : Wall: 0.51 s, CPU: 0.40 s, VmPeak: 1128 MB, VmSize: 1000 MB, VmRSS: 246 MB, VmData: 270 MB, maxrss: 0.383028 MB
Stage writecat finished: 2020-06-10T13:09:43.675500
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.516 s, Cores in use: 0.77, Total efficiency (on 16 cores): 4.8 %
Stage writecat finished
All done: 44.167 s worker CPU, 54.221 s worker Wall, Wall: 30.928 s, Cores in use: 1.66, Total efficiency (on 16 cores): 10.4 %
Finished galaxy PGC2694907 in 0.540 minutes.