Started working on galaxy PGC2399599 at Sun Jun  7 19:27:10 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 94.248708 51.758888899999995 --width 281 --height 281 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:27:11.621709
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '94.248708', '51.758888899999995', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 94.248708 51.758888899999995 --width 281 --height 281 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 94.248708 51.758888899999995
Starting process 63894 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB
Starting process 63896 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 63901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 63906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:27:12.234184
Keeping 9 CCDs:
   k4m_170128_031236_ooi_zd_ls9.fits.fz k4m_170128_031236_ooi_zd_ls9-CCD2 z exptime 109.104 propid 2016A-0453 seeing 1.37 MJD 57781.134 object MzLS_655686_z
   k4m_170221_022247_ooi_zd_ls9.fits.fz k4m_170221_022247_ooi_zd_ls9-CCD1 z exptime 93.104 propid 2016A-0453 seeing 0.89 MJD 57805.099 object MzLS_657247_z
   k4m_180209_072450_ooi_zd_ls9.fits.fz k4m_180209_072450_ooi_zd_ls9-CCD2 z exptime 100.107 propid 2016A-0453 seeing 0.89 MJD 58158.309 object MzLS_656468_z
   k4m_180119_035424_ooi_zd_ls9.fits.fz k4m_180119_035424_ooi_zd_ls9-CCD2 z exptime 163.105 propid 2016A-0453 seeing 1.06 MJD 58137.163 object MzLS_656468_z
   k4m_160213_023942_ooi_zd_ls9.fits.fz k4m_160213_023942_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2016A-0453 seeing 0.87 MJD 57431.111 object MzLS_655685_z
   ksb_171127_054522_ooi_r_ls9.fits.fz ksb_171127_054522_ooi_r_ls9-CCD4 r exptime 195.6 propid BASS seeing 1.22 MJD 58084.240 object 63571
   ksb_180113_062516_ooi_g_ls9.fits.fz ksb_180113_062516_ooi_g_ls9-CCD4 g exptime 233.753 propid BASS seeing 1.39 MJD 58131.268 object 63571
   ksb_160104_050151_ooi_g_ls9.fits.fz ksb_160104_050151_ooi_g_ls9-CCD3 g exptime 250.0 propid 2015A-0801 seeing 2.39 MJD 57391.210 object 63573
   ksb_181212_113230_ooi_r_ls9.fits.fz ksb_181212_113230_ooi_r_ls9-CCD3 r exptime 250.0 propid NOTBASS seeing 1.37 MJD 58464.481 object 
mosaic get_fwhm: self.fwhm = 3.41
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1807 2092 and amp range 0 2005 and image y 455 748 and amp range 0 2039
Range in image: x 0 199 , y 0 294 (with image size 286 x 294)
dzp 0.007397243 -> scaling image by 1.006836374469654
Found overlap: image x 1807 2092 and amp range 2006 4053 and image y 455 748 and amp range 0 2039
Range in image: x 199 286 , y 0 294 (with image size 286 x 294)
dzp 0.000620604 -> scaling image by 1.0005717608254892
mosaic get_fwhm: self.fwhm = 3.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 238 520 and amp range 0 2047 and image y 3009 3291 and amp range 2040 4078
Range in image: x 0 283 , y 0 283 (with image size 283 x 283)
dzp 0.003927584 -> scaling image by 1.0036239891963392
mosaic get_fwhm: self.fwhm = 5.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2963 3259 and amp range 2048 4095 and image y 7 280 and amp range 0 2039
Range in image: x 0 297 , y 0 274 (with image size 297 x 274)
dzp 0.0044767857 -> scaling image by 1.004131784351374
mosaic get_fwhm: self.fwhm = 4.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 239 522 and amp range 0 2047 and image y 3046 3329 and amp range 2040 4078
Range in image: x 0 284 , y 0 284 (with image size 284 x 284)
dzp 0.003927584 -> scaling image by 1.0036239891963392
mosaic get_fwhm: self.fwhm = 3.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2937 3231 and amp range 2048 4095 and image y 3692 3986 and amp range 2022 4060
Range in image: x 0 295 , y 0 295 (with image size 295 x 295)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
Faked up EXPNUM 73910077
Faked up EXPNUM 73910077
Faked up EXPNUM 73910077
90prime get_fwhm: self.fwhm = 5.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3968 4016 and amp range 2016 4031 and image y 414 577 and amp range 0 2047
Range in image: x 0 49 , y 0 164 (with image size 49 x 164)
dzp -0.0022715968 -> scaling image by 0.9979099691834846
Faked up EXPNUM 81310058
Faked up EXPNUM 81310058
Faked up EXPNUM 81310058
90prime get_fwhm: self.fwhm = 3.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1782 1945 and amp range 0 2015 and image y 2389 2553 and amp range 2048 4095
Range in image: x 0 164 , y 0 165 (with image size 164 x 165)
dzp 0.027550658 -> scaling image by 1.0256997821704772
Faked up EXPNUM 80850097
Faked up EXPNUM 80850097
Faked up EXPNUM 80850097
90prime get_fwhm: self.fwhm = 2.69
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1785 1948 and amp range 0 2015 and image y 2389 2553 and amp range 2048 4095
Range in image: x 0 164 , y 0 165 (with image size 164 x 165)
dzp 0.04491909 -> scaling image by 1.0422397564357018
Faked up EXPNUM 84640044
Faked up EXPNUM 84640044
Faked up EXPNUM 84640044
90prime get_fwhm: self.fwhm = 3.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3968 4016 and amp range 2016 4031 and image y 369 531 and amp range 0 2047
Range in image: x 0 49 , y 0 163 (with image size 49 x 163)
dzp 0.0010388457 -> scaling image by 1.0009572701813714
Stage tims : Wall: 7.66 s, CPU: 1.05 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566576 MB
Stage tims finished: 2020-06-07T19:27:19.890159
Resources for stage tims : 3.305 s worker CPU, 17.753 s worker Wall, Wall: 7.657 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:27:19.912681
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01225.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01226.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01327.fits
Matched 20 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/reference-custom-094248p51758.fits
Stage refs : Wall: 6.60 s, CPU: 5.54 s, VmPeak: 1012 MB, VmSize: 1006 MB, VmRSS: 239 MB, VmData: 271 MB, maxrss: 0.566576 MB
Stage refs finished: 2020-06-07T19:27:26.511539
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.600 s, Cores in use: 0.84, Total efficiency (on 4 cores): 21.0 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:27:26.513151
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/outlier-mask-custom-094248p51758.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/outliers-pre-custom-094248p51758.jpg
Image ksb_160104_050151_ooi_g_ls9-CCD3 g : masking 115 positive outlier pixels and 0 negative outlier pixels
Image k4m_170128_031236_ooi_zd_ls9-CCD2 z : masking 516 positive outlier pixels and 0 negative outlier pixels
Image k4m_170221_022247_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 783 negative outlier pixels
Image k4m_180209_072450_ooi_zd_ls9-CCD2 z : masking 2219 positive outlier pixels and 0 negative outlier pixels
Image k4m_180119_035424_ooi_zd_ls9-CCD2 z : masking 703 positive outlier pixels and 0 negative outlier pixels
Image k4m_160213_023942_ooi_zd_ls9-CCD4 z : masking 1093 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/outlier-mask-custom-094248p51758.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/outliers-post-custom-094248p51758.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/outliers-masked-pos-custom-094248p51758.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/outliers-masked-neg-custom-094248p51758.jpg
Stage outliers : Wall: 0.98 s, CPU: 0.68 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage outliers finished: 2020-06-07T19:27:27.497824
Resources for stage outliers : 1.061 s worker CPU, 1.066 s worker Wall, Wall: 0.986 s, Cores in use: 1.76, Total efficiency (on 4 cores): 44.1 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:27:27.499663
Stage halos : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage halos finished: 2020-06-07T19:27:27.752484
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.254 s, Cores in use: 0.96, Total efficiency (on 4 cores): 23.9 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T19:27:27.754390
PSF sigmas in coadd pixels: ['2.26', '3.88']
Using average PSF sigma 3.070086249669886
Gaussian PSF norm 0.09188497287469062 vs pixelized 0.08632062
average tim pixel scale / coadd scale: 1.730371427896454
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.98', '2.23']
Using average PSF sigma 2.106398531827195
Gaussian PSF norm 0.1339228011753194 vs pixelized 0.105982274
average tim pixel scale / coadd scale: 1.7307831249057621
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.22', '1.44', '1.45', '1.72', '1.42']
Using average PSF sigma 1.6503617224803098
Gaussian PSF norm 0.1709290684165415 vs pixelized 0.13384223
average tim pixel scale / coadd scale: 0.990889317761282
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.19 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage fit_on_coadds finished: 2020-06-07T19:27:27.964054
Resources for stage fit_on_coadds : 0.231 s worker CPU, 0.234 s worker Wall, Wall: 0.211 s, Cores in use: 2.00, Total efficiency (on 4 cores): 50.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:27:27.966768
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 61 potential peaks
Of 61 potential peaks: 35 in veto map, 6 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 40 potential peaks
Of 40 potential peaks: 37 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 26 potential peaks
Of 26 potential peaks: 23 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 45 potential peaks
Of 45 potential peaks: 38 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 62 potential peaks
Of 62 potential peaks: 55 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 21 new sources
Median coadd sky for g : 0.00044032867
Median coadd sky for r : 0.00053442584
Median coadd sky for z : -2.162936e-05
Stage srcs : Wall: 0.55 s, CPU: 0.49 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage srcs finished: 2020-06-07T19:27:28.514702
Resources for stage srcs : 0.136 s worker CPU, 0.136 s worker Wall, Wall: 0.549 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/PGC2399599-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:27:28.529857
Blob 1 of 17, id: 4, sources: 7, size: 136x195, npix 16047, brick X: 62,198, Y: 38,233, one pixel: 170 38
Blob 2 of 17, id: 13, sources: 2, size: 68x55, npix 2428, brick X: 209,277, Y: 185,240, one pixel: 241 185
Blob 3 of 17, id: 10, sources: 1, size: 38x39, npix 1034, brick X: 0,38, Y: 105,144, one pixel: 15 105
Blob 4 of 17, id: 7, sources: 2, size: 33x36, npix 788, brick X: 9,42, Y: 62,98, one pixel: 20 62
Blob 5 of 17, id: 2, sources: 1, size: 36x30, npix 712, brick X: 245,281, Y: 25,55, one pixel: 266 25
Blob 3 finished, total: Wall: 1.81 s, CPU: 1.16 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142984 MB
Blob 6 of 17, id: 16, sources: 2, size: 27x30, npix 564, brick X: 254,281, Y: 245,275, one pixel: 270 245
Blob 2 finished, total: Wall: 2.04 s, CPU: 1.42 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142776 MB
Blob 7 of 17, id: 12, sources: 1, size: 29x28, npix 552, brick X: 188,217, Y: 178,206, one pixel: 200 178
Measuring 1 iterative sources
Blob 4 finished, total: Wall: 2.62 s, CPU: 2.06 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143468 MB
Blob 8 of 17, id: 14, sources: 1, size: 27x29, npix 487, brick X: 61,88, Y: 200,229, one pixel: 72 200
Blob 5 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142984 MB
Blob 9 of 17, id: 0, sources: 2, size: 38x17, npix 459, brick X: 141,179, Y: 0,17, one pixel: 145 0
Blob 7 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143468 MB
Blob 10 of 17, id: 6, sources: 1, size: 26x26, npix 430, brick X: 55,81, Y: 48,74, one pixel: 66 48
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (94.22427, 51.76756), pm (5.6, -9.4), parallax 0.864 with NanoMaggies: g=17.3, r=16.5, z=16.2
Reset brightness to NanoMaggies: g=17.3, r=16.5, z=16.2
Blob 6 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143592 MB
Blob 11 of 17, id: 15, sources: 1, size: 25x26, npix 404, brick X: 57,82, Y: 245,271, one pixel: 67 245
Blob 8 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142984 MB
Blob 12 of 17, id: 5, sources: 1, size: 18x28, npix 360, brick X: 0,18, Y: 42,70, one pixel: 6 42
Blob 13 of 17, id: 11, sources: 1, size: 23x23, npix 316, brick X: 49,72, Y: 112,135, one pixel: 59 112
Blob 11 finished, total: Wall: 0.50 s, CPU: 0.49 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142984 MB
Blob 14 of 17, id: 8, sources: 1, size: 21x21, npix 261, brick X: 242,263, Y: 95,116, one pixel: 251 95
Blob 10 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143592 MB
Blob 15 of 17, id: 1, sources: 1, size: 20x22, npix 259, brick X: 248,268, Y: 9,31, one pixel: 256 9
Blob 13 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143592 MB
Blob 16 of 17, id: 9, sources: 1, size: 20x20, npix 220, brick X: 200,220, Y: 96,116, one pixel: 209 96
Blob 9 finished, total: Wall: 1.51 s, CPU: 1.51 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143468 MB
Blob 17 of 17, id: 3, sources: 1, size: 19x19, npix 190, brick X: 87,106, Y: 37,56, one pixel: 95 37
Blob 14 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143592 MB
Blob 16 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143592 MB
Blob 12 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14322 MB
Blob 17 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143592 MB
Blob 15 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 810 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143468 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.594753, ee1=0.0458825, ee2=0.172523
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 12.15 s, CPU: 12.15 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145772 MB
Old catalog: 36
New catalog: 30
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/blobs-custom-094248p51758.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/metrics/cus/all-models-custom-094248p51758.fits
Stage fitblobs : Wall: 12.61 s, CPU: 0.47 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage fitblobs finished: 2020-06-07T19:27:41.144098
Resources for stage fitblobs : 25.750 s worker CPU, 27.628 s worker Wall, Wall: 12.615 s, Cores in use: 2.08, Total efficiency (on 4 cores): 52.0 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:27:41.146199
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/tmp-legacysurvey-custom-094248p51758-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/tmp-legacysurvey-custom-094248p51758-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/tmp-legacysurvey-custom-094248p51758-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/tmp-legacysurvey-custom-094248p51758-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-resid.jpg
Stage coadds : Wall: 1.42 s, CPU: 0.62 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage coadds finished: 2020-06-07T19:27:42.567288
Resources for stage coadds : 2.155 s worker CPU, 2.273 s worker Wall, Wall: 1.422 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.7 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:27:42.569088
Cut to 2 unWISE tiles
Reading WISE tile 0929p514 band 1
Reading WISE tile 0929p514 band 2
Reading WISE tile 0929p514 band 3
Reading WISE tile 0929p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0953p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0953p514 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0953p514 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/092/0929p514/unwise-0929p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 0953p514 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 809 MB, VmSize: 796 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.189512 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 809 MB, VmSize: 794 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.211684 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.205196 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/095/0953p514/unwise-0953p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.20864 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/tmp-legacysurvey-custom-094248p51758-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/tmp-legacysurvey-custom-094248p51758-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.66 s, CPU: 0.44 s, VmPeak: 1016 MB, VmSize: 1016 MB, VmRSS: 257 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage wise_forced finished: 2020-06-07T19:27:46.225332
Resources for stage wise_forced : 8.320 s worker CPU, 10.733 s worker Wall, Wall: 3.658 s, Cores in use: 2.40, Total efficiency (on 4 cores): 59.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:27:46.227318
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/coadd/cus/custom-094248p51758/legacysurvey-custom-094248p51758-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/tractor-i/cus/tractor-custom-094248p51758.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/tractor/cus/tractor-custom-094248p51758.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/094/PGC2399599/tractor/cus/brick-custom-094248p51758.sha256sum
Stage writecat : Wall: 1.02 s, CPU: 0.59 s, VmPeak: 1148 MB, VmSize: 1020 MB, VmRSS: 259 MB, VmData: 283 MB, maxrss: 0.566576 MB
Stage writecat finished: 2020-06-07T19:27:47.243608
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.017 s, Cores in use: 0.58, Total efficiency (on 4 cores): 14.4 %
Stage writecat finished
All done: 40.959 s worker CPU, 59.826 s worker Wall, Wall: 35.015 s, Cores in use: 1.46, Total efficiency (on 4 cores): 36.6 %
Finished galaxy PGC2399599 in 0.618 minutes.