Started working on galaxy PGC2092897 at Sun Jun  7 17:13:58 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.74302899999998 37.0950396 --width 265 --height 265 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T17:14:00.089653
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.74302899999998', '37.0950396', '--width', '265', '--height', '265', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.74302899999998 37.0950396 --width 265 --height 265 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 233.74302899999998 37.0950396
Starting process 14286 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 14287 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 14288 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 14289 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T17:14:00.600833
Keeping 9 CCDs:
   k4m_160216_123732_ooi_zd_ls9.fits.fz k4m_160216_123732_ooi_zd_ls9-CCD4 z exptime 93.103 propid 2016A-0453 seeing 0.92 MJD 57434.526 object MzLS_588488_z
   k4m_160302_120835_ooi_zd_ls9.fits.fz k4m_160302_120835_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 0.83 MJD 57449.506 object MzLS_590491_z
   k4m_160428_081333_ooi_zd_ls9.fits.fz k4m_160428_081333_ooi_zd_ls9-CCD2 z exptime 80.104 propid 2016A-0453 seeing 1.24 MJD 57506.343 object MzLS_589491_z
   ksb_160702_051907_ooi_g_ls9.fits.fz ksb_160702_051907_ooi_g_ls9-CCD3 g exptime 102.9 propid BASS seeing 1.88 MJD 57571.222 object 10633
   ksb_160529_092523_ooi_r_ls9.fits.fz ksb_160529_092523_ooi_r_ls9-CCD2 r exptime 218.8 propid BASS seeing 1.90 MJD 57537.393 object 10622
   ksb_160410_104622_ooi_g_ls9.fits.fz ksb_160410_104622_ooi_g_ls9-CCD2 g exptime 121.9 propid BASS seeing 2.90 MJD 57488.449 object 10622
   ksb_160402_091635_ooi_r_ls9.fits.fz ksb_160402_091635_ooi_r_ls9-CCD3 r exptime 56.3 propid BASS seeing 1.61 MJD 57480.387 object 10631
   ksb_170616_065125_ooi_g_ls9.fits.fz ksb_170616_065125_ooi_g_ls9-CCD3 g exptime 84.982 propid BASS seeing 1.40 MJD 57920.286 object 10631
   ksb_160529_095943_ooi_r_ls9.fits.fz ksb_160529_095943_ooi_r_ls9-CCD3 r exptime 232.7 propid BASS seeing 1.77 MJD 57537.416 object 10633
Faked up EXPNUM 75710038
Faked up EXPNUM 75710038
Faked up EXPNUM 75710038
90prime get_fwhm: self.fwhm = 4.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1299 1454 and amp range 0 2015 and image y 244 398 and amp range 0 2047
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.03470582 -> scaling image by 0.9685402452207784
mosaic get_fwhm: self.fwhm = 4.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 194 460 and amp range 0 2047 and image y 2535 2801 and amp range 2040 4078
Range in image: x 0 267 , y 0 267 (with image size 267 x 267)
dzp 0.008550294 -> scaling image by 1.0079062018164673
mosaic get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1758 2029 and amp range 0 2005 and image y 1087 1359 and amp range 0 2039
Range in image: x 0 248 , y 0 273 (with image size 272 x 273)
dzp -0.011066288 -> scaling image by 0.989859339076806
Found overlap: image x 1758 2029 and amp range 2006 4053 and image y 1087 1359 and amp range 0 2039
Range in image: x 248 272 , y 0 273 (with image size 272 x 273)
dzp 0.001388291 -> scaling image by 1.0012794811153327
Faked up EXPNUM 75370050
Faked up EXPNUM 75370050
Faked up EXPNUM 75370050
90prime get_fwhm: self.fwhm = 4.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1054 1210 and amp range 0 2015 and image y 668 824 and amp range 0 2047
Range in image: x 0 157 , y 0 157 (with image size 157 x 157)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Faked up EXPNUM 74880130
Faked up EXPNUM 74880130
Faked up EXPNUM 74880130
90prime get_fwhm: self.fwhm = 6.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1042 1197 and amp range 0 2015 and image y 648 805 and amp range 0 2047
Range in image: x 0 156 , y 0 158 (with image size 156 x 158)
dzp -0.008523628 -> scaling image by 0.992180183483648
mosaic get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2926 3202 and amp range 2048 4095 and image y 2800 3073 and amp range 2022 4060
Range in image: x 0 277 , y 0 274 (with image size 277 x 274)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
Faked up EXPNUM 74800182
Faked up EXPNUM 74800182
Faked up EXPNUM 74800182
90prime get_fwhm: self.fwhm = 3.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3294 3447 and amp range 2016 4031 and image y 2266 2420 and amp range 2048 4095
Range in image: x 0 154 , y 0 155 (with image size 154 x 155)
dzp -0.0005558773 -> scaling image by 0.99948814914245
Faked up EXPNUM 79200127
Faked up EXPNUM 79200127
Faked up EXPNUM 79200127
90prime get_fwhm: self.fwhm = 3.09
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3286 3439 and amp range 2016 4031 and image y 2257 2411 and amp range 2048 4095
Range in image: x 0 154 , y 0 155 (with image size 154 x 155)
dzp -0.02530836 -> scaling image by 0.9769597156943128
Faked up EXPNUM 75370057
Faked up EXPNUM 75370057
Faked up EXPNUM 75370057
90prime get_fwhm: self.fwhm = 3.91
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1296 1451 and amp range 0 2015 and image y 258 412 and amp range 0 2047
Range in image: x 0 156 , y 0 155 (with image size 156 x 155)
dzp -0.024507914 -> scaling image by 0.9776802328037623
Stage tims : Wall: 6.59 s, CPU: 0.98 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566552 MB
Stage tims finished: 2020-06-07T17:14:07.189637
Resources for stage tims : 3.322 s worker CPU, 17.405 s worker Wall, Wall: 6.590 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T17:14:07.210613
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02451.fits
Matched 14 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/reference-custom-233743p37095.fits
Stage refs : Wall: 2.65 s, CPU: 1.90 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 190 MB, VmData: 223 MB, maxrss: 0.566552 MB
Stage refs finished: 2020-06-07T17:14:09.862753
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.653 s, Cores in use: 0.72, Total efficiency (on 4 cores): 17.9 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T17:14:09.864396
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/outlier-mask-custom-233743p37095.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/outliers-pre-custom-233743p37095.jpg
Image ksb_160410_104622_ooi_g_ls9-CCD2 g : masking 40 positive outlier pixels and 0 negative outlier pixels
Image k4m_160302_120835_ooi_zd_ls9-CCD1 z : masking 853 positive outlier pixels and 0 negative outlier pixels
Image k4m_160216_123732_ooi_zd_ls9-CCD4 z : masking 621 positive outlier pixels and 172 negative outlier pixels
Image k4m_160428_081333_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 69 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/outlier-mask-custom-233743p37095.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/outliers-post-custom-233743p37095.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/outliers-masked-pos-custom-233743p37095.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/outliers-masked-neg-custom-233743p37095.jpg
Stage outliers : Wall: 0.92 s, CPU: 0.65 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.566552 MB
Stage outliers finished: 2020-06-07T17:14:10.782428
Resources for stage outliers : 0.971 s worker CPU, 0.990 s worker Wall, Wall: 0.919 s, Cores in use: 1.77, Total efficiency (on 4 cores): 44.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T17:14:10.784409
Stage halos : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.566552 MB
Stage halos finished: 2020-06-07T17:14:11.128268
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.345 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T17:14:11.130247
PSF sigmas in coadd pixels: ['3.05', '4.71', '2.27']
Using average PSF sigma 3.344072237370073
Gaussian PSF norm 0.08435666808314225 vs pixelized 0.072856404
average tim pixel scale / coadd scale: 1.7294810839594548
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['3.08', '2.61', '2.88']
Using average PSF sigma 2.8581604728140815
Gaussian PSF norm 0.09869802429117419 vs pixelized 0.07735687
average tim pixel scale / coadd scale: 1.7296171832460028
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.50', '1.35', '2.01']
Using average PSF sigma 1.617830283407778
Gaussian PSF norm 0.17436612150668682 vs pixelized 0.14771956
average tim pixel scale / coadd scale: 0.9909439041058866
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.20 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.566552 MB
Stage fit_on_coadds finished: 2020-06-07T17:14:11.380526
Resources for stage fit_on_coadds : 0.212 s worker CPU, 0.214 s worker Wall, Wall: 0.252 s, Cores in use: 1.66, Total efficiency (on 4 cores): 41.4 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T17:14:11.383600
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 19 kept
SED z : 19 new peaks
Found 15 potential peaks
Of 15 potential peaks: 14 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 13 potential peaks
Of 13 potential peaks: 11 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 24 potential peaks
Of 24 potential peaks: 20 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 26 potential peaks
Of 26 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 21 new sources
Median coadd sky for g : 6.449555e-05
Median coadd sky for r : -2.3549792e-05
Median coadd sky for z : 0.00019491714
Stage srcs : Wall: 0.64 s, CPU: 0.58 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.566552 MB
Stage srcs finished: 2020-06-07T17:14:12.021154
Resources for stage srcs : 0.129 s worker CPU, 0.132 s worker Wall, Wall: 0.639 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/PGC2092897-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T17:14:12.033797
Blob 1 of 14, id: 4, sources: 4, size: 99x164, npix 9471, brick X: 88,187, Y: 45,209, one pixel: 112 45
Blob 2 of 14, id: 13, sources: 1, size: 82x60, npix 3918, brick X: 68,150, Y: 205,265, one pixel: 106 205
Blob 3 of 14, id: 8, sources: 3, size: 63x51, npix 1899, brick X: 186,249, Y: 153,204, one pixel: 233 153
Blob 4 of 14, id: 1, sources: 3, size: 47x55, npix 1637, brick X: 191,238, Y: 4,59, one pixel: 210 4
Blob 5 of 14, id: 12, sources: 2, size: 46x49, npix 1275, brick X: 11,57, Y: 190,239, one pixel: 41 190
Blob 4 finished, total: Wall: 2.19 s, CPU: 2.19 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143236 MB
Blob 6 of 14, id: 2, sources: 2, size: 47x40, npix 990, brick X: 31,78, Y: 17,57, one pixel: 67 17
Measuring 2 iterative sources
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 2.83 s, CPU: 2.83 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14308 MB
Blob 7 of 14, id: 0, sources: 1, size: 30x28, npix 628, brick X: 235,265, Y: 0,28, one pixel: 241 0
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 3.80 s, CPU: 3.80 s, VmPeak: 792 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144032 MB
Blob 8 of 14, id: 3, sources: 1, size: 28x28, npix 514, brick X: 147,175, Y: 19,47, one pixel: 159 19
Blob 5 finished, total: Wall: 2.16 s, CPU: 2.16 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14386 MB
Blob 9 of 14, id: 7, sources: 1, size: 27x27, npix 466, brick X: 3,30, Y: 111,138, one pixel: 15 111
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.38067, ee1=0.372585, ee2=-0.0865635
Measuring 1 iterative sources
Blob 8 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14386 MB
Blob 10 of 14, id: 5, sources: 1, size: 25x24, npix 400, brick X: 3,28, Y: 47,71, one pixel: 12 47
Blob 7 finished, total: Wall: 1.95 s, CPU: 1.95 s, VmPeak: 792 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144032 MB
Blob 11 of 14, id: 10, sources: 1, size: 20x21, npix 276, brick X: 166,186, Y: 180,201, one pixel: 174 180
Blob 12 of 14, id: 9, sources: 1, size: 21x21, npix 261, brick X: 29,50, Y: 167,188, one pixel: 38 167
Blob 10 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 792 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144032 MB
Blob 13 of 14, id: 6, sources: 1, size: 20x20, npix 218, brick X: 69,89, Y: 82,102, one pixel: 79 82
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14386 MB
Blob 14 of 14, id: 11, sources: 1, size: 18x18, npix 171, brick X: 244,262, Y: 186,204, one pixel: 252 186
Blob 11 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 792 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144032 MB
Blob 12 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14386 MB
Blob 1 finished, total: Wall: 6.35 s, CPU: 6.32 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 178 MB, maxrss: 0.145428 MB
Blob 6 finished, total: Wall: 3.50 s, CPU: 3.44 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144128 MB
Blob 13 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 792 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144032 MB
Blob 14 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14386 MB
Old catalog: 26
New catalog: 29
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/blobs-custom-233743p37095.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/metrics/cus/all-models-custom-233743p37095.fits
Stage fitblobs : Wall: 6.96 s, CPU: 0.40 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 203 MB, VmData: 230 MB, maxrss: 0.566552 MB
Stage fitblobs finished: 2020-06-07T17:14:18.996168
Resources for stage fitblobs : 25.840 s worker CPU, 25.958 s worker Wall, Wall: 6.964 s, Cores in use: 3.77, Total efficiency (on 4 cores): 94.2 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T17:14:18.998044
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/tmp-legacysurvey-custom-233743p37095-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/tmp-legacysurvey-custom-233743p37095-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/tmp-legacysurvey-custom-233743p37095-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/tmp-legacysurvey-custom-233743p37095-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-resid.jpg
Stage coadds : Wall: 1.47 s, CPU: 0.64 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 203 MB, VmData: 230 MB, maxrss: 0.566552 MB
Stage coadds finished: 2020-06-07T17:14:20.472639
Resources for stage coadds : 2.237 s worker CPU, 2.415 s worker Wall, Wall: 1.476 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.8 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T17:14:20.474302
Cut to 2 unWISE tiles
Reading WISE tile 2330p378 band 1
Reading WISE tile 2330p378 band 2
Reading WISE tile 2330p378 band 3
Reading WISE tile 2330p378 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2331p363 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2331p363 band 3
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2331p363 band 1
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2330p378/unwise-2330p378-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 2331p363 band 2
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.16 s, CPU: 0.16 s, VmPeak: 796 MB, VmSize: 796 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.189484 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.209052 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.209064 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2331p363/unwise-2331p363-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209092 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/tmp-legacysurvey-custom-233743p37095-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/tmp-legacysurvey-custom-233743p37095-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.42 s, CPU: 0.45 s, VmPeak: 972 MB, VmSize: 964 MB, VmRSS: 204 MB, VmData: 230 MB, maxrss: 0.566552 MB
Stage wise_forced finished: 2020-06-07T17:14:24.892586
Resources for stage wise_forced : 9.764 s worker CPU, 13.439 s worker Wall, Wall: 4.419 s, Cores in use: 2.31, Total efficiency (on 4 cores): 57.8 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T17:14:24.894629
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/coadd/cus/custom-233743p37095/legacysurvey-custom-233743p37095-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/tractor-i/cus/tractor-custom-233743p37095.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/tractor/cus/tractor-custom-233743p37095.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2092897/tractor/cus/brick-custom-233743p37095.sha256sum
Stage writecat : Wall: 1.43 s, CPU: 0.47 s, VmPeak: 1096 MB, VmSize: 968 MB, VmRSS: 206 MB, VmData: 230 MB, maxrss: 0.566552 MB
Stage writecat finished: 2020-06-07T17:14:26.324806
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.431 s, Cores in use: 0.33, Total efficiency (on 4 cores): 8.3 %
Stage writecat finished
All done: 42.478 s worker CPU, 60.556 s worker Wall, Wall: 25.730 s, Cores in use: 1.91, Total efficiency (on 4 cores): 47.7 %
Finished galaxy PGC2092897 in 0.474 minutes.