Started working on galaxy NGC3408 at Sun Jun  7 19:49:42 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.048644 58.43814329999999 --width 581 --height 581 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:49:44.279645
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '163.048644', '58.43814329999999', '--width', '581', '--height', '581', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 163.048644 58.43814329999999 --width 581 --height 581 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 163.048644 58.43814329999999
Starting process 36354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 36355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 36356 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 36357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:49:44.791712
Keeping 10 CCDs:
   k4m_170501_042033_ooi_zd_ls9.fits.fz k4m_170501_042033_ooi_zd_ls9-CCD2 z exptime 80.103 propid 2016A-0453 seeing 0.79 MJD 57874.181 object MzLS_681064_z
   k4m_170408_074743_ooi_zd_ls9.fits.fz k4m_170408_074743_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.83 MJD 57851.325 object MzLS_681723_z
   k4m_161215_124006_ooi_zd_ls9.fits.fz k4m_161215_124006_ooi_zd_ls9-CCD2 z exptime 80.104 propid 2016A-0453 seeing 0.92 MJD 57737.528 object MzLS_680400_z
   k4m_170408_074941_ooi_zd_ls9.fits.fz k4m_170408_074941_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 0.80 MJD 57851.326 object MzLS_681724_z
   ksb_170430_041439_ooi_r_ls9.fits.fz ksb_170430_041439_ooi_r_ls9-CCD2 r exptime 86.332 propid BASS seeing 1.08 MJD 57873.177 object 36273
   ksb_170522_040707_ooi_g_ls9.fits.fz ksb_170522_040707_ooi_g_ls9-CCD2 g exptime 134.912 propid 2015A-0801 seeing 1.64 MJD 57895.172 object 36273
   ksb_170403_050327_ooi_r_ls9.fits.fz ksb_170403_050327_ooi_r_ls9-CCD1 r exptime 127.908 propid BASS seeing 1.44 MJD 57846.211 object 35261
   ksb_180317_094135_ooi_g_ls9.fits.fz ksb_180317_094135_ooi_g_ls9-CCD1 g exptime 90.053 propid BASS seeing 1.26 MJD 58194.404 object 35261
   ksb_170518_051758_ooi_g_ls9.fits.fz ksb_170518_051758_ooi_g_ls9-CCD1 g exptime 151.35 propid BASS seeing 1.79 MJD 57891.221 object 35262
   ksb_170325_065859_ooi_r_ls9.fits.fz ksb_170325_065859_ooi_r_ls9-CCD1 r exptime 77.152 propid BASS seeing 2.26 MJD 57837.291 object 35262
mosaic get_fwhm: self.fwhm = 3.03
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 555 1140 and amp range 0 2047 and image y 2564 3148 and amp range 2040 4078
Range in image: x 0 586 , y 0 585 (with image size 586 x 585)
dzp 0.015739892 -> scaling image by 1.0146025667655956
Faked up EXPNUM 78730052
Faked up EXPNUM 78730052
Faked up EXPNUM 78730052
90prime get_fwhm: self.fwhm = 2.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2222 2558 and amp range 2016 4031 and image y 4045 4080 and amp range 2048 4095
Range in image: x 0 337 , y 0 36 (with image size 337 x 36)
dzp 0.021366077 -> scaling image by 1.0198737893800265
mosaic get_fwhm: self.fwhm = 3.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3246 3845 and amp range 2048 4095 and image y 2925 3512 and amp range 2040 4078
Range in image: x 0 600 , y 0 588 (with image size 600 x 588)
dzp -0.032976374 -> scaling image by 0.9700842429001929
Faked up EXPNUM 78460072
Faked up EXPNUM 78460072
Faked up EXPNUM 78460072
90prime get_fwhm: self.fwhm = 3.17
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 410 755 and amp range 0 2015 and image y 1327 1668 and amp range 0 2047
Range in image: x 0 346 , y 0 342 (with image size 346 x 342)
dzp -0.024106435 -> scaling image by 0.9780418215011345
Faked up EXPNUM 78950052
Faked up EXPNUM 78950052
Faked up EXPNUM 78950052
90prime get_fwhm: self.fwhm = 3.63
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2232 2569 and amp range 2016 4031 and image y 4051 4080 and amp range 2048 4095
Range in image: x 0 338 , y 0 30 (with image size 338 x 30)
dzp 0.010008041 -> scaling image by 1.0092603604948323
Faked up EXPNUM 78910040
Faked up EXPNUM 78910040
Faked up EXPNUM 78910040
90prime get_fwhm: self.fwhm = 3.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2418 2756 and amp range 2016 4031 and image y 3286 3623 and amp range 2048 4095
Range in image: x 0 339 , y 0 338 (with image size 339 x 338)
dzp 0.020521455 -> scaling image by 1.0190807119283773
mosaic get_fwhm: self.fwhm = 3.19
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2118 2708 and amp range 2006 4053 and image y 3056 3659 and amp range 2040 4078
Range in image: x 0 591 , y 0 604 (with image size 591 x 604)
dzp -0.0021409686 -> scaling image by 0.9980300379995196
Faked up EXPNUM 81940082
Faked up EXPNUM 81940082
Faked up EXPNUM 81940082
90prime get_fwhm: self.fwhm = 2.79
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 425 771 and amp range 0 2015 and image y 1328 1669 and amp range 0 2047
Range in image: x 0 347 , y 0 342 (with image size 347 x 342)
dzp -0.030770088 -> scaling image by 0.9720575212609548
Faked up EXPNUM 78370112
Faked up EXPNUM 78370112
Faked up EXPNUM 78370112
90prime get_fwhm: self.fwhm = 4.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2427 2766 and amp range 2016 4031 and image y 3276 3613 and amp range 2048 4095
Range in image: x 0 340 , y 0 338 (with image size 340 x 338)
dzp 0.02308583 -> scaling image by 1.021490500713915
Stage tims : Wall: 6.49 s, CPU: 0.90 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 183 MB, VmData: 217 MB, maxrss: 0.566564 MB
Stage tims finished: 2020-06-07T19:49:51.279688
Resources for stage tims : 3.298 s worker CPU, 16.393 s worker Wall, Wall: 6.489 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:49:51.310521
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00963.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00877.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00878.fits
Matched 7 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/reference-custom-163048p58438.fits
Stage refs : Wall: 1.92 s, CPU: 1.25 s, VmPeak: 972 MB, VmSize: 954 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.566564 MB
Stage refs finished: 2020-06-07T19:49:53.231442
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.922 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:49:53.232821
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/outlier-mask-custom-163048p58438.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/outliers-pre-custom-163048p58438.jpg
Image ksb_180317_094135_ooi_g_ls9-CCD1 g : masking 237 positive outlier pixels and 0 negative outlier pixels
Image ksb_170518_051758_ooi_g_ls9-CCD1 g : masking 300 positive outlier pixels and 0 negative outlier pixels
Image ksb_170325_065859_ooi_r_ls9-CCD1 r : masking 76 positive outlier pixels and 0 negative outlier pixels
Image k4m_170408_074743_ooi_zd_ls9-CCD3 z : masking 2495 positive outlier pixels and 113 negative outlier pixels
Image k4m_170501_042033_ooi_zd_ls9-CCD2 z : masking 564 positive outlier pixels and 0 negative outlier pixels
Image k4m_161215_124006_ooi_zd_ls9-CCD2 z : masking 1787 positive outlier pixels and 108 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/outlier-mask-custom-163048p58438.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/outliers-post-custom-163048p58438.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/outliers-masked-pos-custom-163048p58438.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/outliers-masked-neg-custom-163048p58438.jpg
Stage outliers : Wall: 2.49 s, CPU: 1.41 s, VmPeak: 974 MB, VmSize: 974 MB, VmRSS: 258 MB, VmData: 289 MB, maxrss: 0.566564 MB
Stage outliers finished: 2020-06-07T19:49:55.718364
Resources for stage outliers : 3.456 s worker CPU, 3.584 s worker Wall, Wall: 2.488 s, Cores in use: 1.96, Total efficiency (on 4 cores): 49.0 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:49:55.721284
Stage halos : Wall: 0.30 s, CPU: 0.28 s, VmPeak: 974 MB, VmSize: 974 MB, VmRSS: 226 MB, VmData: 289 MB, maxrss: 0.566564 MB
Stage halos finished: 2020-06-07T19:49:56.021614
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.301 s, Cores in use: 0.93, Total efficiency (on 4 cores): 23.4 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T19:49:56.023532
PSF sigmas in coadd pixels: ['2.67', '2.05', '2.91']
Using average PSF sigma 2.5441038290675557
Gaussian PSF norm 0.11088179206792408 vs pixelized 0.09469919
average tim pixel scale / coadd scale: 1.7296763017901595
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.76', '2.33', '3.67']
Using average PSF sigma 2.588055061565399
Gaussian PSF norm 0.10899875971079671 vs pixelized 0.099743195
average tim pixel scale / coadd scale: 1.7295315380044678
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.28', '1.35', '1.49']
Using average PSF sigma 1.3704044592893585
Gaussian PSF norm 0.2058478355507995 vs pixelized 0.17734915
average tim pixel scale / coadd scale: 0.9909012147851061
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.71 s, CPU: 0.59 s, VmPeak: 974 MB, VmSize: 974 MB, VmRSS: 265 MB, VmData: 293 MB, maxrss: 0.566564 MB
Stage fit_on_coadds finished: 2020-06-07T19:49:56.731620
Resources for stage fit_on_coadds : 0.792 s worker CPU, 0.864 s worker Wall, Wall: 0.711 s, Cores in use: 1.94, Total efficiency (on 4 cores): 48.6 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:49:56.736037
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 162 potential peaks
Of 162 potential peaks: 99 in veto map, 15 cut by saddle test, 0 cut by aper test, 48 kept
SED z : 48 new peaks
Found 81 potential peaks
Of 81 potential peaks: 71 in veto map, 9 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 110 potential peaks
Of 110 potential peaks: 90 in veto map, 15 cut by saddle test, 0 cut by aper test, 5 kept
SED g : 5 new peaks
Found 153 potential peaks
Of 153 potential peaks: 128 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept
SED Flat : 11 new peaks
Found 223 potential peaks
Of 223 potential peaks: 204 in veto map, 18 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 66 new sources
Median coadd sky for g : 4.8702736e-05
Median coadd sky for r : 0.00018436924
Median coadd sky for z : 0.00015145465
Stage srcs : Wall: 1.65 s, CPU: 1.44 s, VmPeak: 974 MB, VmSize: 974 MB, VmRSS: 237 MB, VmData: 293 MB, maxrss: 0.566564 MB
Stage srcs finished: 2020-06-07T19:49:58.388442
Resources for stage srcs : 0.568 s worker CPU, 0.568 s worker Wall, Wall: 1.653 s, Cores in use: 1.21, Total efficiency (on 4 cores): 30.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/NGC3408-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:49:58.415791
Blob 1 of 54, id: 18, sources: 14, size: 294x269, npix 52205, brick X: 124,418, Y: 151,420, one pixel: 261 151
Blob 2 of 54, id: 6, sources: 2, size: 56x54, npix 1965, brick X: 226,282, Y: 59,113, one pixel: 236 59
Blob 3 of 54, id: 45, sources: 3, size: 64x48, npix 1748, brick X: 512,576, Y: 484,532, one pixel: 543 484
Blob 4 of 54, id: 41, sources: 4, size: 40x80, npix 1629, brick X: 0,40, Y: 440,520, one pixel: 4 440
Blob 5 of 54, id: 48, sources: 2, size: 56x46, npix 1598, brick X: 346,402, Y: 534,580, one pixel: 382 534
Blob 2 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 805 MB, VmSize: 718 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148596 MB
Blob 6 of 54, id: 10, sources: 2, size: 41x45, npix 1466, brick X: 0,41, Y: 92,137, one pixel: 13 92
Blob 3 finished, total: Wall: 2.41 s, CPU: 2.36 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144512 MB
Blob 7 of 54, id: 24, sources: 1, size: 38x37, npix 958, brick X: 391,429, Y: 202,239, one pixel: 405 202
Blob 4 finished, total: Wall: 2.56 s, CPU: 2.53 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142828 MB
Blob 8 of 54, id: 46, sources: 3, size: 29x61, npix 898, brick X: 299,328, Y: 487,548, one pixel: 311 487
Measuring 1 iterative sources
Blob 5 finished, total: Wall: 2.35 s, CPU: 2.35 s, VmPeak: 805 MB, VmSize: 718 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149132 MB
Blob 9 of 54, id: 47, sources: 1, size: 38x32, npix 841, brick X: 105,143, Y: 529,561, one pixel: 119 529
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144696 MB
Blob 10 of 54, id: 0, sources: 1, size: 36x30, npix 790, brick X: 250,286, Y: 0,30, one pixel: 257 0
Blob 7 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143292 MB
Blob 11 of 54, id: 17, sources: 1, size: 33x32, npix 726, brick X: 58,91, Y: 138,170, one pixel: 72 138
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143292 MB
Blob 12 of 54, id: 44, sources: 1, size: 33x30, npix 671, brick X: 414,447, Y: 469,499, one pixel: 425 469
Blob 9 finished, total: Wall: 1.12 s, CPU: 1.11 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144696 MB
Blob 13 of 54, id: 7, sources: 1, size: 33x31, npix 670, brick X: 530,563, Y: 72,103, one pixel: 545 72
Blob 8 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 805 MB, VmSize: 718 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149132 MB
Blob 14 of 54, id: 43, sources: 1, size: 30x31, npix 614, brick X: 260,290, Y: 460,491, one pixel: 273 460
Blob 11 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143292 MB
Blob 15 of 54, id: 3, sources: 1, size: 29x28, npix 540, brick X: 440,469, Y: 33,61, one pixel: 453 33
Blob 14 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 16 of 54, id: 34, sources: 1, size: 27x28, npix 480, brick X: 205,232, Y: 376,404, one pixel: 215 376
Blob 13 finished, total: Wall: 1.67 s, CPU: 1.67 s, VmPeak: 805 MB, VmSize: 718 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.14976 MB
Blob 17 of 54, id: 27, sources: 2, size: 36x22, npix 475, brick X: 68,104, Y: 260,282, one pixel: 93 260
Blob 12 finished, total: Wall: 1.91 s, CPU: 1.91 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145568 MB
Blob 18 of 54, id: 4, sources: 1, size: 28x27, npix 469, brick X: 507,535, Y: 41,68, one pixel: 518 41
Blob 15 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 19 of 54, id: 37, sources: 1, size: 26x27, npix 435, brick X: 545,571, Y: 405,432, one pixel: 557 405
Blob 16 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 20 of 54, id: 25, sources: 1, size: 26x27, npix 429, brick X: 547,573, Y: 217,244, one pixel: 557 217
Blob 17 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145568 MB
Blob 21 of 54, id: 51, sources: 1, size: 25x28, npix 416, brick X: 194,219, Y: 545,573, one pixel: 203 545
Blob 18 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 22 of 54, id: 53, sources: 1, size: 25x25, npix 414, brick X: 64,89, Y: 554,579, one pixel: 74 554
Blob 19 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 23 of 54, id: 26, sources: 1, size: 23x32, npix 411, brick X: 453,476, Y: 245,277, one pixel: 463 245
Blob 20 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145568 MB
Blob 24 of 54, id: 5, sources: 1, size: 27x24, npix 403, brick X: 108,135, Y: 47,71, one pixel: 118 47
Blob 22 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 25 of 54, id: 38, sources: 1, size: 25x26, npix 394, brick X: 118,143, Y: 413,439, one pixel: 128 413
Blob 21 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 26 of 54, id: 14, sources: 1, size: 24x27, npix 388, brick X: 104,128, Y: 114,141, one pixel: 115 114
Measuring 1 iterative sources
Blob 23 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145568 MB
Blob 27 of 54, id: 15, sources: 1, size: 25x24, npix 383, brick X: 269,294, Y: 125,149, one pixel: 279 125
Blob 25 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 28 of 54, id: 32, sources: 1, size: 25x24, npix 369, brick X: 504,529, Y: 325,349, one pixel: 514 325
Blob 26 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145568 MB
Blob 29 of 54, id: 36, sources: 1, size: 21x29, npix 361, brick X: 57,78, Y: 384,413, one pixel: 65 384
Blob 24 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 30 of 54, id: 31, sources: 1, size: 24x24, npix 342, brick X: 450,474, Y: 315,339, one pixel: 461 315
Blob 27 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 31 of 54, id: 40, sources: 1, size: 23x24, npix 338, brick X: 238,261, Y: 430,454, one pixel: 247 430
Blob 32 of 54, id: 16, sources: 1, size: 24x22, npix 325, brick X: 90,114, Y: 136,158, one pixel: 99 136
Blob 28 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145568 MB
Blob 33 of 54, id: 9, sources: 1, size: 22x24, npix 316, brick X: 352,374, Y: 90,114, one pixel: 362 90
Blob 30 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 34 of 54, id: 52, sources: 1, size: 22x24, npix 312, brick X: 133,155, Y: 550,574, one pixel: 144 550
Blob 29 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 35 of 54, id: 28, sources: 1, size: 22x23, npix 304, brick X: 434,456, Y: 280,303, one pixel: 443 280
Blob 31 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Blob 36 of 54, id: 21, sources: 1, size: 22x22, npix 301, brick X: 58,80, Y: 173,195, one pixel: 66 173
Blob 32 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 37 of 54, id: 42, sources: 1, size: 23x21, npix 279, brick X: 317,340, Y: 447,468, one pixel: 326 447
Blob 33 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 38 of 54, id: 2, sources: 1, size: 22x21, npix 271, brick X: 46,68, Y: 2,23, one pixel: 55 2
Blob 34 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Blob 39 of 54, id: 33, sources: 1, size: 21x21, npix 269, brick X: 14,35, Y: 341,362, one pixel: 23 341
Blob 36 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 40 of 54, id: 8, sources: 1, size: 20x21, npix 257, brick X: 323,343, Y: 90,111, one pixel: 331 90
Blob 35 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 41 of 54, id: 11, sources: 1, size: 21x20, npix 249, brick X: 454,475, Y: 107,127, one pixel: 463 107
Blob 37 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Blob 42 of 54, id: 22, sources: 1, size: 20x21, npix 249, brick X: 363,383, Y: 174,195, one pixel: 371 174
Blob 39 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 38 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 43 of 54, id: 30, sources: 1, size: 20x20, npix 238, brick X: 547,567, Y: 313,333, one pixel: 556 313
Blob 44 of 54, id: 1, sources: 1, size: 20x20, npix 229, brick X: 198,218, Y: 1,21, one pixel: 206 1
Blob 42 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 45 of 54, id: 39, sources: 1, size: 20x20, npix 219, brick X: 152,172, Y: 420,440, one pixel: 160 420
Blob 40 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Blob 46 of 54, id: 29, sources: 1, size: 18x20, npix 198, brick X: 503,521, Y: 300,320, one pixel: 511 300
Blob 41 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 47 of 54, id: 50, sources: 1, size: 19x18, npix 198, brick X: 561,580, Y: 538,556, one pixel: 569 538
Blob 45 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 48 of 54, id: 19, sources: 1, size: 19x19, npix 190, brick X: 382,401, Y: 154,173, one pixel: 390 154
Blob 44 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Blob 49 of 54, id: 49, sources: 1, size: 19x19, npix 190, brick X: 25,44, Y: 536,555, one pixel: 34 536
Blob 46 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 50 of 54, id: 23, sources: 1, size: 19x18, npix 189, brick X: 362,381, Y: 196,214, one pixel: 370 196
Blob 47 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 804 MB, VmSize: 714 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Blob 51 of 54, id: 35, sources: 1, size: 18x19, npix 189, brick X: 438,456, Y: 377,396, one pixel: 447 377
Blob 43 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 52 of 54, id: 20, sources: 1, size: 18x18, npix 180, brick X: 414,432, Y: 157,175, one pixel: 422 157
Blob 50 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 53 of 54, id: 12, sources: 1, size: 18x17, npix 162, brick X: 214,232, Y: 112,129, one pixel: 222 112
Blob 49 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 804 MB, VmSize: 715 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Blob 54 of 54, id: 13, sources: 1, size: 17x17, npix 145, brick X: 197,214, Y: 113,130, one pixel: 205 113
Blob 48 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 51 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 53 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143292 MB
Blob 54 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149808 MB
Blob 52 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 804 MB, VmSize: 715 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145808 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.4018, ee1=-0.0444496, ee2=-0.145925
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 22.08 s, CPU: 22.07 s, VmPeak: 791 MB, VmSize: 754 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.202952 MB
Old catalog: 82
New catalog: 74
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/blobs-custom-163048p58438.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/metrics/cus/all-models-custom-163048p58438.fits
Stage fitblobs : Wall: 22.52 s, CPU: 0.62 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 238 MB, VmData: 294 MB, maxrss: 0.566564 MB
Stage fitblobs finished: 2020-06-07T19:50:20.936521
Resources for stage fitblobs : 59.641 s worker CPU, 59.781 s worker Wall, Wall: 22.524 s, Cores in use: 2.68, Total efficiency (on 4 cores): 66.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:50:20.940565
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/tmp-legacysurvey-custom-163048p58438-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/tmp-legacysurvey-custom-163048p58438-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/tmp-legacysurvey-custom-163048p58438-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/tmp-legacysurvey-custom-163048p58438-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-resid.jpg
Stage coadds : Wall: 2.74 s, CPU: 1.18 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 293 MB, VmData: 336 MB, maxrss: 0.566564 MB
Stage coadds finished: 2020-06-07T19:50:23.684179
Resources for stage coadds : 3.581 s worker CPU, 3.679 s worker Wall, Wall: 2.745 s, Cores in use: 1.74, Total efficiency (on 4 cores): 43.4 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:50:23.685711
Cut to 1 unWISE tiles
Reading WISE tile 1641p590 band 2
Reading WISE tile 1641p590 band 1
Reading WISE tile 1641p590 band 4
Reading WISE tile 1641p590 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.55 s, CPU: 0.98 s, VmPeak: 1127 MB, VmSize: 999 MB, VmRSS: 151 MB, VmData: 189 MB, maxrss: 0.199772 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.19 s, CPU: 0.38 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.213564 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.24 s, CPU: 0.50 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 153 MB, VmData: 191 MB, maxrss: 0.217184 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/164/1641p590/unwise-1641p590-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.19 s, CPU: 0.28 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 166 MB, VmData: 199 MB, maxrss: 0.230088 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/tmp-legacysurvey-custom-163048p58438-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/tmp-legacysurvey-custom-163048p58438-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.18 s, CPU: 0.72 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 295 MB, VmData: 336 MB, maxrss: 0.566564 MB
Stage wise_forced finished: 2020-06-07T19:50:26.864792
Resources for stage wise_forced : 7.286 s worker CPU, 8.339 s worker Wall, Wall: 3.180 s, Cores in use: 2.52, Total efficiency (on 4 cores): 62.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:50:26.866844
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/coadd/cus/custom-163048p58438/legacysurvey-custom-163048p58438-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/tractor-i/cus/tractor-custom-163048p58438.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/tractor/cus/tractor-custom-163048p58438.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/163/NGC3408/tractor/cus/brick-custom-163048p58438.sha256sum
Stage writecat : Wall: 1.01 s, CPU: 0.77 s, VmPeak: 1147 MB, VmSize: 1019 MB, VmRSS: 296 MB, VmData: 336 MB, maxrss: 0.566564 MB
Stage writecat finished: 2020-06-07T19:50:27.872245
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.006 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.1 %
Stage writecat finished
All done: 78.625 s worker CPU, 93.210 s worker Wall, Wall: 43.085 s, Cores in use: 2.04, Total efficiency (on 4 cores): 51.0 %
Finished galaxy NGC3408 in 0.769 minutes.