Started working on galaxy PGC3130267 at Sun Jun  7 19:03:56 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 116.742555 42.320968 --width 331 --height 331 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:03:58.203558
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '116.742555', '42.320968', '--width', '331', '--height', '331', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 116.742555 42.320968 --width 331 --height 331 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 116.742555 42.320968
Starting process 16396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 16402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 16405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 16406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:03:58.774072
Keeping 9 CCDs:
   k4m_160301_043941_ooi_zd_ls9.fits.fz k4m_160301_043941_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 0.98 MJD 57448.194 object MzLS_616328_z
   k4m_170202_062053_ooi_zd_ls9.fits.fz k4m_170202_062053_ooi_zd_ls9-CCD3 z exptime 80.106 propid 2016A-0453 seeing 1.06 MJD 57786.265 object MzLS_615401_z
   k4m_160229_044627_ooi_zd_ls9.fits.fz k4m_160229_044627_ooi_zd_ls9-CCD4 z exptime 80.106 propid 2016A-0453 seeing 0.75 MJD 57447.199 object MzLS_614471_z
   ksb_170320_034201_ooi_r_ls9.fits.fz ksb_170320_034201_ooi_r_ls9-CCD3 r exptime 85.21 propid BASS seeing 1.25 MJD 57832.154 object 16321
   ksb_160211_053422_ooi_g_ls9.fits.fz ksb_160211_053422_ooi_g_ls9-CCD3 g exptime 96.1 propid 2015A-0801 seeing 1.25 MJD 57429.232 object 16321
   ksb_170226_044353_ooi_r_ls9.fits.fz ksb_170226_044353_ooi_r_ls9-CCD2 r exptime 97.8 propid BASS seeing 1.32 MJD 57810.197 object 17603
   ksb_170224_053705_ooi_g_ls9.fits.fz ksb_170224_053705_ooi_g_ls9-CCD2 g exptime 188.244 propid BASS seeing 2.01 MJD 57808.234 object 17603
   ksb_160206_064829_ooi_g_ls9.fits.fz ksb_160206_064829_ooi_g_ls9-CCD1 g exptime 152.7 propid 2015A-0801 seeing 1.79 MJD 57424.284 object 16312
   ksb_160312_035945_ooi_r_ls9.fits.fz ksb_160312_035945_ooi_r_ls9-CCD1 r exptime 93.7 propid 2015A-0801 seeing 1.35 MJD 57459.166 object 16312
mosaic get_fwhm: self.fwhm = 2.87
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2159 2493 and amp range 2048 4095 and image y 0 132 and amp range 0 2021
Range in image: x 0 335 , y 0 133 (with image size 335 x 133)
dzp -0.0006399284 -> scaling image by 0.9994107778325068
Faked up EXPNUM 78320062
Faked up EXPNUM 78320062
Faked up EXPNUM 78320062
90prime get_fwhm: self.fwhm = 2.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1464 1657 and amp range 0 2015 and image y 3101 3294 and amp range 2048 4095
Range in image: x 0 194 , y 0 194 (with image size 194 x 194)
dzp -0.07725406 -> scaling image by 0.9313188157188347
mosaic get_fwhm: self.fwhm = 4.07
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3722 4046 and amp range 2006 4053 and image y 7 254 and amp range 0 2039
Range in image: x 0 325 , y 0 248 (with image size 325 x 248)
dzp -0.016180232 -> scaling image by 0.9852079488029655
mosaic get_fwhm: self.fwhm = 3.77
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1024 1361 and amp range 0 2005 and image y 2727 3063 and amp range 2040 4078
Range in image: x 0 338 , y 0 337 (with image size 338 x 337)
dzp -0.005990375 -> scaling image by 0.994497853444703
Faked up EXPNUM 74290118
Faked up EXPNUM 74290118
Faked up EXPNUM 74290118
90prime get_fwhm: self.fwhm = 2.75
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1456 1650 and amp range 0 2015 and image y 3083 3276 and amp range 2048 4095
Range in image: x 0 195 , y 0 194 (with image size 195 x 194)
dzp -0.0045482004 -> scaling image by 0.9958197144381092
Faked up EXPNUM 78080067
Faked up EXPNUM 78080067
Faked up EXPNUM 78080067
90prime get_fwhm: self.fwhm = 4.43
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3235 3428 and amp range 2016 4031 and image y 2947 3140 and amp range 2048 4095
Range in image: x 0 194 , y 0 194 (with image size 194 x 194)
dzp 0.010008041 -> scaling image by 1.0092603604948323
Faked up EXPNUM 74240085
Faked up EXPNUM 74240085
Faked up EXPNUM 74240085
90prime get_fwhm: self.fwhm = 3.95
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3446 3639 and amp range 2016 4031 and image y 1560 1754 and amp range 0 2047
Range in image: x 0 194 , y 0 195 (with image size 194 x 195)
dzp -0.0032519526 -> scaling image by 0.9970093219958882
Faked up EXPNUM 78100102
Faked up EXPNUM 78100102
Faked up EXPNUM 78100102
90prime get_fwhm: self.fwhm = 2.91
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3211 3404 and amp range 2016 4031 and image y 2947 3141 and amp range 2048 4095
Range in image: x 0 194 , y 0 195 (with image size 194 x 195)
dzp 0.021366077 -> scaling image by 1.0198737893800265
Faked up EXPNUM 74590041
Faked up EXPNUM 74590041
Faked up EXPNUM 74590041
90prime get_fwhm: self.fwhm = 2.99
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3412 3605 and amp range 2016 4031 and image y 1544 1738 and amp range 0 2047
Range in image: x 0 194 , y 0 195 (with image size 194 x 195)
dzp -0.0041296566 -> scaling image by 0.9962036700684744
Stage tims : Wall: 5.49 s, CPU: 0.99 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566568 MB
Stage tims finished: 2020-06-07T19:04:04.266990
Resources for stage tims : 3.417 s worker CPU, 13.425 s worker Wall, Wall: 5.494 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:04:04.286771
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02025.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01900.fits
Matched 5 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/reference-custom-116742p42320.fits
Stage refs : Wall: 3.12 s, CPU: 2.50 s, VmPeak: 974 MB, VmSize: 968 MB, VmRSS: 199 MB, VmData: 232 MB, maxrss: 0.566568 MB
Stage refs finished: 2020-06-07T19:04:07.405139
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.119 s, Cores in use: 0.80, Total efficiency (on 4 cores): 20.1 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:04:07.406710
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/outlier-mask-custom-116742p42320.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/outliers-pre-custom-116742p42320.jpg
Image ksb_170224_053705_ooi_g_ls9-CCD2 g : masking 875 positive outlier pixels and 0 negative outlier pixels
Image ksb_160206_064829_ooi_g_ls9-CCD1 g : masking 65 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/outlier-mask-custom-116742p42320.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/outliers-post-custom-116742p42320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/outliers-masked-pos-custom-116742p42320.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/outliers-masked-neg-custom-116742p42320.jpg
Stage outliers : Wall: 1.62 s, CPU: 0.97 s, VmPeak: 977 MB, VmSize: 977 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.566568 MB
Stage outliers finished: 2020-06-07T19:04:09.022581
Resources for stage outliers : 1.671 s worker CPU, 1.708 s worker Wall, Wall: 1.617 s, Cores in use: 1.63, Total efficiency (on 4 cores): 40.8 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:04:09.024514
Stage halos : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 977 MB, VmSize: 977 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.566568 MB
Stage halos finished: 2020-06-07T19:04:09.367562
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.344 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.1 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T19:04:09.369355
PSF sigmas in coadd pixels: ['2.02', '3.26', '2.91']
Using average PSF sigma 2.7308282459070994
Gaussian PSF norm 0.10330008567791663 vs pixelized 0.079358555
average tim pixel scale / coadd scale: 1.7296802341397708
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.04', '2.14', '2.20']
Using average PSF sigma 2.126681626679856
Gaussian PSF norm 0.13264552071871724 vs pixelized 0.11356326
average tim pixel scale / coadd scale: 1.7293061943767407
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.59', '1.72', '1.21']
Using average PSF sigma 1.5052392052703498
Gaussian PSF norm 0.18740861305377193 vs pixelized 0.14844127
average tim pixel scale / coadd scale: 0.990844062415755
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.39 s, CPU: 0.26 s, VmPeak: 977 MB, VmSize: 977 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.566568 MB
Stage fit_on_coadds finished: 2020-06-07T19:04:09.762037
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.510 s worker CPU, 0.539 s worker Wall, Wall: 0.394 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.8 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:04:09.764941
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 45 potential peaks
Of 45 potential peaks: 18 in veto map, 7 cut by saddle test, 0 cut by aper test, 20 kept
SED z : 20 new peaks
Found 55 potential peaks
Of 55 potential peaks: 48 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 41 potential peaks
Of 41 potential peaks: 35 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 66 potential peaks
Of 66 potential peaks: 55 in veto map, 5 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 99 potential peaks
Of 99 potential peaks: 86 in veto map, 11 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 30 new sources
Median coadd sky for g : 0.00015937714
Median coadd sky for r : 0.00031186538
Median coadd sky for z : 8.357137e-05
Stage srcs : Wall: 0.81 s, CPU: 0.73 s, VmPeak: 977 MB, VmSize: 977 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.566568 MB
Stage srcs finished: 2020-06-07T19:04:10.575037
Resources for stage srcs : 0.196 s worker CPU, 0.196 s worker Wall, Wall: 0.811 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/PGC3130267-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:04:10.615432
Blob 1 of 12, id: 5, sources: 20, size: 277x220, npix 29692, brick X: 19,296, Y: 69,289, one pixel: 198 69
Blob 2 of 12, id: 0, sources: 4, size: 97x39, npix 2155, brick X: 155,252, Y: 0,39, one pixel: 163 0
Blob 3 of 12, id: 2, sources: 4, size: 60x77, npix 2000, brick X: 269,329, Y: 18,95, one pixel: 290 18
Blob 4 of 12, id: 7, sources: 2, size: 35x36, npix 720, brick X: 226,261, Y: 232,268, one pixel: 246 232
Blob 5 of 12, id: 8, sources: 1, size: 30x28, npix 567, brick X: 239,269, Y: 274,302, one pixel: 251 274
Blob 4 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.140784 MB
Blob 6 of 12, id: 10, sources: 1, size: 29x25, npix 535, brick X: 101,130, Y: 306,331, one pixel: 112 306
Blob 5 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.140784 MB
Blob 7 of 12, id: 11, sources: 3, size: 30x22, npix 517, brick X: 0,30, Y: 309,331, one pixel: 5 309
Blob 6 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 8 of 12, id: 9, sources: 1, size: 21x22, npix 261, brick X: 195,216, Y: 305,327, one pixel: 205 305
Blob 9 of 12, id: 4, sources: 1, size: 20x21, npix 257, brick X: 8,28, Y: 57,78, one pixel: 16 57
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (116.75902, 42.33344), pm (-2.1, -6.6), parallax 0.673 with NanoMaggies: g=16.9, r=15.9, z=15.9
Reset brightness to NanoMaggies: g=16.6, r=15.9, z=15.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (116.75801, 42.33784), pm (10.7, -33.8), parallax 3.809 with NanoMaggies: g=18.3, r=16.9, z=15.4
Reset brightness to NanoMaggies: g=18.3, r=16.9, z=15.4
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14306 MB
Blob 10 of 12, id: 3, sources: 1, size: 21x20, npix 248, brick X: 123,144, Y: 34,54, one pixel: 133 34
Blob 7 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 11 of 12, id: 1, sources: 1, size: 20x21, npix 230, brick X: 44,64, Y: 17,38, one pixel: 53 17
Blob 9 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 12 of 12, id: 6, sources: 1, size: 18x19, npix 198, brick X: 30,48, Y: 87,106, one pixel: 38 87
Blob 8 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14306 MB
Blob 10 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Blob 11 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14306 MB
Blob 12 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142864 MB
Measuring 2 iterative sources
Blob 2 finished, total: Wall: 4.34 s, CPU: 4.33 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144796 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.36517, ee1=-0.0427337, ee2=0.058453
Measuring 1 iterative sources
Blob 1 finished, total: Wall: 15.82 s, CPU: 15.82 s, VmPeak: 805 MB, VmSize: 753 MB, VmRSS: 190 MB, VmData: 218 MB, maxrss: 0.194168 MB
Old catalog: 46
New catalog: 35
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/blobs-custom-116742p42320.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/metrics/cus/all-models-custom-116742p42320.fits
Stage fitblobs : Wall: 16.35 s, CPU: 0.49 s, VmPeak: 977 MB, VmSize: 977 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.566568 MB
Stage fitblobs finished: 2020-06-07T19:04:26.962649
Resources for stage fitblobs : 26.398 s worker CPU, 26.449 s worker Wall, Wall: 16.350 s, Cores in use: 1.64, Total efficiency (on 4 cores): 41.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:04:26.966099
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/tmp-legacysurvey-custom-116742p42320-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/tmp-legacysurvey-custom-116742p42320-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/tmp-legacysurvey-custom-116742p42320-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/tmp-legacysurvey-custom-116742p42320-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-resid.jpg
Stage coadds : Wall: 1.73 s, CPU: 0.84 s, VmPeak: 977 MB, VmSize: 977 MB, VmRSS: 222 MB, VmData: 249 MB, maxrss: 0.566568 MB
Stage coadds finished: 2020-06-07T19:04:28.697021
Resources for stage coadds : 2.562 s worker CPU, 2.675 s worker Wall, Wall: 1.732 s, Cores in use: 1.96, Total efficiency (on 4 cores): 49.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:04:28.698826
Cut to 1 unWISE tiles
Reading WISE tile 1173p424 band 1
Reading WISE tile 1173p424 band 2
Reading WISE tile 1173p424 band 3
Reading WISE tile 1173p424 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.212056 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 808 MB, VmSize: 793 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.19218 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 807 MB, VmRSS: 168 MB, VmData: 189 MB, maxrss: 0.226128 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/117/1173p424/unwise-1173p424-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.211968 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/tmp-legacysurvey-custom-116742p42320-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/tmp-legacysurvey-custom-116742p42320-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.02 s, CPU: 0.49 s, VmPeak: 977 MB, VmSize: 977 MB, VmRSS: 223 MB, VmData: 249 MB, maxrss: 0.566568 MB
Stage wise_forced finished: 2020-06-07T19:04:31.718955
Resources for stage wise_forced : 5.272 s worker CPU, 8.101 s worker Wall, Wall: 3.021 s, Cores in use: 1.91, Total efficiency (on 4 cores): 47.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:04:31.720833
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/coadd/cus/custom-116742p42320/legacysurvey-custom-116742p42320-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/tractor-i/cus/tractor-custom-116742p42320.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/tractor/cus/tractor-custom-116742p42320.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/116/PGC3130267/tractor/cus/brick-custom-116742p42320.sha256sum
Stage writecat : Wall: 0.91 s, CPU: 0.74 s, VmPeak: 1110 MB, VmSize: 982 MB, VmRSS: 225 MB, VmData: 249 MB, maxrss: 0.566568 MB
Stage writecat finished: 2020-06-07T19:04:32.633953
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.914 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.3 %
Stage writecat finished
All done: 40.029 s worker CPU, 53.096 s worker Wall, Wall: 33.867 s, Cores in use: 1.43, Total efficiency (on 4 cores): 35.7 %
Finished galaxy PGC3130267 in 0.603 minutes.