Started working on galaxy PGC3133129 at Sun Jun  7 16:47:58 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.60705450000003 52.1246893 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T16:47:59.459535
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.60705450000003', '52.1246893', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.60705450000003 52.1246893 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 243.60705450000003 52.1246893
Starting process 49059 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 49060 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 49061 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Starting process 49062 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T16:47:59.963735
Keeping 10 CCDs:
   k4m_160531_072337_ooi_zd_ls9.fits.fz k4m_160531_072337_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 0.82 MJD 57539.308 object MzLS_657408_z
   k4m_160607_065624_ooi_zd_ls9.fits.fz k4m_160607_065624_ooi_zd_ls9-CCD4 z exptime 80.102 propid 2016A-0453 seeing 0.99 MJD 57546.289 object MzLS_657407_z
   k4m_160604_063529_ooi_zd_ls9.fits.fz k4m_160604_063529_ooi_zd_ls9-CCD2 z exptime 80.103 propid 2016A-0453 seeing 0.91 MJD 57543.275 object MzLS_658181_z
   k4m_170518_071501_ooi_zd_ls9.fits.fz k4m_170518_071501_ooi_zd_ls9-CCD1 z exptime 81.104 propid 2016A-0453 seeing 1.08 MJD 57891.302 object MzLS_658952_z
   ksb_160513_091654_ooi_r_ls9.fits.fz ksb_160513_091654_ooi_r_ls9-CCD3 r exptime 68.1 propid BASS seeing 1.11 MJD 57521.387 object 29281
   ksb_170602_091233_ooi_g_ls9.fits.fz ksb_170602_091233_ooi_g_ls9-CCD3 g exptime 106.445 propid 2015A-0801 seeing 1.49 MJD 57906.384 object 29281
   ksb_170404_105311_ooi_g_ls9.fits.fz ksb_170404_105311_ooi_g_ls9-CCD1 g exptime 140.107 propid BASS seeing 2.11 MJD 57847.454 object 29283
   ksb_170423_104056_ooi_r_ls9.fits.fz ksb_170423_104056_ooi_r_ls9-CCD1 r exptime 87.458 propid BASS seeing 1.48 MJD 57866.445 object 29283
   ksb_160708_050358_ooi_g_ls9.fits.fz ksb_160708_050358_ooi_g_ls9-CCD4 g exptime 156.9 propid BASS seeing 2.06 MJD 57577.211 object 29282
   ksb_160710_054612_ooi_r_ls9.fits.fz ksb_160710_054612_ooi_r_ls9-CCD4 r exptime 160.2 propid BASS seeing 2.20 MJD 57579.240 object 29282
mosaic get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 7 148 and amp range 0 2047 and image y 2950 3195 and amp range 2040 4078
Range in image: x 0 142 , y 0 246 (with image size 142 x 246)
dzp 0.008550294 -> scaling image by 1.0079062018164673
mosaic get_fwhm: self.fwhm = 3.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2653 2908 and amp range 2048 4095 and image y 3884 4054 and amp range 2022 4060
Range in image: x 0 256 , y 0 171 (with image size 256 x 171)
dzp -0.0028835079 -> scaling image by 0.9973477146455455
mosaic get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2618 2873 and amp range 2048 4095 and image y 254 509 and amp range 0 2039
Range in image: x 0 256 , y 0 256 (with image size 256 x 256)
dzp 0.0072022504 -> scaling image by 1.0066555682883527
mosaic get_fwhm: self.fwhm = 4.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1476 1725 and amp range 0 2005 and image y 2254 2503 and amp range 2040 4078
Range in image: x 0 250 , y 0 250 (with image size 250 x 250)
dzp 0.032569118 -> scaling image by 1.0304517167935139
Faked up EXPNUM 75210174
Faked up EXPNUM 75210174
Faked up EXPNUM 75210174
90prime get_fwhm: self.fwhm = 2.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3068 3210 and amp range 2016 4031 and image y 157 300 and amp range 0 2047
Range in image: x 0 143 , y 0 144 (with image size 143 x 144)
dzp 0.004245165 -> scaling image by 1.0039175950705865
Faked up EXPNUM 78660212
Faked up EXPNUM 78660212
Faked up EXPNUM 78660212
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1035 1179 and amp range 0 2015 and image y 2617 2760 and amp range 2048 4095
Range in image: x 0 145 , y 0 144 (with image size 145 x 144)
dzp -0.041613504 -> scaling image by 0.9623977484321999
Faked up EXPNUM 79060133
Faked up EXPNUM 79060133
Faked up EXPNUM 79060133
90prime get_fwhm: self.fwhm = 3.29
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3068 3211 and amp range 2016 4031 and image y 147 289 and amp range 0 2047
Range in image: x 0 144 , y 0 143 (with image size 144 x 143)
dzp -3.875605e-05 -> scaling image by 0.9999643049955675
Faked up EXPNUM 78470088
Faked up EXPNUM 78470088
Faked up EXPNUM 78470088
90prime get_fwhm: self.fwhm = 4.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1034 1179 and amp range 0 2015 and image y 2631 2774 and amp range 2048 4095
Range in image: x 0 146 , y 0 144 (with image size 146 x 144)
dzp -0.034377232 -> scaling image by 0.9688334104074875
Faked up EXPNUM 75770053
Faked up EXPNUM 75770053
Faked up EXPNUM 75770053
90prime get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 877 1019 and amp range 0 2015 and image y 2125 2267 and amp range 2048 4095
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp 0.009255477 -> scaling image by 1.0085610475070432
Faked up EXPNUM 75790062
Faked up EXPNUM 75790062
Faked up EXPNUM 75790062
90prime get_fwhm: self.fwhm = 4.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 875 1017 and amp range 0 2015 and image y 2113 2255 and amp range 2048 4095
Range in image: x 0 143 , y 0 143 (with image size 143 x 143)
dzp 0.004205519 -> scaling image by 1.0038809374310762
Stage tims : Wall: 6.46 s, CPU: 1.12 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.566564 MB
Stage tims finished: 2020-06-07T16:48:06.423322
Resources for stage tims : 3.356 s worker CPU, 15.887 s worker Wall, Wall: 6.461 s, Cores in use: 0.69, Total efficiency (on 4 cores): 17.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T16:48:06.526464
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01370.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01267.fits
Matched 17 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/reference-custom-243607p52124.fits
Stage refs : Wall: 2.20 s, CPU: 1.91 s, VmPeak: 972 MB, VmSize: 961 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.566564 MB
Stage refs finished: 2020-06-07T16:48:08.728974
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.203 s, Cores in use: 0.87, Total efficiency (on 4 cores): 21.6 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T16:48:08.730390
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/outlier-mask-custom-243607p52124.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/outliers-pre-custom-243607p52124.jpg
Image ksb_160513_091654_ooi_r_ls9-CCD3 r : masking 234 positive outlier pixels and 0 negative outlier pixels
Image k4m_160604_063529_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 311 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/outlier-mask-custom-243607p52124.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/outliers-post-custom-243607p52124.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/outliers-masked-pos-custom-243607p52124.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/outliers-masked-neg-custom-243607p52124.jpg
Stage outliers : Wall: 1.20 s, CPU: 0.97 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 192 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage outliers finished: 2020-06-07T16:48:09.931244
Resources for stage outliers : 0.731 s worker CPU, 0.740 s worker Wall, Wall: 1.202 s, Cores in use: 1.42, Total efficiency (on 4 cores): 35.4 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T16:48:09.932891
Stage halos : Wall: 0.42 s, CPU: 0.41 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 192 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage halos finished: 2020-06-07T16:48:10.351431
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.419 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.6 %
Stage halos finished
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-06-07T16:48:10.353168
PSF sigmas in coadd pixels: ['2.42', '3.42', '3.35']
Using average PSF sigma 3.0641038907432274
Gaussian PSF norm 0.09206436917041133 vs pixelized 0.07454215
average tim pixel scale / coadd scale: 1.729541402203493
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.80', '2.41', '3.57']
Using average PSF sigma 2.59258975793048
Gaussian PSF norm 0.10880811008026921 vs pixelized 0.09361161
average tim pixel scale / coadd scale: 1.729165629540634
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.33', '1.61', '1.47', '1.75']
Using average PSF sigma 1.5411259901023702
Gaussian PSF norm 0.18304460088635574 vs pixelized 0.15006243
average tim pixel scale / coadd scale: 0.9908739716002988
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 193 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage fit_on_coadds finished: 2020-06-07T16:48:10.536602
Resources for stage fit_on_coadds : 0.162 s worker CPU, 0.162 s worker Wall, Wall: 0.185 s, Cores in use: 1.81, Total efficiency (on 4 cores): 45.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T16:48:10.539552
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 23 potential peaks
Of 23 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 19 kept
SED z : 19 new peaks
Found 29 potential peaks
Of 29 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 28 potential peaks
Of 28 potential peaks: 25 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 46 potential peaks
Of 46 potential peaks: 40 in veto map, 3 cut by saddle test, 1 cut by aper test, 2 kept
SED Flat : 2 new peaks
Found 51 potential peaks
Of 51 potential peaks: 44 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 25 new sources
Median coadd sky for g : 0.00024496746
Median coadd sky for r : 0.00073583476
Median coadd sky for z : 2.6264195e-05
Stage srcs : Wall: 0.52 s, CPU: 0.47 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 194 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage srcs finished: 2020-06-07T16:48:11.055075
Resources for stage srcs : 0.093 s worker CPU, 0.102 s worker Wall, Wall: 0.516 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/PGC3133129-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T16:48:11.068487
Blob 1 of 11, id: 2, sources: 15, size: 156x213, npix 21657, brick X: 44,200, Y: 5,218, one pixel: 125 5
Blob 2 of 11, id: 3, sources: 1, size: 34x34, npix 798, brick X: 179,213, Y: 10,44, one pixel: 196 10
Blob 3 of 11, id: 1, sources: 2, size: 35x30, npix 763, brick X: 210,245, Y: 0,30, one pixel: 216 0
Blob 4 of 11, id: 5, sources: 2, size: 39x31, npix 672, brick X: 15,54, Y: 81,112, one pixel: 25 81
Blob 5 of 11, id: 10, sources: 1, size: 30x27, npix 571, brick X: 150,180, Y: 218,245, one pixel: 162 218
Blob 2 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.139816 MB
Blob 6 of 11, id: 4, sources: 1, size: 25x24, npix 365, brick X: 203,228, Y: 38,62, one pixel: 213 38
Blob 4 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB
Blob 7 of 11, id: 8, sources: 1, size: 21x21, npix 258, brick X: 190,211, Y: 188,209, one pixel: 199 188
Blob 8 of 11, id: 6, sources: 1, size: 21x20, npix 248, brick X: 204,225, Y: 82,102, one pixel: 213 82
Blob 6 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB
Blob 9 of 11, id: 0, sources: 1, size: 15x20, npix 203, brick X: 0,15, Y: 0,20, one pixel: 3 0
Blob 5 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141692 MB
Blob 10 of 11, id: 7, sources: 1, size: 18x17, npix 162, brick X: 28,46, Y: 143,160, one pixel: 36 143
Blob 7 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB
Blob 11 of 11, id: 9, sources: 1, size: 14x18, npix 150, brick X: 231,245, Y: 199,217, one pixel: 239 199
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (243.59324, 52.10683), pm (-7.3, 2.6), parallax 0.383 with NanoMaggies: g=16.1, r=15.5, z=15.2
Reset brightness to NanoMaggies: g=16.1, r=15.5, z=15.2
Blob 3 finished, total: Wall: 1.16 s, CPU: 1.15 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141472 MB
Blob 10 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141584 MB
Blob 8 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141692 MB
Blob 11 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141584 MB
Blob 9 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141524 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.440758, ee1=0.119533, ee2=-0.0759851
Measuring 2 iterative sources
Blob 1 finished, total: Wall: 12.97 s, CPU: 12.96 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 147 MB, VmData: 179 MB, maxrss: 0.150496 MB
Old catalog: 31
New catalog: 26
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/blobs-custom-243607p52124.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/metrics/cus/all-models-custom-243607p52124.fits
Stage fitblobs : Wall: 13.34 s, CPU: 0.35 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 194 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage fitblobs finished: 2020-06-07T16:48:24.408573
Resources for stage fitblobs : 17.151 s worker CPU, 17.201 s worker Wall, Wall: 13.341 s, Cores in use: 1.31, Total efficiency (on 4 cores): 32.8 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T16:48:24.410580
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/tmp-legacysurvey-custom-243607p52124-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/tmp-legacysurvey-custom-243607p52124-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/tmp-legacysurvey-custom-243607p52124-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/tmp-legacysurvey-custom-243607p52124-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-resid.jpg
Stage coadds : Wall: 1.39 s, CPU: 0.71 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 194 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage coadds finished: 2020-06-07T16:48:25.801277
Resources for stage coadds : 1.862 s worker CPU, 1.956 s worker Wall, Wall: 1.392 s, Cores in use: 1.85, Total efficiency (on 4 cores): 46.2 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T16:48:25.802802
Cut to 1 unWISE tiles
Reading WISE tile 2431p514 band 1
Reading WISE tile 2431p514 band 2
Reading WISE tile 2431p514 band 4
Reading WISE tile 2431p514 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20864 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.18778 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 149 MB, VmData: 173 MB, maxrss: 0.21328 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208356 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/tmp-legacysurvey-custom-243607p52124-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/tmp-legacysurvey-custom-243607p52124-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.30 s, CPU: 0.42 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 195 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage wise_forced finished: 2020-06-07T16:48:28.100513
Resources for stage wise_forced : 4.816 s worker CPU, 5.983 s worker Wall, Wall: 2.299 s, Cores in use: 2.28, Total efficiency (on 4 cores): 56.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T16:48:28.102183
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/coadd/cus/custom-243607p52124/legacysurvey-custom-243607p52124-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/tractor-i/cus/tractor-custom-243607p52124.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/tractor/cus/tractor-custom-243607p52124.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC3133129/tractor/cus/brick-custom-243607p52124.sha256sum
Stage writecat : Wall: 1.51 s, CPU: 0.68 s, VmPeak: 1090 MB, VmSize: 962 MB, VmRSS: 197 MB, VmData: 223 MB, maxrss: 0.566564 MB
Stage writecat finished: 2020-06-07T16:48:29.611889
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.511 s, Cores in use: 0.45, Total efficiency (on 4 cores): 11.2 %
Stage writecat finished
All done: 28.171 s worker CPU, 42.034 s worker Wall, Wall: 29.654 s, Cores in use: 1.19, Total efficiency (on 4 cores): 29.9 %
Finished galaxy PGC3133129 in 0.523 minutes.