Started working on galaxy PGC2404447 at Sun Jun  7 19:55:15 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.80836799999997 51.9985465 --width 237 --height 237 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T19:55:16.560745
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.80836799999997', '51.9985465', '--width', '237', '--height', '237', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.80836799999997 51.9985465 --width 237 --height 237 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 243.80836799999997 51.9985465
Starting process 27323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 27324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 27325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Starting process 27326 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T19:55:16.895905
Keeping 9 CCDs:
   k4m_170516_092720_ooi_zd_ls9.fits.fz k4m_170516_092720_ooi_zd_ls9-CCD2 z exptime 132.104 propid 2016A-0453 seeing 1.36 MJD 57889.394 object MzLS_656630_z
   k4m_160531_072337_ooi_zd_ls9.fits.fz k4m_160531_072337_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 0.82 MJD 57539.308 object MzLS_657408_z
   k4m_160604_063529_ooi_zd_ls9.fits.fz k4m_160604_063529_ooi_zd_ls9-CCD3 z exptime 80.103 propid 2016A-0453 seeing 0.86 MJD 57543.275 object MzLS_658181_z
   ksb_160513_091654_ooi_r_ls9.fits.fz ksb_160513_091654_ooi_r_ls9-CCD2 r exptime 68.1 propid BASS seeing 1.21 MJD 57521.387 object 29281
   ksb_170602_091233_ooi_g_ls9.fits.fz ksb_170602_091233_ooi_g_ls9-CCD2 g exptime 106.445 propid 2015A-0801 seeing 1.61 MJD 57906.384 object 29281
   ksb_170404_105311_ooi_g_ls9.fits.fz ksb_170404_105311_ooi_g_ls9-CCD1 g exptime 140.107 propid BASS seeing 2.11 MJD 57847.454 object 29283
   ksb_170423_104056_ooi_r_ls9.fits.fz ksb_170423_104056_ooi_r_ls9-CCD1 r exptime 87.458 propid BASS seeing 1.48 MJD 57866.445 object 29283
   ksb_160708_050358_ooi_g_ls9.fits.fz ksb_160708_050358_ooi_g_ls9-CCD4 g exptime 156.9 propid BASS seeing 2.06 MJD 57577.211 object 29282
   ksb_160710_054612_ooi_r_ls9.fits.fz ksb_160710_054612_ooi_r_ls9-CCD4 r exptime 160.2 propid BASS seeing 2.20 MJD 57579.240 object 29282
mosaic get_fwhm: self.fwhm = 3.31
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2452 2691 and amp range 2006 4053 and image y 369 608 and amp range 0 2039
Range in image: x 0 240 , y 0 240 (with image size 240 x 240)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
mosaic get_fwhm: self.fwhm = 5.23
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3572 3816 and amp range 2048 4095 and image y 3205 3446 and amp range 2040 4078
Range in image: x 0 245 , y 0 242 (with image size 245 x 242)
dzp -0.032976374 -> scaling image by 0.9700842429001929
mosaic get_fwhm: self.fwhm = 3.15
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 857 1096 and amp range 0 2047 and image y 2002 2241 and amp range 0 2039
Range in image: x 0 240 , y 0 38 (with image size 240 x 240)
dzp -0.006320339 -> scaling image by 0.9941956631368829
Found overlap: image x 857 1096 and amp range 0 2047 and image y 2002 2241 and amp range 2040 4078
Range in image: x 0 240 , y 38 240 (with image size 240 x 240)
dzp 0.008550294 -> scaling image by 1.0079062018164673
Faked up EXPNUM 78660212
Faked up EXPNUM 78660212
Faked up EXPNUM 78660212
90prime get_fwhm: self.fwhm = 3.27
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2028 2167 and amp range 2016 4031 and image y 1625 1764 and amp range 0 2047
Range in image: x 0 140 , y 0 140 (with image size 140 x 140)
dzp -0.006547878 -> scaling image by 0.9939873303458991
Faked up EXPNUM 75210174
Faked up EXPNUM 75210174
Faked up EXPNUM 75210174
Faked up EXPNUM 79060133
Faked up EXPNUM 79060133
Faked up EXPNUM 79060133
Faked up EXPNUM 78470088
Faked up EXPNUM 78470088
Faked up EXPNUM 78470088
90prime get_fwhm: self.fwhm = 4.65
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2025 2165 and amp range 2016 4031 and image y 1638 1777 and amp range 0 2047
Range in image: x 0 141 , y 0 140 (with image size 141 x 140)
dzp -0.011406615 -> scaling image by 0.9895491130016149
Faked up EXPNUM 75770053
Faked up EXPNUM 75770053
Faked up EXPNUM 75770053
90prime get_fwhm: self.fwhm = 4.55
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1875 2013 and amp range 0 2015 and image y 1141 1279 and amp range 0 2047
Range in image: x 0 139 , y 0 139 (with image size 139 x 139)
dzp 0.009539392 -> scaling image by 1.0088248156909383
Faked up EXPNUM 75790062
Faked up EXPNUM 75790062
Faked up EXPNUM 75790062
90prime get_fwhm: self.fwhm = 4.85
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1873 2012 and amp range 0 2015 and image y 1130 1267 and amp range 0 2047
Range in image: x 0 140 , y 0 138 (with image size 140 x 138)
dzp 0.009781551 -> scaling image by 1.0090498455107675
Stage tims : Wall: 4.77 s, CPU: 0.80 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 169 MB, VmData: 203 MB, maxrss: 0.566544 MB
Stage tims finished: 2020-06-07T19:55:21.667379
Resources for stage tims : 2.989 s worker CPU, 11.814 s worker Wall, Wall: 4.773 s, Cores in use: 0.80, Total efficiency (on 4 cores): 19.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T19:55:21.682900
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01370.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01267.fits
Matched 16 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/reference-custom-243808p51998.fits
Stage refs : Wall: 5.75 s, CPU: 1.82 s, VmPeak: 971 MB, VmSize: 960 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.566544 MB
Stage refs finished: 2020-06-07T19:55:27.434457
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.752 s, Cores in use: 0.32, Total efficiency (on 4 cores): 7.9 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T19:55:27.435858
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/outlier-mask-custom-243808p51998.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/outliers-pre-custom-243808p51998.jpg
Image k4m_160531_072337_ooi_zd_ls9-CCD2 z : masking 482 positive outlier pixels and 0 negative outlier pixels
Image k4m_160604_063529_ooi_zd_ls9-CCD3 z : masking 2351 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/outlier-mask-custom-243808p51998.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/outliers-post-custom-243808p51998.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/outliers-masked-pos-custom-243808p51998.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/outliers-masked-neg-custom-243808p51998.jpg
Stage outliers : Wall: 5.63 s, CPU: 0.81 s, VmPeak: 971 MB, VmSize: 958 MB, VmRSS: 189 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage outliers finished: 2020-06-07T19:55:33.063736
Resources for stage outliers : 0.521 s worker CPU, 0.524 s worker Wall, Wall: 5.629 s, Cores in use: 0.24, Total efficiency (on 4 cores): 5.9 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T19:55:33.065544
Stage halos : Wall: 0.24 s, CPU: 0.24 s, VmPeak: 971 MB, VmSize: 958 MB, VmRSS: 189 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage halos finished: 2020-06-07T19:55:33.309385
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.245 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T19:55:33.310968
PSF sigmas in coadd pixels: ['3.42', '3.35']
Using average PSF sigma 3.3854587198170103
Gaussian PSF norm 0.08332542651387752 vs pixelized 0.06882881
average tim pixel scale / coadd scale: 1.7295284387797742
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.41', '3.57']
Using average PSF sigma 2.987494682515084
Gaussian PSF norm 0.09442520297187303 vs pixelized 0.08480487
average tim pixel scale / coadd scale: 1.7291499334671854
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.21', '1.33', '1.40']
Using average PSF sigma 1.6430467170980017
Gaussian PSF norm 0.1716900614196305 vs pixelized 0.13835473
average tim pixel scale / coadd scale: 0.9908745881127378
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.12 s, VmPeak: 971 MB, VmSize: 958 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage fit_on_coadds finished: 2020-06-07T19:55:33.457563
Resources for stage fit_on_coadds : 0.132 s worker CPU, 0.145 s worker Wall, Wall: 0.148 s, Cores in use: 1.73, Total efficiency (on 4 cores): 43.3 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T19:55:33.459987
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 17 potential peaks
Of 17 potential peaks: 2 in veto map, 1 cut by saddle test, 0 cut by aper test, 14 kept
SED z : 14 new peaks
Found 15 potential peaks
Of 15 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 8 potential peaks
Of 8 potential peaks: 8 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 25 potential peaks
Of 25 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 25 potential peaks
Of 25 potential peaks: 21 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 19 new sources
Median coadd sky for g : 2.6298114e-05
Median coadd sky for r : 2.33167e-05
Median coadd sky for z : -0.0001583482
Stage srcs : Wall: 0.41 s, CPU: 0.37 s, VmPeak: 971 MB, VmSize: 958 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage srcs finished: 2020-06-07T19:55:33.871078
Resources for stage srcs : 0.100 s worker CPU, 0.108 s worker Wall, Wall: 0.412 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/PGC2404447-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T19:55:33.881405
Blob 1 of 14, id: 4, sources: 3, size: 149x115, npix 9420, brick X: 44,193, Y: 68,183, one pixel: 91 68
Blob 2 of 14, id: 6, sources: 4, size: 56x51, npix 1560, brick X: 0,56, Y: 146,197, one pixel: 7 146
Blob 3 of 14, id: 11, sources: 2, size: 50x39, npix 1444, brick X: 26,76, Y: 198,237, one pixel: 48 198
Blob 4 of 14, id: 0, sources: 2, size: 37x52, npix 1198, brick X: 117,154, Y: 9,61, one pixel: 133 9
Blob 5 of 14, id: 10, sources: 1, size: 34x41, npix 963, brick X: 130,164, Y: 194,235, one pixel: 149 194
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (243.81610, 52.03030), pm (-14.0, 47.2), parallax 9.070 with NanoMaggies: g=9.4, r=9.05, z=8.95
Reset brightness to NanoMaggies: g=9.4, r=9.05, z=8.95
Blob 3 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141304 MB
Blob 6 of 14, id: 12, sources: 1, size: 32x33, npix 785, brick X: 87,119, Y: 204,237, one pixel: 100 204
Blob 4 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141484 MB
Blob 7 of 14, id: 3, sources: 1, size: 29x28, npix 535, brick X: 195,224, Y: 55,83, one pixel: 206 55
Blob 5 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142096 MB
Blob 8 of 14, id: 1, sources: 2, size: 35x22, npix 494, brick X: 166,201, Y: 27,49, one pixel: 190 27
Blob 6 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141484 MB
Blob 9 of 14, id: 5, sources: 1, size: 22x22, npix 304, brick X: 18,40, Y: 75,97, one pixel: 27 75
Blob 10 of 14, id: 8, sources: 1, size: 23x22, npix 294, brick X: 168,191, Y: 168,190, one pixel: 178 168
Blob 2 finished, total: Wall: 2.43 s, CPU: 2.43 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139116 MB
Blob 11 of 14, id: 2, sources: 1, size: 21x21, npix 250, brick X: 7,28, Y: 40,61, one pixel: 16 40
Blob 7 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142096 MB
Blob 12 of 14, id: 9, sources: 1, size: 19x19, npix 208, brick X: 215,234, Y: 170,189, one pixel: 224 170
Blob 9 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139116 MB
Blob 13 of 14, id: 13, sources: 1, size: 19x19, npix 199, brick X: 186,205, Y: 208,227, one pixel: 194 208
Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139116 MB
Blob 14 of 14, id: 7, sources: 1, size: 18x18, npix 171, brick X: 200,218, Y: 154,172, one pixel: 208 154
Blob 10 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1423 MB
Blob 8 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141484 MB
Blob 12 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 797 MB, VmSize: 713 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139116 MB
Blob 14 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141484 MB
Blob 13 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.1423 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.49137, ee1=-0.0972185, ee2=-0.296847
Measuring 3 iterative sources
Blob 1 finished, total: Wall: 4.93 s, CPU: 4.93 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.14396 MB
Old catalog: 23
New catalog: 23
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/blobs-custom-243808p51998.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/metrics/cus/all-models-custom-243808p51998.fits
Stage fitblobs : Wall: 5.21 s, CPU: 0.30 s, VmPeak: 971 MB, VmSize: 958 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage fitblobs finished: 2020-06-07T19:55:39.094842
Resources for stage fitblobs : 14.543 s worker CPU, 14.572 s worker Wall, Wall: 5.215 s, Cores in use: 2.85, Total efficiency (on 4 cores): 71.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T19:55:39.096694
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/tmp-legacysurvey-custom-243808p51998-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/tmp-legacysurvey-custom-243808p51998-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/tmp-legacysurvey-custom-243808p51998-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/tmp-legacysurvey-custom-243808p51998-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-resid.jpg
Stage coadds : Wall: 1.18 s, CPU: 0.40 s, VmPeak: 971 MB, VmSize: 958 MB, VmRSS: 192 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage coadds finished: 2020-06-07T19:55:40.279358
Resources for stage coadds : 1.898 s worker CPU, 1.941 s worker Wall, Wall: 1.184 s, Cores in use: 1.94, Total efficiency (on 4 cores): 48.6 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T19:55:40.280969
Cut to 1 unWISE tiles
Reading WISE tile 2431p514 band 2
Reading WISE tile 2431p514 band 1
Reading WISE tile 2431p514 band 3
Reading WISE tile 2431p514 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 797 MB, VmSize: 795 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.187308 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208472 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204348 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2431p514/unwise-2431p514-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.2087 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/tmp-legacysurvey-custom-243808p51998-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/tmp-legacysurvey-custom-243808p51998-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.08 s, CPU: 0.31 s, VmPeak: 971 MB, VmSize: 958 MB, VmRSS: 193 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage wise_forced finished: 2020-06-07T19:55:42.361403
Resources for stage wise_forced : 5.243 s worker CPU, 5.928 s worker Wall, Wall: 2.082 s, Cores in use: 2.67, Total efficiency (on 4 cores): 66.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T19:55:42.363256
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/coadd/cus/custom-243808p51998/legacysurvey-custom-243808p51998-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/tractor-i/cus/tractor-custom-243808p51998.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/tractor/cus/tractor-custom-243808p51998.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/PGC2404447/tractor/cus/brick-custom-243808p51998.sha256sum
Stage writecat : Wall: 0.59 s, CPU: 0.42 s, VmPeak: 1091 MB, VmSize: 963 MB, VmRSS: 195 MB, VmData: 220 MB, maxrss: 0.566544 MB
Stage writecat finished: 2020-06-07T19:55:42.950955
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.589 s, Cores in use: 0.72, Total efficiency (on 4 cores): 18.1 %
Stage writecat finished
All done: 25.427 s worker CPU, 35.034 s worker Wall, Wall: 26.060 s, Cores in use: 1.19, Total efficiency (on 4 cores): 29.8 %
Finished galaxy PGC2404447 in 0.465 minutes.