Started working on galaxy PGC2048740 at Thu Jun 4 13:52:17 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.540041 34.409555600000004 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T13:52:19.170308 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.540041', '34.409555600000004', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.540041 34.409555600000004 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 106.540041 34.409555600000004 Starting process 35438 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 35439 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 35440 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 35441 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 35442 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 35443 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 35444 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 35445 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T13:52:21.664538 Keeping 12 CCDs: k4m_160204_045521_ooi_zd_ls9.fits.fz k4m_160204_045521_ooi_zd_ls9-CCD2 z exptime 80.105 propid 2016A-0453 seeing 1.07 MJD 57422.205 object MzLS_575049_z k4m_170829_112503_ooi_zd_ls9.fits.fz k4m_170829_112503_ooi_zd_ls9-CCD3 z exptime 215.105 propid 2016A-0453 seeing 1.57 MJD 57994.476 object MzLS_577116_z k4m_180205_033414_ooi_zd_ls9.fits.fz k4m_180205_033414_ooi_zd_ls9-CCD3 z exptime 80.105 propid 2016A-0453 seeing 0.90 MJD 58154.149 object MzLS_577116_z k4m_161017_113137_ooi_zd_ls9.fits.fz k4m_161017_113137_ooi_zd_ls9-CCD2 z exptime 115.103 propid 2016A-0404 seeing 0.80 MJD 57678.480 object MzLS_574012_z k4m_180206_035059_ooi_zd_ls9.fits.fz k4m_180206_035059_ooi_zd_ls9-CCD2 z exptime 80.104 propid 2016A-0453 seeing 0.78 MJD 58155.160 object MzLS_574012_z k4m_160205_043249_ooi_zd_ls9.fits.fz k4m_160205_043249_ooi_zd_ls9-CCD1 z exptime 80.105 propid 2016A-0453 seeing 1.09 MJD 57423.189 object MzLS_576084_z ksb_160130_041824_ooi_r_ls9.fits.fz ksb_160130_041824_ooi_r_ls9-CCD1 r exptime 136.5 propid 2015A-0801 seeing 1.50 MJD 57417.179 object 60702 ksb_180116_071011_ooi_g_ls9.fits.fz ksb_180116_071011_ooi_g_ls9-CCD1 g exptime 250.0 propid BASS seeing 1.57 MJD 58134.299 object 60702 ksb_160207_041247_ooi_r_ls9.fits.fz ksb_160207_041247_ooi_r_ls9-CCD4 r exptime 330.9 propid 2015A-0801 seeing 1.99 MJD 57425.176 object 60873 ksb_180316_030005_ooi_g_ls9.fits.fz ksb_180316_030005_ooi_g_ls9-CCD4 g exptime 121.32 propid BASS seeing 1.80 MJD 58193.125 object 60873 ksb_160212_035429_ooi_r_ls9.fits.fz ksb_160212_035429_ooi_r_ls9-CCD1 r exptime 100.5 propid 2015A-0801 seeing 1.63 MJD 57430.163 object 60701 ksb_160112_074408_ooi_g_ls9.fits.fz ksb_160112_074408_ooi_g_ls9-CCD1 g exptime 180.7 propid 2015A-0801 seeing 1.53 MJD 57399.322 object 60701 mosaic get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3629 3868 and amp range 2048 4095 and image y 4046 4072 and amp range 2040 4078 Range in image: x 0 240 , y 0 27 (with image size 240 x 27) dzp -0.036442947 -> scaling image by 0.9669918668439786 mosaic get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3642 3881 and amp range 2048 4095 and image y 4048 4072 and amp range 2040 4078 Range in image: x 0 240 , y 0 25 (with image size 240 x 25) dzp -0.032976374 -> scaling image by 0.9700842429001929 mosaic get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 14 and amp range 0 2005 and image y 326 562 and amp range 0 2039 Range in image: x 0 15 , y 0 237 (with image size 15 x 237) dzp 0.0014252509 -> scaling image by 1.0013135665633692 mosaic get_fwhm: self.fwhm = 4.19 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2485 2721 and amp range 2006 4053 and image y 853 1093 and amp range 0 2039 Range in image: x 0 237 , y 0 241 (with image size 237 x 241) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 4.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 902 1136 and amp range 0 2047 and image y 3687 3920 and amp range 2040 4078 Range in image: x 0 235 , y 0 234 (with image size 235 x 234) dzp 0.008550294 -> scaling image by 1.0079062018164673 Faked up EXPNUM 74250050 Faked up EXPNUM 74250050 Faked up EXPNUM 74250050 90prime get_fwhm: self.fwhm = 4.39 WARNING: image median 0.029665466 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 2648 2784 and amp range 2016 4031 and image y 231 367 and amp range 0 2047 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Faked up EXPNUM 81930054 Faked up EXPNUM 81930054 Faked up EXPNUM 81930054 90prime get_fwhm: self.fwhm = 3.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2580 2716 and amp range 2016 4031 and image y 141 276 and amp range 0 2047 Range in image: x 0 137 , y 0 136 (with image size 137 x 136) dzp 0.023266561 -> scaling image by 1.0216605511853067 Faked up EXPNUM 74300065 Faked up EXPNUM 74300065 Faked up EXPNUM 74300065 90prime get_fwhm: self.fwhm = 3.59 WARNING: image median 0.047824588 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 735 873 and amp range 0 2015 and image y 1221 1358 and amp range 0 2047 Range in image: x 0 139 , y 0 138 (with image size 139 x 138) dzp -0.01149955 -> scaling image by 0.9894644150522871 Faked up EXPNUM 73990088 Faked up EXPNUM 73990088 Faked up EXPNUM 73990088 90prime get_fwhm: self.fwhm = 3.37 WARNING: image median 0.015323379 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 750 888 and amp range 0 2015 and image y 1211 1347 and amp range 0 2047 Range in image: x 0 139 , y 0 137 (with image size 139 x 137) dzp -0.011813398 -> scaling image by 0.989178436928226 Faked up EXPNUM 74170066 Faked up EXPNUM 74170066 Faked up EXPNUM 74170066 90prime get_fwhm: self.fwhm = 3.31 WARNING: image median 0.05563295 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 2779 2915 and amp range 2016 4031 and image y 3249 3384 and amp range 2048 4095 Range in image: x 0 137 , y 0 136 (with image size 137 x 136) dzp 0.01301769 -> scaling image by 1.0120619004021345 Faked up EXPNUM 81340082 Faked up EXPNUM 81340082 Faked up EXPNUM 81340082 90prime get_fwhm: self.fwhm = 3.47 WARNING: image median 0.024481215 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 2756 2892 and amp range 2016 4031 and image y 3209 3345 and amp range 2048 4095 Range in image: x 0 137 , y 0 137 (with image size 137 x 137) dzp 0.016257986 -> scaling image by 1.01508683329102 Stage tims : Wall: 7.68 s, CPU: 4.07 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.456828 MB Stage tims finished: 2020-06-04T13:52:29.345771 Resources for stage tims : 5.511 s worker CPU, 17.689 s worker Wall, Wall: 7.683 s, Cores in use: 1.25, Total efficiency (on 8 cores): 15.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-04T13:52:32.525548 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02533.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02662.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/reference-custom-106540p34409.fits Stage refs : Wall: 9.25 s, CPU: 7.65 s, VmPeak: 1000 MB, VmSize: 994 MB, VmRSS: 225 MB, VmData: 256 MB, maxrss: 0.456828 MB Stage refs finished: 2020-06-04T13:52:41.771077 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.247 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.3 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T13:52:41.772994 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/outlier-mask-custom-106540p34409.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/outliers-pre-custom-106540p34409.jpg Image ksb_180116_071011_ooi_g_ls9-CCD1 g : masking 8557 positive outlier pixels and 0 negative outlier pixels Image ksb_160112_074408_ooi_g_ls9-CCD1 g : masking 1220 positive outlier pixels and 0 negative outlier pixels Image ksb_160212_035429_ooi_r_ls9-CCD1 r : masking 4529 positive outlier pixels and 0 negative outlier pixels Image ksb_160130_041824_ooi_r_ls9-CCD1 r : masking 3203 positive outlier pixels and 0 negative outlier pixels Image k4m_180205_033414_ooi_zd_ls9-CCD3 z : masking 0 positive outlier pixels and 3079 negative outlier pixels Image k4m_160204_045521_ooi_zd_ls9-CCD2 z : masking 1249 positive outlier pixels and 389 negative outlier pixels Image k4m_160205_043249_ooi_zd_ls9-CCD1 z : masking 1003 positive outlier pixels and 138 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/outlier-mask-custom-106540p34409.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/outliers-post-custom-106540p34409.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/outliers-masked-pos-custom-106540p34409.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/outliers-masked-neg-custom-106540p34409.jpg Stage outliers : Wall: 6.96 s, CPU: 6.74 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 237 MB, VmData: 266 MB, maxrss: 0.456828 MB Stage outliers finished: 2020-06-04T13:52:48.736891 Resources for stage outliers : 0.803 s worker CPU, 0.805 s worker Wall, Wall: 6.965 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T13:52:48.739034 Stage halos : Wall: 4.77 s, CPU: 4.76 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 237 MB, VmData: 266 MB, maxrss: 0.456828 MB Stage halos finished: 2020-06-04T13:52:53.505289 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.767 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-04T13:52:53.507350 PSF sigmas in coadd pixels: ['2.55', '2.92', '2.48'] Using average PSF sigma 2.653114009802995 Gaussian PSF norm 0.1063259214385683 vs pixelized 0.094459035 average tim pixel scale / coadd scale: 1.7302384944845928 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.44', '3.23', '2.64'] Using average PSF sigma 2.7693379067759043 Gaussian PSF norm 0.10186362273944974 vs pixelized 0.093798146 average tim pixel scale / coadd scale: 1.7292213489351267 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.73', '1.46', '1.29', '1.27', '1.77'] Using average PSF sigma 1.5052665450205631 Gaussian PSF norm 0.1874052092016863 vs pixelized 0.15663859 average tim pixel scale / coadd scale: 0.990864064078778 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.13 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 238 MB, VmData: 266 MB, maxrss: 0.456828 MB Stage fit_on_coadds finished: 2020-06-04T13:52:53.729296 Resources for stage fit_on_coadds : 0.278 s worker CPU, 0.278 s worker Wall, Wall: 0.223 s, Cores in use: 1.85, Total efficiency (on 8 cores): 23.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T13:52:53.732460 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 44 potential peaks Of 44 potential peaks: 20 in veto map, 7 cut by saddle test, 0 cut by aper test, 17 kept SED z : 17 new peaks Found 93 potential peaks Of 93 potential peaks: 80 in veto map, 12 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 103 potential peaks Of 103 potential peaks: 95 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 226 potential peaks Of 226 potential peaks: 214 in veto map, 12 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 292 potential peaks Of 292 potential peaks: 280 in veto map, 11 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 20 new sources Median coadd sky for g : 0.0013794812 Median coadd sky for r : 0.0028904248 Median coadd sky for z : -0.00015497234 Stage srcs : Wall: 4.75 s, CPU: 4.72 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 239 MB, VmData: 266 MB, maxrss: 0.456828 MB Stage srcs finished: 2020-06-04T13:52:58.483000 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 4.752 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/PGC2048740-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T13:53:00.791168 Blob 1 of 1, id: 0, sources: 36, size: 233x233, npix 53552, brick X: 0,233, Y: 0,233, one pixel: 0 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.54802, 34.47376), pm (-53.8, -48.9), parallax 10.036 with NanoMaggies: g=5.81, r=5.13, z=4.85 Reset brightness to NanoMaggies: g=5.81, r=5.13, z=4.85 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.54927, 34.43371), pm (-1.2, -5.7), parallax 0.580 with NanoMaggies: g=12.9, r=12, z=11.6 Reset brightness to NanoMaggies: g=12.9, r=12, z=11.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.54586, 34.42495), pm (1.9, -4.7), parallax 1.302 with NanoMaggies: g=14.4, r=14, z=13.8 Reset brightness to NanoMaggies: g=14.4, r=14, z=13.8 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.934192, ee1=0.0691571, ee2=0.0927193 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.54955, 34.42136), pm (9.0, 4.4), parallax 0.607 with NanoMaggies: g=19.6, r=18.2, z=17.1 Reset brightness to NanoMaggies: g=19.6, r=18.2, z=17.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.54662, 34.41813), pm (0.5, -1.6), parallax -0.258 with NanoMaggies: g=19.4, r=19.1, z=18.6 Reset brightness to NanoMaggies: g=18.9, r=18.5, z=18.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.54226, 34.41819), pm (4.9, -5.0), parallax 0.797 with NanoMaggies: g=25.8, r=19.5, z=17 Reset brightness to NanoMaggies: g=20.4, r=19, z=17.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.53967, 34.42105), pm (-0.7, -0.6), parallax 0.522 with NanoMaggies: g=20.5, r=19.1, z=18.3 Reset brightness to NanoMaggies: g=20.5, r=19.1, z=18.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.54810, 34.41808), pm (1.6, -4.1), parallax 2.145 with NanoMaggies: g=21.3, r=20, z=19.5 Reset brightness to NanoMaggies: g=20.9, r=20.2, z=19.9 Blob 1 finished, total: Wall: 17.90 s, CPU: 17.89 s, VmPeak: 799 MB, VmSize: 728 MB, VmRSS: 161 MB, VmData: 194 MB, maxrss: 0.165064 MB Old catalog: 37 New catalog: 34 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/blobs-custom-106540p34409.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/metrics/cus/all-models-custom-106540p34409.fits Stage fitblobs : Wall: 22.57 s, CPU: 4.63 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 240 MB, VmData: 267 MB, maxrss: 0.456828 MB Stage fitblobs finished: 2020-06-04T13:53:23.365383 Resources for stage fitblobs : 17.917 s worker CPU, 17.933 s worker Wall, Wall: 22.576 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T13:53:23.367346 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/tmp-legacysurvey-custom-106540p34409-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/tmp-legacysurvey-custom-106540p34409-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/tmp-legacysurvey-custom-106540p34409-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/tmp-legacysurvey-custom-106540p34409-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-resid.jpg Stage coadds : Wall: 8.28 s, CPU: 6.20 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.456828 MB Stage coadds finished: 2020-06-04T13:53:31.643228 Resources for stage coadds : 3.310 s worker CPU, 3.495 s worker Wall, Wall: 8.277 s, Cores in use: 1.15, Total efficiency (on 8 cores): 14.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T13:53:31.645391 Cut to 1 unWISE tiles Reading WISE tile 1059p348 band 4 Reading WISE tile 1059p348 band 1 Reading WISE tile 1059p348 band 2 Reading WISE tile 1059p348 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 810 MB, VmSize: 789 MB, VmRSS: 142 MB, VmData: 175 MB, maxrss: 0.183764 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 795 MB, VmSize: 787 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.201544 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 787 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.201384 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/105/1059p348/unwise-1059p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 787 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.201612 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/tmp-legacysurvey-custom-106540p34409-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/tmp-legacysurvey-custom-106540p34409-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.16 s, CPU: 4.80 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 241 MB, VmData: 267 MB, maxrss: 0.456828 MB Stage wise_forced finished: 2020-06-04T13:53:39.810506 Resources for stage wise_forced : 3.251 s worker CPU, 6.476 s worker Wall, Wall: 8.166 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T13:53:39.812688 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/coadd/cus/custom-106540p34409/legacysurvey-custom-106540p34409-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/tractor-i/cus/tractor-custom-106540p34409.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/tractor/cus/tractor-custom-106540p34409.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2048740/tractor/cus/brick-custom-106540p34409.sha256sum Stage writecat : Wall: 3.95 s, CPU: 3.77 s, VmPeak: 1136 MB, VmSize: 1008 MB, VmRSS: 243 MB, VmData: 267 MB, maxrss: 0.456828 MB Stage writecat finished: 2020-06-04T13:53:43.760622 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.949 s, Cores in use: 0.96, Total efficiency (on 8 cores): 11.9 % Stage writecat finished All done: 31.152 s worker CPU, 46.758 s worker Wall, Wall: 82.102 s, Cores in use: 0.96, Total efficiency (on 8 cores): 12.0 % Finished galaxy PGC2048740 in 1.436 minutes.