Started working on galaxy IC0458 at Wed Aug 5 23:14:13 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.64263700000001 50.118708899999994 --width 621 --height 621 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T23:14:14.475027 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '107.64263700000001', '50.118708899999994', '--width', '621', '--height', '621', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 107.64263700000001 50.118708899999994 --width 621 --height 621 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 107.64263700000001 50.118708899999994 Starting process 36512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 36513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 36514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 36515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 36516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB Starting process 36517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 36518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 36519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 36520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 36521 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 36522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 36523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36525 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36526 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 36527 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 36528 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 36529 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 36530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 36531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 36532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 36533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 36534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 36535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 36536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 36537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 36538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 36539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 36540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 36541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 36542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 36543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T23:14:14.881600 Keeping 14 CCDs: k4m_170315_065651_ooi_zd_ls9-CCD1 z expnum 114228 exptime 130.104 propid 2016A-0453 seeing 0.90 MJD 57827.289 object MzLS_650943_z mosaic/CP/V4.3/CP20170314/k4m_170315_065651_ooi_zd_ls9.fits.fz k4m_170222_053841_ooi_zd_ls9-CCD1 z expnum 109554 exptime 80.104 propid 2016A-0453 seeing 1.04 MJD 57806.235 object MzLS_650943_z mosaic/CP/V4.3/CP20170221/k4m_170222_053841_ooi_zd_ls9.fits.fz k4m_170901_104853_ooi_zd_ls9-CCD2 z expnum 137688 exptime 250.103 propid 2016A-0453 seeing 1.06 MJD 57997.451 object MzLS_649330_z mosaic/CP/V4.3/CP20170831/k4m_170901_104853_ooi_zd_ls9.fits.fz k4m_180105_035347_ooi_zd_ls9-CCD3 z expnum 154178 exptime 102.108 propid 2016A-0453 seeing 0.99 MJD 58123.162 object MzLS_650138_z mosaic/CP/V4.3/CP20180104/k4m_180105_035347_ooi_zd_ls9.fits.fz k4m_160301_033936_ooi_zd_ls9-CCD3 z expnum 72106 exptime 92.103 propid 2016A-0453 seeing 1.01 MJD 57448.152 object MzLS_650138_z mosaic/CP/V4.3/CP20160229/k4m_160301_033936_ooi_zd_ls9.fits.fz ksb_160304_024735_ooi_g_ls9-CCD4 g expnum 74510042 exptime 221.2 propid 2015A-0801 seeing 1.31 MJD 57451.116 object 26132 90prime/CP/V2.3/CP20160303/ksb_160304_024735_ooi_g_ls9.fits.fz ksb_170227_031917_ooi_r_ls9-CCD3 r expnum 78110038 exptime 174.2 propid BASS seeing 1.96 MJD 57811.138 object 26143 90prime/CP/V2.3/CP20170226/ksb_170227_031917_ooi_r_ls9.fits.fz ksb_170225_035030_ooi_g_ls9-CCD3 g expnum 78090046 exptime 178.7 propid BASS seeing 1.74 MJD 57809.160 object 26143 90prime/CP/V2.3/CP20170224/ksb_170225_035030_ooi_g_ls9.fits.fz ksb_180416_032142_ooi_g_ls9-CCD1 g expnum 82240029 exptime 250.0 propid BASS seeing 1.48 MJD 58224.140 object 26131 90prime/CP/V2.3/CP20180415/ksb_180416_032142_ooi_g_ls9.fits.fz ksb_180320_052244_ooi_r_ls9-CCD1 r expnum 81970076 exptime 201.033 propid BASS seeing 1.55 MJD 58197.224 object 26131 90prime/CP/V2.3/CP20180319/ksb_180320_052244_ooi_r_ls9.fits.fz ksb_171126_130543_ooi_r_ls9-CCD1 r expnum 80830217 exptime 188.37 propid BASS seeing 1.24 MJD 58083.546 object 26131 90prime/CP/V2.3/CP20171125/ksb_171126_130543_ooi_r_ls9.fits.fz ksb_170224_030500_ooi_g_ls9-CCD1 g expnum 78080034 exptime 250.0 propid BASS seeing 2.08 MJD 57808.128 object 26133 90prime/CP/V2.3/CP20170223/ksb_170224_030500_ooi_g_ls9.fits.fz ksb_170226_035441_ooi_r_ls9-CCD1 r expnum 78100088 exptime 250.0 propid BASS seeing 1.37 MJD 57810.163 object 26133 90prime/CP/V2.3/CP20170225/ksb_170226_035441_ooi_r_ls9.fits.fz ksb_161107_101011_ooi_r_ls9-CCD4 r expnum 76990140 exptime 173.8 propid BASS seeing 1.59 MJD 57699.424 object 26132 90prime/CP/V2.3/CP20161106/ksb_161107_101011_ooi_r_ls9.fits.fz Faked up EXPNUM 80830217 Faked up EXPNUM 80830217 Faked up EXPNUM 80830217 90prime get_fwhm: self.fwhm = 2.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2966 3328 and amp range 2016 4031 and image y 2303 2664 and amp range 2048 4095 Range in image: x 0 363 , y 0 362 (with image size 363 x 362) dzp 0.015744466 -> scaling image by 1.0146068417155982 Faked up EXPNUM 74510042 Faked up EXPNUM 74510042 Faked up EXPNUM 74510042 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 792 1151 and amp range 0 2015 and image y 15 175 and amp range 0 2047 Range in image: x 0 360 , y 0 161 (with image size 360 x 161) dzp 0.009539392 -> scaling image by 1.0088248156909383 Faked up EXPNUM 76990140 Faked up EXPNUM 76990140 Faked up EXPNUM 76990140 90prime get_fwhm: self.fwhm = 3.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 829 1188 and amp range 0 2015 and image y 15 175 and amp range 0 2047 Range in image: x 0 360 , y 0 161 (with image size 360 x 161) dzp 0.004145757 -> scaling image by 1.0038256824624485 Faked up EXPNUM 82240029 Faked up EXPNUM 82240029 Faked up EXPNUM 82240029 90prime get_fwhm: self.fwhm = 3.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2962 3324 and amp range 2016 4031 and image y 2321 2683 and amp range 2048 4095 Range in image: x 0 363 , y 0 363 (with image size 363 x 363) dzp 0.016257986 -> scaling image by 1.01508683329102 Faked up EXPNUM 81970076 Faked up EXPNUM 81970076 Faked up EXPNUM 81970076 90prime get_fwhm: self.fwhm = 3.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2963 3325 and amp range 2016 4031 and image y 2316 2678 and amp range 2048 4095 Range in image: x 0 363 , y 0 363 (with image size 363 x 363) dzp 0.015744466 -> scaling image by 1.0146068417155982 Faked up EXPNUM 78100088 Faked up EXPNUM 78100088 Faked up EXPNUM 78100088 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 953 1320 and amp range 0 2015 and image y 303 668 and amp range 0 2047 Range in image: x 0 368 , y 0 366 (with image size 368 x 366) dzp -0.024106435 -> scaling image by 0.9780418215011345 Faked up EXPNUM 78090046 Faked up EXPNUM 78090046 Faked up EXPNUM 78090046 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 951 1317 and amp range 0 2015 and image y 3852 4080 and amp range 2048 4095 Range in image: x 0 367 , y 0 229 (with image size 367 x 229) dzp -0.045992933 -> scaling image by 0.958523636456738 Faked up EXPNUM 78080034 Faked up EXPNUM 78080034 Faked up EXPNUM 78080034 90prime get_fwhm: self.fwhm = 4.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 938 1306 and amp range 0 2015 and image y 327 692 and amp range 0 2047 Range in image: x 0 369 , y 0 366 (with image size 369 x 366) dzp -0.023075538 -> scaling image by 0.9789709052881876 mosaic get_fwhm: self.fwhm = 3.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 555 1195 and amp range 0 2005 and image y 973 1616 and amp range 0 2039 Range in image: x 0 641 , y 0 644 (with image size 641 x 644) dzp 0.007397243 -> scaling image by 1.006836374469654 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3278 3903 and amp range 2006 4053 and image y 2160 2790 and amp range 2040 4078 Range in image: x 0 626 , y 0 631 (with image size 626 x 631) dzp 0.0056365696 -> scaling image by 1.005204971477435 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 593 1231 and amp range 0 2005 and image y 999 1643 and amp range 0 2039 Range in image: x 0 639 , y 0 645 (with image size 639 x 645) dzp 0.007397243 -> scaling image by 1.006836374469654 mosaic get_fwhm: self.fwhm = 3.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3292 3916 and amp range 2006 4053 and image y 2193 2824 and amp range 2040 4078 Range in image: x 0 625 , y 0 632 (with image size 625 x 632) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 4.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1720 2359 and amp range 0 2047 and image y 674 1309 and amp range 0 2039 Range in image: x 0 328 , y 0 636 (with image size 640 x 636) dzp 0.007023884 -> scaling image by 1.0064902069278665 Found overlap: image x 1720 2359 and amp range 2048 4095 and image y 674 1309 and amp range 0 2039 Range in image: x 328 640 , y 0 636 (with image size 640 x 636) dzp -0.012875672 -> scaling image by 0.9882111074411305 Faked up EXPNUM 78110038 Faked up EXPNUM 78110038 Faked up EXPNUM 78110038 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 973 1338 and amp range 0 2015 and image y 3880 4080 and amp range 2048 4095 Range in image: x 0 366 , y 0 201 (with image size 366 x 201) dzp -0.07725406 -> scaling image by 0.9313188157188347 Stage tims : Wall: 15.73 s, CPU: 0.85 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 202 MB, VmData: 236 MB, maxrss: 0.206844 MB Stage tims finished: 2020-08-05T23:14:30.610257 Resources for stage tims : 7.579 s worker CPU, 34.538 s worker Wall, Wall: 15.731 s, Cores in use: 0.54, Total efficiency (on 32 cores): 1.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-05T23:14:30.662603 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01330.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01436.fits Matched 22 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/reference-custom-107642p50118.fits Stage refs : Wall: 9.99 s, CPU: 3.27 s, VmPeak: 999 MB, VmSize: 994 MB, VmRSS: 246 MB, VmData: 278 MB, maxrss: 0.252316 MB Stage refs finished: 2020-08-05T23:14:40.652416 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.992 s, Cores in use: 0.33, Total efficiency (on 32 cores): 1.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T23:14:41.422863 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/outlier-mask-custom-107642p50118.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/outliers-pre-custom-107642p50118.jpg Image ksb_170225_035030_ooi_g_ls9-CCD3 g : masking 930 positive outlier pixels and 0 negative outlier pixels Image ksb_180416_032142_ooi_g_ls9-CCD1 g : masking 110 positive outlier pixels and 0 negative outlier pixels Image ksb_170224_030500_ooi_g_ls9-CCD1 g : masking 1974 positive outlier pixels and 0 negative outlier pixels Image ksb_171126_130543_ooi_r_ls9-CCD1 r : masking 326 positive outlier pixels and 0 negative outlier pixels Image ksb_170226_035441_ooi_r_ls9-CCD1 r : masking 151 positive outlier pixels and 0 negative outlier pixels Image ksb_180320_052244_ooi_r_ls9-CCD1 r : masking 70 positive outlier pixels and 0 negative outlier pixels Image k4m_170222_053841_ooi_zd_ls9-CCD1 z : masking 17659 positive outlier pixels and 463 negative outlier pixels Image k4m_170315_065651_ooi_zd_ls9-CCD1 z : masking 1664 positive outlier pixels and 5266 negative outlier pixels Image k4m_180105_035347_ooi_zd_ls9-CCD3 z : masking 8408 positive outlier pixels and 249 negative outlier pixels Image k4m_170901_104853_ooi_zd_ls9-CCD2 z : masking 2269 positive outlier pixels and 1548 negative outlier pixels Image k4m_160301_033936_ooi_zd_ls9-CCD3 z : masking 23414 positive outlier pixels and 278 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/outlier-mask-custom-107642p50118.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/outliers-post-custom-107642p50118.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/outliers-masked-pos-custom-107642p50118.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/outliers-masked-neg-custom-107642p50118.jpg Stage outliers : Wall: 3.24 s, CPU: 2.12 s, VmPeak: 1135 MB, VmSize: 985 MB, VmRSS: 277 MB, VmData: 308 MB, maxrss: 0.332024 MB Stage outliers finished: 2020-08-05T23:14:44.665842 Resources for stage outliers : 6.431 s worker CPU, 7.045 s worker Wall, Wall: 3.245 s, Cores in use: 2.63, Total efficiency (on 32 cores): 8.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T23:14:44.724087 Stage halos : Wall: 0.26 s, CPU: 0.24 s, VmPeak: 1135 MB, VmSize: 1005 MB, VmRSS: 297 MB, VmData: 328 MB, maxrss: 0.332024 MB Stage halos finished: 2020-08-05T23:14:44.986594 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.265 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T23:14:45.045423 PSF sigmas in coadd pixels: ['2.13', '2.82', '2.41', '3.38'] Using average PSF sigma 2.682956364792461 Gaussian PSF norm 0.10514326489827183 vs pixelized 0.08450236 average tim pixel scale / coadd scale: 1.7297982212906091 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.19', '2.53', '2.01', '2.23', '2.58'] Using average PSF sigma 2.5070770663579323 Gaussian PSF norm 0.11251939382289569 vs pixelized 0.0924925 average tim pixel scale / coadd scale: 1.7297647196714203 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.45', '1.68', '1.72', '1.61', '1.64'] Using average PSF sigma 1.62006518422797 Gaussian PSF norm 0.1741255811927767 vs pixelized 0.14150439 average tim pixel scale / coadd scale: 0.9909282280274361 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.85 s, CPU: 0.83 s, VmPeak: 1135 MB, VmSize: 1009 MB, VmRSS: 270 MB, VmData: 333 MB, maxrss: 0.336344 MB Stage fit_on_coadds finished: 2020-08-05T23:14:45.898060 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 1.647 s worker CPU, 1.648 s worker Wall, Wall: 0.855 s, Cores in use: 2.90, Total efficiency (on 32 cores): 9.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T23:14:46.021272 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 11031 potential peaks Of 11031 potential peaks: 10923 in veto map, 18 cut by saddle test, 0 cut by aper test, 90 kept SED z : 90 new peaks Found 7886 potential peaks Of 7886 potential peaks: 7860 in veto map, 18 cut by saddle test, 0 cut by aper test, 8 kept SED r : 8 new peaks Found 2046 potential peaks Of 2046 potential peaks: 2021 in veto map, 15 cut by saddle test, 0 cut by aper test, 10 kept SED g : 10 new peaks Found 1964 potential peaks Of 1964 potential peaks: 1920 in veto map, 29 cut by saddle test, 0 cut by aper test, 15 kept SED Flat : 15 new peaks Found 2165 potential peaks Of 2165 potential peaks: 2120 in veto map, 33 cut by saddle test, 2 cut by aper test, 10 kept SED Red : 10 new peaks Adding 133 new sources Median coadd sky for g : 0.00033850566 Median coadd sky for r : 0.00085848186 Median coadd sky for z : 8.198006e-05 Stage srcs : Wall: 3.01 s, CPU: 2.86 s, VmPeak: 1135 MB, VmSize: 1009 MB, VmRSS: 282 MB, VmData: 334 MB, maxrss: 0.336344 MB Stage srcs finished: 2020-08-05T23:14:49.029958 Resources for stage srcs : 0.455 s worker CPU, 0.455 s worker Wall, Wall: 3.011 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T23:14:49.553415 Blob 1 of 32, id: 3, sources: 100, size: 621x544, npix 201274, brick X: 0,621, Y: 77,621, one pixel: 391 77 Blob 2 of 32, id: 0, sources: 22, size: 621x147, npix 47696, brick X: 0,621, Y: 0,147, one pixel: 0 0 Blob 3 of 32, id: 19, sources: 4, size: 68x118, npix 5339, brick X: 0,68, Y: 306,424, one pixel: 41 306 Blob 4 of 32, id: 24, sources: 2, size: 37x51, npix 1150, brick X: 90,127, Y: 454,505, one pixel: 106 454 Blob 5 of 32, id: 25, sources: 2, size: 43x46, npix 1075, brick X: 33,76, Y: 461,507, one pixel: 61 461 Blob 6 of 32, id: 20, sources: 2, size: 42x42, npix 1055, brick X: 579,621, Y: 337,379, one pixel: 589 337 Blob 7 of 32, id: 16, sources: 2, size: 43x39, npix 977, brick X: 28,71, Y: 264,303, one pixel: 37 264 Blob 8 of 32, id: 11, sources: 2, size: 28x43, npix 771, brick X: 37,65, Y: 180,223, one pixel: 47 180 Blob 9 of 32, id: 4, sources: 2, size: 26x39, npix 691, brick X: 515,541, Y: 78,117, one pixel: 526 78 Blob 10 of 32, id: 21, sources: 1, size: 31x31, npix 671, brick X: 98,129, Y: 382,413, one pixel: 117 382 Blob 11 of 32, id: 15, sources: 1, size: 31x32, npix 638, brick X: 554,585, Y: 239,271, one pixel: 570 239 Blob 12 of 32, id: 22, sources: 1, size: 30x31, npix 636, brick X: 586,616, Y: 391,422, one pixel: 597 391 Blob 13 of 32, id: 28, sources: 1, size: 31x33, npix 551, brick X: 413,444, Y: 512,545, one pixel: 424 512 Blob 14 of 32, id: 17, sources: 1, size: 19x29, npix 403, brick X: 0,19, Y: 278,307, one pixel: 5 278 Blob 15 of 32, id: 18, sources: 1, size: 25x25, npix 374, brick X: 592,617, Y: 303,328, one pixel: 603 303 Blob 16 of 32, id: 8, sources: 1, size: 23x24, npix 331, brick X: 119,142, Y: 114,138, one pixel: 129 114 Blob 17 of 32, id: 31, sources: 1, size: 23x23, npix 317, brick X: 9,32, Y: 536,559, one pixel: 19 536 Blob 18 of 32, id: 14, sources: 1, size: 23x23, npix 307, brick X: 32,55, Y: 228,251, one pixel: 41 228 Blob 19 of 32, id: 26, sources: 1, size: 22x23, npix 305, brick X: 133,155, Y: 494,517, one pixel: 142 494 Blob 20 of 32, id: 23, sources: 1, size: 22x22, npix 291, brick X: 61,83, Y: 432,454, one pixel: 70 432 Blob 21 of 32, id: 9, sources: 1, size: 22x21, npix 270, brick X: 592,614, Y: 117,138, one pixel: 602 117 Blob 22 of 32, id: 30, sources: 1, size: 21x21, npix 269, brick X: 208,229, Y: 526,547, one pixel: 216 526 Blob 23 of 32, id: 1, sources: 1, size: 20x21, npix 249, brick X: 207,227, Y: 67,88, one pixel: 216 67 Blob 24 of 32, id: 27, sources: 1, size: 17x22, npix 244, brick X: 0,17, Y: 506,528, one pixel: 5 506 Blob 25 of 32, id: 5, sources: 1, size: 20x21, npix 239, brick X: 492,512, Y: 88,109, one pixel: 502 88 Blob 26 of 32, id: 7, sources: 1, size: 20x21, npix 239, brick X: 560,580, Y: 92,113, one pixel: 569 92 Blob 27 of 32, id: 6, sources: 1, size: 20x19, npix 209, brick X: 462,482, Y: 92,111, one pixel: 471 92 Blob 28 of 32, id: 10, sources: 1, size: 20x19, npix 209, brick X: 579,599, Y: 136,155, one pixel: 588 136 Blob 29 of 32, id: 13, sources: 1, size: 20x19, npix 208, brick X: 15,35, Y: 212,231, one pixel: 23 212 Blob 30 of 32, id: 2, sources: 1, size: 19x19, npix 199, brick X: 358,377, Y: 69,88, one pixel: 367 69 Blob 31 of 32, id: 29, sources: 1, size: 18x18, npix 180, brick X: 181,199, Y: 516,534, one pixel: 189 516 Blob 32 of 32, id: 12, sources: 1, size: 18x17, npix 162, brick X: 81,99, Y: 199,216, one pixel: 89 199 Blob 19 finished, total: Wall: 0.08 s, CPU: 0.07 s, VmPeak: 808 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 184 MB, maxrss: 0.146916 MB Blob 20 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 97 MB, VmData: 148 MB, maxrss: 0.099096 MB Blob 25 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145948 MB Blob 21 finished, total: Wall: 0.10 s, CPU: 0.09 s, VmPeak: 689 MB, VmSize: 678 MB, VmRSS: 99 MB, VmData: 149 MB, maxrss: 0.112844 MB Blob 23 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 688 MB, VmSize: 667 MB, VmRSS: 87 MB, VmData: 138 MB, maxrss: 0.105308 MB Blob 28 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146656 MB Blob 30 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147056 MB Blob 32 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 689 MB, VmSize: 672 MB, VmRSS: 93 MB, VmData: 143 MB, maxrss: 0.11298 MB Blob 18 finished, total: Wall: 0.20 s, CPU: 0.19 s, VmPeak: 683 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.100392 MB Blob 17 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 102 MB, VmData: 148 MB, maxrss: 0.104376 MB Measuring 1 iterative sources Blob 27 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 807 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 184 MB, maxrss: 0.148964 MB Blob 26 finished, total: Wall: 0.27 s, CPU: 0.25 s, VmPeak: 684 MB, VmSize: 675 MB, VmRSS: 101 MB, VmData: 147 MB, maxrss: 0.103048 MB Blob 29 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 677 MB, VmSize: 676 MB, VmRSS: 100 MB, VmData: 147 MB, maxrss: 0.10274 MB Blob 24 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148004 MB Blob 31 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 679 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.10194 MB Blob 16 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 688 MB, VmSize: 679 MB, VmRSS: 104 MB, VmData: 150 MB, maxrss: 0.112524 MB Blob 13 finished, total: Wall: 0.45 s, CPU: 0.44 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147476 MB Blob 10 finished, total: Wall: 0.48 s, CPU: 0.47 s, VmPeak: 681 MB, VmSize: 676 MB, VmRSS: 102 MB, VmData: 148 MB, maxrss: 0.104128 MB Blob 6 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147704 MB Blob 12 finished, total: Wall: 0.54 s, CPU: 0.53 s, VmPeak: 681 MB, VmSize: 679 MB, VmRSS: 102 MB, VmData: 150 MB, maxrss: 0.10418 MB Blob 15 finished, total: Wall: 0.58 s, CPU: 0.57 s, VmPeak: 679 MB, VmSize: 676 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.104192 MB Blob 8 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 688 MB, VmSize: 676 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.112112 MB Blob 11 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 810 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147444 MB Blob 22 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 680 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.09948 MB Blob 9 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 682 MB, VmSize: 676 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.104052 MB Blob 4 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 681 MB, VmSize: 676 MB, VmRSS: 101 MB, VmData: 147 MB, maxrss: 0.103496 MB Blob 7 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 814 MB, VmSize: 727 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.15094 MB Blob 14 finished, total: Wall: 0.93 s, CPU: 0.93 s, VmPeak: 806 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149584 MB Blob 5 finished, total: Wall: 1.21 s, CPU: 1.20 s, VmPeak: 807 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149328 MB Measuring 2 iterative sources Blob 3 finished, total: Wall: 2.78 s, CPU: 2.78 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149816 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.70682, 50.07733), pm (-0.2, -6.1), parallax 1.797 with NanoMaggies: g=13.4, r=13, z=12.9 Reset brightness to NanoMaggies: g=13.4, r=13, z=12.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.67210, 50.09566), pm (3.0, -1.1), parallax 0.465 with NanoMaggies: g=18.6, r=17.7, z=(flux -3.27e+04) Reset brightness to NanoMaggies: g=17.3, r=16.8, z=16.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.60835, 50.09289), pm (-4.2, -6.5), parallax 0.427 with NanoMaggies: g=19.1, r=18.2, z=17.7 Reset brightness to NanoMaggies: g=19.1, r=18.2, z=17.7 Measuring 4 iterative sources Blob 2 finished, total: Wall: 12.50 s, CPU: 12.49 s, VmPeak: 811 MB, VmSize: 726 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151404 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.59240, 50.13939), pm (5.0, -13.8), parallax 1.426 with NanoMaggies: g=10.6, r=9.6, z=9.15 Reset brightness to NanoMaggies: g=10.6, r=9.6, z=9.15 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.14332, ee1=0.326278, ee2=-0.0917452 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.61789, 50.14386), pm (-6.8, 3.0), parallax 1.424 with NanoMaggies: g=15.6, r=14.9, z=14.6 Reset brightness to NanoMaggies: g=15.6, r=14.9, z=14.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.67854, 50.14017), pm (-6.3, -31.9), parallax 3.434 with NanoMaggies: g=21.1, r=18.9, z=(flux -1.53e+04) Reset brightness to NanoMaggies: g=19.5, r=18, z=16.2 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.64328, 50.14352), pm (0.4, -1.1), parallax 0.242 with NanoMaggies: g=18.6, r=18.1, z=13 Reset brightness to NanoMaggies: g=18.6, r=18.1, z=18 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.61548, 50.14136), pm (4.1, -8.1), parallax 0.820 with NanoMaggies: g=23.2, r=22.4, z=19.8 Reset brightness to NanoMaggies: g=20.4, r=19, z=18.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (107.67861, 50.13997), pm (-4.9, -29.5), parallax 4.196 with NanoMaggies: g=20.2, r=19.3, z=(flux -1.42e+03) Reset brightness to NanoMaggies: g=20.1, r=19.1, z=18.6 Measuring 18 iterative sources Blob 1 finished, total: Wall: 81.34 s, CPU: 81.33 s, VmPeak: 878 MB, VmSize: 790 MB, VmRSS: 228 MB, VmData: 261 MB, maxrss: 0.319144 MB Old catalog: 163 New catalog: 154 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/blobs-custom-107642p50118.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/metrics/cus/all-models-custom-107642p50118.fits Stage fitblobs : Wall: 82.39 s, CPU: 0.88 s, VmPeak: 1135 MB, VmSize: 1009 MB, VmRSS: 286 MB, VmData: 343 MB, maxrss: 0.336344 MB Stage fitblobs finished: 2020-08-05T23:16:11.939912 Resources for stage fitblobs : 109.174 s worker CPU, 109.609 s worker Wall, Wall: 82.389 s, Cores in use: 1.34, Total efficiency (on 32 cores): 4.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T23:16:11.976556 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/tmp-legacysurvey-custom-107642p50118-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/tmp-legacysurvey-custom-107642p50118-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/tmp-legacysurvey-custom-107642p50118-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/tmp-legacysurvey-custom-107642p50118-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-resid.jpg Stage coadds : Wall: 4.54 s, CPU: 1.66 s, VmPeak: 1135 MB, VmSize: 1013 MB, VmRSS: 296 MB, VmData: 347 MB, maxrss: 0.347564 MB Stage coadds finished: 2020-08-05T23:16:16.513825 Resources for stage coadds : 26.097 s worker CPU, 26.656 s worker Wall, Wall: 4.540 s, Cores in use: 6.11, Total efficiency (on 32 cores): 19.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T23:16:16.795554 Cut to 1 unWISE tiles Reading WISE tile 1068p499 band 2 Reading WISE tile 1068p499 band 1 Reading WISE tile 1068p499 band 3 Reading WISE tile 1068p499 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.39 s, CPU: 1.18 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 148 MB, VmData: 188 MB, maxrss: 0.209428 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.29 s, CPU: 0.70 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 152 MB, VmData: 193 MB, maxrss: 0.212884 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.75 s, CPU: 2.50 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 156 MB, VmData: 196 MB, maxrss: 0.201572 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p499/unwise-1068p499-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.30 s, CPU: 0.78 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 151 MB, VmData: 189 MB, maxrss: 0.212192 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/tmp-legacysurvey-custom-107642p50118-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/tmp-legacysurvey-custom-107642p50118-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.59 s, CPU: 0.83 s, VmPeak: 1135 MB, VmSize: 1013 MB, VmRSS: 297 MB, VmData: 347 MB, maxrss: 0.347564 MB Stage wise_forced finished: 2020-08-05T23:16:19.389949 Resources for stage wise_forced : 8.346 s worker CPU, 6.026 s worker Wall, Wall: 2.597 s, Cores in use: 3.53, Total efficiency (on 32 cores): 11.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T23:16:19.712341 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/coadd/cus/custom-107642p50118/legacysurvey-custom-107642p50118-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/tractor-i/cus/tractor-custom-107642p50118.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/tractor/cus/tractor-custom-107642p50118.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/tractor/cus/brick-custom-107642p50118.sha256sum Stage writecat : Wall: 1.58 s, CPU: 1.08 s, VmPeak: 1153 MB, VmSize: 1025 MB, VmRSS: 306 MB, VmData: 355 MB, maxrss: 0.444816 MB Stage writecat finished: 2020-08-05T23:16:21.287658 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.578 s, Cores in use: 0.69, Total efficiency (on 32 cores): 2.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/107/IC0458/IC0458-largegalaxy-writecat.p All done: 159.737 s worker CPU, 185.984 s worker Wall, Wall: 126.447 s, Cores in use: 1.38, Total efficiency (on 32 cores): 4.3 % Finished galaxy IC0458 in 2.132 minutes.