Started working on galaxy PGC2775080 at Sun Jun 7 16:45:46 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 193.93774950000002 77.91075 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T16:45:48.848232 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '193.93774950000002', '77.91075', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 193.93774950000002 77.91075 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 193.93774950000002 77.91075 Starting process 42875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057392 MB Starting process 42881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057524 MB Starting process 42885 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057468 MB Starting process 42883 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057528 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T16:45:49.706580 Keeping 12 CCDs: k4m_171110_120457_ooi_zd_ls9.fits.fz k4m_171110_120457_ooi_zd_ls9-CCD1 z exptime 201.103 propid 2016A-0453 seeing 0.97 MJD 58067.503 object MzLS_728038_z k4m_180112_091652_ooi_zd_ls9.fits.fz k4m_180112_091652_ooi_zd_ls9-CCD1 z exptime 202.104 propid 2016A-0453 seeing 1.51 MJD 58130.387 object MzLS_728038_z k4m_171219_084954_ooi_zd_ls9.fits.fz k4m_171219_084954_ooi_zd_ls9-CCD4 z exptime 144.104 propid 2016A-0453 seeing 1.12 MJD 58106.368 object MzLS_727768_z k4m_180212_083745_ooi_zd_ls9.fits.fz k4m_180212_083745_ooi_zd_ls9-CCD3 z exptime 250.104 propid 2015B-2008 seeing 1.71 MJD 58161.360 object MzLS_728303_z k4m_180115_085929_ooi_zd_ls9.fits.fz k4m_180115_085929_ooi_zd_ls9-CCD3 z exptime 100.104 propid 2016A-0453 seeing 0.89 MJD 58133.375 object MzLS_728303_z ksb_190128_120720_ooi_r_ls9.fits.fz ksb_190128_120720_ooi_r_ls9-CCD2 r exptime 148.896 propid NOTBASS seeing 1.21 MJD 58511.505 object ksb_180515_075749_ooi_g_ls9.fits.fz ksb_180515_075749_ooi_g_ls9-CCD3 g exptime 171.47 propid NOTBASS seeing 2.10 MJD 58253.332 object 51193 ksb_180614_054015_ooi_r_ls9.fits.fz ksb_180614_054015_ooi_r_ls9-CCD3 r exptime 191.55 propid NOTBASS seeing 1.30 MJD 58283.236 object 51193 ksb_180612_054113_ooi_g_ls9.fits.fz ksb_180612_054113_ooi_g_ls9-CCD2 g exptime 217.95 propid NOTBASS seeing 2.16 MJD 58281.237 object 51181 ksb_190209_130334_ooi_r_ls9.fits.fz ksb_190209_130334_ooi_r_ls9-CCD1 r exptime 121.621 propid NOTBASS seeing 1.51 MJD 58523.544 object ksb_180515_074057_ooi_g_ls9.fits.fz ksb_180515_074057_ooi_g_ls9-CCD1 g exptime 250.0 propid NOTBASS seeing 2.15 MJD 58253.320 object 51183 ksb_190208_123745_ooi_r_ls9.fits.fz ksb_190208_123745_ooi_r_ls9-CCD4 r exptime 163.799 propid NOTBASS seeing 1.41 MJD 58522.526 object mosaic get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3983 4046 and amp range 2006 4053 and image y 770 1027 and amp range 0 2039 Range in image: x 0 64 , y 0 258 (with image size 64 x 258) dzp 0.0061123776 -> scaling image by 1.005645584425507 mosaic get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2357 2615 and amp range 2048 4095 and image y 1617 1872 and amp range 0 2021 Range in image: x 0 259 , y 0 256 (with image size 259 x 256) dzp -0.029506588 -> scaling image by 0.9731893881648719 mosaic get_fwhm: self.fwhm = 5.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3935 4046 and amp range 2006 4053 and image y 878 1136 and amp range 0 2039 Range in image: x 0 112 , y 0 259 (with image size 112 x 259) dzp 0.0061123776 -> scaling image by 1.005645584425507 mosaic get_fwhm: self.fwhm = 6.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1245 1503 and amp range 0 2005 and image y 2649 2912 and amp range 2040 4078 Range in image: x 0 259 , y 0 264 (with image size 259 x 264) dzp 0.01523814 -> scaling image by 1.014133796220052 Faked up EXPNUM 85110264 Faked up EXPNUM 85110264 Faked up EXPNUM 85110264 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 541 690 and amp range 0 2015 and image y 2347 2496 and amp range 2048 4095 Range in image: x 0 150 , y 0 150 (with image size 150 x 150) dzp 0.049663078 -> scaling image by 1.0468036570994166 Faked up EXPNUM 82830040 Faked up EXPNUM 82830040 Faked up EXPNUM 82830040 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2769 2920 and amp range 2016 4031 and image y 3788 3938 and amp range 2048 4095 Range in image: x 0 152 , y 0 151 (with image size 152 x 151) dzp -0.0072602304 -> scaling image by 0.9933353884052984 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1241 1498 and amp range 0 2005 and image y 2681 2944 and amp range 2040 4078 Range in image: x 0 258 , y 0 264 (with image size 258 x 264) dzp 0.01523814 -> scaling image by 1.014133796220052 Faked up EXPNUM 82530112 Faked up EXPNUM 82530112 Faked up EXPNUM 82530112 90prime get_fwhm: self.fwhm = 4.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2738 2888 and amp range 2016 4031 and image y 3756 3906 and amp range 2048 4095 Range in image: x 0 151 , y 0 151 (with image size 151 x 151) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 82810070 Faked up EXPNUM 82810070 Faked up EXPNUM 82810070 90prime get_fwhm: self.fwhm = 4.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 558 707 and amp range 0 2015 and image y 2354 2504 and amp range 2048 4095 Range in image: x 0 150 , y 0 151 (with image size 150 x 151) dzp 0.0459271 -> scaling image by 1.0432078344950917 Faked up EXPNUM 85230234 Faked up EXPNUM 85230234 Faked up EXPNUM 85230234 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2659 2811 and amp range 2016 4031 and image y 442 595 and amp range 0 2047 Range in image: x 0 153 , y 0 154 (with image size 153 x 154) dzp -0.023422003 -> scaling image by 0.9786585595476589 Faked up EXPNUM 82530109 Faked up EXPNUM 82530109 Faked up EXPNUM 82530109 90prime get_fwhm: self.fwhm = 4.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2630 2783 and amp range 2016 4031 and image y 399 552 and amp range 0 2047 Range in image: x 0 154 , y 0 154 (with image size 154 x 154) dzp -0.019046262 -> scaling image by 0.9826107140833663 Stage tims : Wall: 7.05 s, CPU: 1.13 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 205 MB, maxrss: 0.566512 MB Stage tims finished: 2020-06-07T16:45:56.761162 Resources for stage tims : 3.742 s worker CPU, 16.823 s worker Wall, Wall: 7.056 s, Cores in use: 0.69, Total efficiency (on 4 cores): 17.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-tims.p Running stage refs Faked up EXPNUM 85220293 Faked up EXPNUM 85220293 Faked up EXPNUM 85220293 Running stage refs at 2020-06-07T16:45:56.782410 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00129.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00163.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/reference-custom-193937p77910.fits Stage refs : Wall: 3.94 s, CPU: 1.73 s, VmPeak: 972 MB, VmSize: 958 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.566512 MB Stage refs finished: 2020-06-07T16:46:00.721187 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.940 s, Cores in use: 0.44, Total efficiency (on 4 cores): 11.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T16:46:00.722936 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outlier-mask-custom-193937p77910.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-pre-custom-193937p77910.jpg Image ksb_180612_054113_ooi_g_ls9-CCD2 g : masking 106 positive outlier pixels and 0 negative outlier pixels Image ksb_180614_054015_ooi_r_ls9-CCD3 r : masking 44 positive outlier pixels and 0 negative outlier pixels Image k4m_180212_083745_ooi_zd_ls9-CCD3 z : masking 737 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outlier-mask-custom-193937p77910.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-post-custom-193937p77910.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-masked-pos-custom-193937p77910.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-masked-neg-custom-193937p77910.jpg Stage outliers : Wall: 1.06 s, CPU: 0.79 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 203 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage outliers finished: 2020-06-07T16:46:01.781200 Resources for stage outliers : 0.856 s worker CPU, 0.859 s worker Wall, Wall: 1.059 s, Cores in use: 1.56, Total efficiency (on 4 cores): 38.9 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T16:46:01.783024 Stage halos : Wall: 0.52 s, CPU: 0.50 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 203 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage halos finished: 2020-06-07T16:46:02.301355 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.519 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-07T16:46:02.303084 PSF sigmas in coadd pixels: ['3.41', '3.51', '3.50'] Using average PSF sigma 3.4729449294147265 Gaussian PSF norm 0.08122639359600148 vs pixelized 0.0677085 average tim pixel scale / coadd scale: 1.7303374030748169 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.11', '2.45'] Using average PSF sigma 2.1771167189913734 Gaussian PSF norm 0.12957265419585248 vs pixelized 0.11837854 average tim pixel scale / coadd scale: 1.7304189826667535 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.58', '2.46', '1.82', '2.77', '1.44'] Using average PSF sigma 2.0133361624007344 Gaussian PSF norm 0.14011311029028745 vs pixelized 0.11324801 average tim pixel scale / coadd scale: 0.9910709123333332 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.19 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage fit_on_coadds finished: 2020-06-07T16:46:02.525668 Resources for stage fit_on_coadds : 0.195 s worker CPU, 0.207 s worker Wall, Wall: 0.224 s, Cores in use: 1.71, Total efficiency (on 4 cores): 42.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T16:46:02.528799 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 12 potential peaks Of 12 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 8 potential peaks Of 8 potential peaks: 6 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 15 potential peaks Of 15 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 20 potential peaks Of 20 potential peaks: 16 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 14 new sources Median coadd sky for g : -7.255922e-05 Median coadd sky for r : 9.911437e-05 Median coadd sky for z : -8.946499e-05 Stage srcs : Wall: 0.84 s, CPU: 0.79 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage srcs finished: 2020-06-07T16:46:03.368631 Resources for stage srcs : 0.111 s worker CPU, 0.118 s worker Wall, Wall: 0.841 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T16:46:03.388613 Blob 1 of 9, id: 3, sources: 7, size: 172x153, npix 15715, brick X: 51,223, Y: 43,196, one pixel: 150 43 Blob 2 of 9, id: 6, sources: 1, size: 50x53, npix 1913, brick X: 21,71, Y: 187,240, one pixel: 42 187 Blob 3 of 9, id: 8, sources: 2, size: 66x30, npix 1471, brick X: 62,128, Y: 221,251, one pixel: 96 221 Blob 4 of 9, id: 4, sources: 1, size: 29x31, npix 585, brick X: 188,217, Y: 54,85, one pixel: 200 54 Blob 5 of 9, id: 2, sources: 1, size: 25x27, npix 418, brick X: 8,33, Y: 43,70, one pixel: 19 43 Measuring 1 iterative sources Blob 4 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14272 MB Blob 6 of 9, id: 7, sources: 1, size: 23x23, npix 329, brick X: 190,213, Y: 203,226, one pixel: 200 203 Blob 7 of 9, id: 1, sources: 1, size: 23x18, npix 270, brick X: 116,139, Y: 0,18, one pixel: 122 0 Blob 3 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142964 MB Blob 8 of 9, id: 0, sources: 1, size: 23x16, npix 246, brick X: 38,61, Y: 0,16, one pixel: 42 0 Blob 6 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142964 MB Blob 9 of 9, id: 5, sources: 1, size: 21x19, npix 217, brick X: 219,240, Y: 100,119, one pixel: 227 100 Blob 5 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14272 MB Blob 7 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142964 MB Blob 2 finished, total: Wall: 1.83 s, CPU: 1.82 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141732 MB Blob 8 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.14272 MB Blob 9 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142964 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.89868, ee1=0.00558244, ee2=-0.114368 Measuring 5 iterative sources Blob 1 finished, total: Wall: 11.31 s, CPU: 11.31 s, VmPeak: 806 MB, VmSize: 714 MB, VmRSS: 143 MB, VmData: 179 MB, maxrss: 0.146164 MB Old catalog: 17 New catalog: 21 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/blobs-custom-193937p77910.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/all-models-custom-193937p77910.fits Stage fitblobs : Wall: 12.88 s, CPU: 0.33 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 205 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage fitblobs finished: 2020-06-07T16:46:16.265843 Resources for stage fitblobs : 17.004 s worker CPU, 17.033 s worker Wall, Wall: 12.879 s, Cores in use: 1.35, Total efficiency (on 4 cores): 33.7 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T16:46:16.267902 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/tmp-legacysurvey-custom-193937p77910-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/tmp-legacysurvey-custom-193937p77910-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/tmp-legacysurvey-custom-193937p77910-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/tmp-legacysurvey-custom-193937p77910-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-resid.jpg Stage coadds : Wall: 1.37 s, CPU: 0.67 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage coadds finished: 2020-06-07T16:46:17.640862 Resources for stage coadds : 1.817 s worker CPU, 1.896 s worker Wall, Wall: 1.374 s, Cores in use: 1.81, Total efficiency (on 4 cores): 45.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T16:46:17.642357 Cut to 1 unWISE tiles Reading WISE tile 1928p772 band 2 Reading WISE tile 1928p772 band 4 Reading WISE tile 1928p772 band 1 Reading WISE tile 1928p772 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.204512 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.187996 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208928 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208812 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/tmp-legacysurvey-custom-193937p77910-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/tmp-legacysurvey-custom-193937p77910-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.33 s, CPU: 0.46 s, VmPeak: 972 MB, VmSize: 968 MB, VmRSS: 206 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage wise_forced finished: 2020-06-07T16:46:19.974442 Resources for stage wise_forced : 3.873 s worker CPU, 5.602 s worker Wall, Wall: 2.333 s, Cores in use: 1.86, Total efficiency (on 4 cores): 46.4 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T16:46:19.976250 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193937p77910/legacysurvey-custom-193937p77910-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/tractor-i/cus/tractor-custom-193937p77910.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/tractor/cus/tractor-custom-193937p77910.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/tractor/cus/brick-custom-193937p77910.sha256sum Stage writecat : Wall: 0.95 s, CPU: 0.63 s, VmPeak: 1100 MB, VmSize: 972 MB, VmRSS: 208 MB, VmData: 234 MB, maxrss: 0.566512 MB Stage writecat finished: 2020-06-07T16:46:20.922482 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.947 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.5 % Stage writecat finished All done: 27.600 s worker CPU, 42.540 s worker Wall, Wall: 31.223 s, Cores in use: 1.12, Total efficiency (on 4 cores): 27.9 % Finished galaxy PGC2775080 in 0.575 minutes. Started working on galaxy PGC2775080 at Fri Aug 7 09:32:36 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 193.93926104537346 77.91087520370857 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:32:37.642263 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '193.93926104537346', '77.91087520370857', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 193.93926104537346 77.91087520370857 --width 251 --height 251 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 193.93926104537346 77.91087520370857 Starting process 51871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 51873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 51875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 51877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 51879 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 51881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 51883 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059484 MB Starting process 51885 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 51887 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 51889 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 51891 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 51895 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 51897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 51893 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 51899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 51901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:32:38.109277 Keeping 12 CCDs: k4m_171110_120457_ooi_zd_ls9-CCD1 z expnum 145781 exptime 201.103 propid 2016A-0453 seeing 0.97 MJD 58067.503 object MzLS_728038_z mosaic/CP/V4.3/CP20171109/k4m_171110_120457_ooi_zd_ls9.fits.fz k4m_180112_091652_ooi_zd_ls9-CCD1 z expnum 155005 exptime 202.104 propid 2016A-0453 seeing 1.51 MJD 58130.387 object MzLS_728038_z mosaic/CP/V4.3/CP20180111/k4m_180112_091652_ooi_zd_ls9.fits.fz k4m_171219_084954_ooi_zd_ls9-CCD4 z expnum 151821 exptime 144.104 propid 2016A-0453 seeing 1.12 MJD 58106.368 object MzLS_727768_z mosaic/CP/V4.3/CP20171218/k4m_171219_084954_ooi_zd_ls9.fits.fz k4m_180212_083745_ooi_zd_ls9-CCD3 z expnum 161903 exptime 250.104 propid 2015B-2008 seeing 1.71 MJD 58161.360 object MzLS_728303_z mosaic/CP/V4.3/CP20180211/k4m_180212_083745_ooi_zd_ls9.fits.fz k4m_180115_085929_ooi_zd_ls9-CCD3 z expnum 155720 exptime 100.104 propid 2016A-0453 seeing 0.89 MJD 58133.375 object MzLS_728303_z mosaic/CP/V4.3/CP20180114/k4m_180115_085929_ooi_zd_ls9.fits.fz ksb_190128_120720_ooi_r_ls9-CCD2 r expnum 85110264 exptime 148.896 propid NOTBASS seeing 1.21 MJD 58511.505 object 90prime/CP/V2.3/CP20190127/ksb_190128_120720_ooi_r_ls9.fits.fz ksb_180515_075749_ooi_g_ls9-CCD3 g expnum 82530112 exptime 171.47 propid NOTBASS seeing 2.10 MJD 58253.332 object 51193 90prime/CP/V2.3/CP20180514/ksb_180515_075749_ooi_g_ls9.fits.fz ksb_180614_054015_ooi_r_ls9-CCD3 r expnum 82830040 exptime 191.55 propid NOTBASS seeing 1.30 MJD 58283.236 object 51193 90prime/CP/V2.3/CP20180613/ksb_180614_054015_ooi_r_ls9.fits.fz ksb_180612_054113_ooi_g_ls9-CCD2 g expnum 82810070 exptime 217.95 propid NOTBASS seeing 2.16 MJD 58281.237 object 51181 90prime/CP/V2.3/CP20180611/ksb_180612_054113_ooi_g_ls9.fits.fz ksb_190209_130334_ooi_r_ls9-CCD1 r expnum 85230234 exptime 121.621 propid NOTBASS seeing 1.51 MJD 58523.544 object 90prime/CP/V2.3/CP20190208/ksb_190209_130334_ooi_r_ls9.fits.fz ksb_180515_074057_ooi_g_ls9-CCD1 g expnum 82530109 exptime 250.0 propid NOTBASS seeing 2.15 MJD 58253.320 object 51183 90prime/CP/V2.3/CP20180514/ksb_180515_074057_ooi_g_ls9.fits.fz ksb_190208_123745_ooi_r_ls9-CCD4 r expnum 85220293 exptime 163.799 propid NOTBASS seeing 1.41 MJD 58522.526 object 90prime/CP/V2.3/CP20190207/ksb_190208_123745_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3984 4046 and amp range 2006 4053 and image y 775 1032 and amp range 0 2039 Range in image: x 0 63 , y 0 258 (with image size 63 x 258) dzp 0.0061123776 -> scaling image by 1.005645584425507 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1242 1500 and amp range 0 2005 and image y 2686 2948 and amp range 2040 4078 Range in image: x 0 259 , y 0 263 (with image size 259 x 263) dzp 0.01523814 -> scaling image by 1.014133796220052 mosaic get_fwhm: self.fwhm = 5.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3936 4046 and amp range 2006 4053 and image y 883 1140 and amp range 0 2039 Range in image: x 0 111 , y 0 258 (with image size 111 x 258) dzp 0.0061123776 -> scaling image by 1.005645584425507 mosaic get_fwhm: self.fwhm = 4.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2358 2617 and amp range 2048 4095 and image y 1621 1876 and amp range 0 2021 Range in image: x 0 260 , y 0 256 (with image size 260 x 256) dzp -0.029506588 -> scaling image by 0.9731893881648719 Faked up EXPNUM 82810070 Faked up EXPNUM 82810070 Faked up EXPNUM 82810070 90prime get_fwhm: self.fwhm = 4.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 557 706 and amp range 0 2015 and image y 2352 2502 and amp range 2048 4095 Range in image: x 0 150 , y 0 151 (with image size 150 x 151) dzp 0.0459271 -> scaling image by 1.0432078344950917 Faked up EXPNUM 85230234 Faked up EXPNUM 85230234 Faked up EXPNUM 85230234 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2658 2810 and amp range 2016 4031 and image y 440 592 and amp range 0 2047 Range in image: x 0 153 , y 0 153 (with image size 153 x 153) dzp -0.023422003 -> scaling image by 0.9786585595476589 Faked up EXPNUM 82530109 Faked up EXPNUM 82530109 Faked up EXPNUM 82530109 90prime get_fwhm: self.fwhm = 4.75 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2629 2782 and amp range 2016 4031 and image y 396 550 and amp range 0 2047 Range in image: x 0 154 , y 0 155 (with image size 154 x 155) dzp -0.019046262 -> scaling image by 0.9826107140833663 Faked up EXPNUM 82830040 Faked up EXPNUM 82830040 Faked up EXPNUM 82830040 90prime get_fwhm: self.fwhm = 2.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2768 2919 and amp range 2016 4031 and image y 3785 3936 and amp range 2048 4095 Range in image: x 0 152 , y 0 152 (with image size 152 x 152) dzp -0.0072602304 -> scaling image by 0.9933353884052984 Faked up EXPNUM 82530112 Faked up EXPNUM 82530112 Faked up EXPNUM 82530112 90prime get_fwhm: self.fwhm = 4.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2737 2887 and amp range 2016 4031 and image y 3753 3903 and amp range 2048 4095 Range in image: x 0 151 , y 0 151 (with image size 151 x 151) dzp -0.01723723 -> scaling image by 0.9842492857213068 mosaic get_fwhm: self.fwhm = 6.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1247 1505 and amp range 0 2005 and image y 2654 2916 and amp range 2040 4078 Range in image: x 0 259 , y 0 263 (with image size 259 x 263) dzp 0.01523814 -> scaling image by 1.014133796220052 Faked up EXPNUM 85110264 Faked up EXPNUM 85110264 Faked up EXPNUM 85110264 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 540 689 and amp range 0 2015 and image y 2345 2494 and amp range 2048 4095 Range in image: x 0 150 , y 0 150 (with image size 150 x 150) dzp 0.049663078 -> scaling image by 1.0468036570994166 Stage tims : Wall: 194.73 s, CPU: 0.98 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.178176 MB Stage tims finished: 2020-08-07T09:35:52.841821 Resources for stage tims : 6.019 s worker CPU, 631.934 s worker Wall, Wall: 194.734 s, Cores in use: 0.04, Total efficiency (on 16 cores): 0.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:35:57.383581 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00129.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00163.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/reference-custom-193939p77910.fits Stage refs : Wall: 8.03 s, CPU: 1.64 s, VmPeak: 982 MB, VmSize: 969 MB, VmRSS: 192 MB, VmData: 225 MB, maxrss: 0.196636 MB Stage refs finished: 2020-08-07T09:36:05.413775 Faked up EXPNUM 85220293 Faked up EXPNUM 85220293 Faked up EXPNUM 85220293 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.032 s, Cores in use: 0.20, Total efficiency (on 16 cores): 1.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:36:06.826762 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outlier-mask-custom-193939p77910.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-pre-custom-193939p77910.jpg Image ksb_180612_054113_ooi_g_ls9-CCD2 g : masking 114 positive outlier pixels and 0 negative outlier pixels Image ksb_180614_054015_ooi_r_ls9-CCD3 r : masking 44 positive outlier pixels and 0 negative outlier pixels Image k4m_180212_083745_ooi_zd_ls9-CCD3 z : masking 811 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outlier-mask-custom-193939p77910.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-post-custom-193939p77910.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-masked-pos-custom-193939p77910.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/outliers-masked-neg-custom-193939p77910.jpg Stage outliers : Wall: 0.94 s, CPU: 0.64 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 206 MB, VmData: 236 MB, maxrss: 0.211224 MB Stage outliers finished: 2020-08-07T09:36:07.766853 Resources for stage outliers : 0.662 s worker CPU, 0.760 s worker Wall, Wall: 0.942 s, Cores in use: 1.39, Total efficiency (on 16 cores): 8.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:36:07.875518 Stage halos : Wall: 0.30 s, CPU: 0.29 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 207 MB, VmData: 236 MB, maxrss: 0.211748 MB Stage halos finished: 2020-08-07T09:36:08.171957 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.298 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:36:08.313554 PSF sigmas in coadd pixels: ['3.41', '3.51', '3.50'] Using average PSF sigma 3.4729449294147265 Gaussian PSF norm 0.08122639359600148 vs pixelized 0.06770838 average tim pixel scale / coadd scale: 1.7303374030748169 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.97', '2.11', '2.45'] Using average PSF sigma 2.1771167189913734 Gaussian PSF norm 0.12957265419585248 vs pixelized 0.11837775 average tim pixel scale / coadd scale: 1.7304189826667535 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.58', '2.46', '1.82', '2.77', '1.44'] Using average PSF sigma 2.0133361624007344 Gaussian PSF norm 0.14011311029028745 vs pixelized 0.11325006 average tim pixel scale / coadd scale: 0.9910709123333332 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.15 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 208 MB, VmData: 236 MB, maxrss: 0.21334 MB Stage fit_on_coadds finished: 2020-08-07T09:36:08.495024 Resources for stage fit_on_coadds : 0.176 s worker CPU, 0.176 s worker Wall, Wall: 0.183 s, Cores in use: 1.77, Total efficiency (on 16 cores): 11.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:36:08.534077 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 13 potential peaks Of 13 potential peaks: 3 in veto map, 2 cut by saddle test, 0 cut by aper test, 8 kept SED z : 8 new peaks Found 23 potential peaks Of 23 potential peaks: 17 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 7 potential peaks Of 7 potential peaks: 6 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 15 potential peaks Of 15 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 19 potential peaks Of 19 potential peaks: 15 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 14 new sources Median coadd sky for g : -7.226608e-05 Median coadd sky for r : 0.00010085448 Median coadd sky for z : -7.985983e-05 Stage srcs : Wall: 0.44 s, CPU: 0.40 s, VmPeak: 982 MB, VmSize: 978 MB, VmRSS: 209 MB, VmData: 236 MB, maxrss: 0.213696 MB Stage srcs finished: 2020-08-07T09:36:08.970327 Resources for stage srcs : 0.071 s worker CPU, 0.071 s worker Wall, Wall: 0.437 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:36:09.027534 Blob 1 of 10, id: 2, sources: 6, size: 172x154, npix 15578, brick X: 55,227, Y: 41,195, one pixel: 155 41 Blob 2 of 10, id: 6, sources: 1, size: 49x53, npix 1911, brick X: 26,75, Y: 185,238, one pixel: 50 185 Blob 3 of 10, id: 9, sources: 2, size: 66x32, npix 1568, brick X: 67,133, Y: 219,251, one pixel: 103 219 Blob 4 of 10, id: 5, sources: 1, size: 34x34, npix 825, brick X: 21,55, Y: 124,158, one pixel: 34 124 Blob 5 of 10, id: 3, sources: 1, size: 28x32, npix 586, brick X: 193,221, Y: 52,84, one pixel: 205 52 Blob 6 of 10, id: 1, sources: 1, size: 26x27, npix 421, brick X: 12,38, Y: 41,68, one pixel: 24 41 Blob 7 of 10, id: 7, sources: 1, size: 23x23, npix 317, brick X: 195,218, Y: 201,224, one pixel: 205 201 Blob 8 of 10, id: 0, sources: 1, size: 21x16, npix 225, brick X: 121,142, Y: 0,16, one pixel: 126 0 Blob 9 of 10, id: 4, sources: 1, size: 21x19, npix 225, brick X: 224,245, Y: 98,117, one pixel: 232 98 Blob 10 of 10, id: 8, sources: 1, size: 17x18, npix 162, brick X: 4,21, Y: 210,228, one pixel: 12 210 Blob 9 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 85 MB, VmData: 137 MB, maxrss: 0.087244 MB Blob 10 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145912 MB Blob 7 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14562 MB Blob 4 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.092232 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09234 MB Blob 6 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 784 MB, VmSize: 711 MB, VmRSS: 129 MB, VmData: 169 MB, maxrss: 0.132252 MB Blob 3 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.1461 MB Blob 5 finished, total: Wall: 0.50 s, CPU: 0.50 s, VmPeak: 801 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146676 MB Blob 2 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 801 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147536 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.70897, ee1=0.00469525, ee2=-0.108424 Measuring 1 iterative sources Blob 1 finished, total: Wall: 5.46 s, CPU: 5.46 s, VmPeak: 808 MB, VmSize: 728 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149932 MB Old catalog: 17 New catalog: 14 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/blobs-custom-193939p77910.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/metrics/cus/all-models-custom-193939p77910.fits Stage fitblobs : Wall: 5.96 s, CPU: 0.38 s, VmPeak: 982 MB, VmSize: 975 MB, VmRSS: 205 MB, VmData: 233 MB, maxrss: 0.21386 MB Stage fitblobs finished: 2020-08-07T09:36:14.983402 Resources for stage fitblobs : 8.662 s worker CPU, 8.724 s worker Wall, Wall: 5.957 s, Cores in use: 1.52, Total efficiency (on 16 cores): 9.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:36:15.034960 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/tmp-legacysurvey-custom-193939p77910-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/tmp-legacysurvey-custom-193939p77910-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/tmp-legacysurvey-custom-193939p77910-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/tmp-legacysurvey-custom-193939p77910-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-resid.jpg Stage coadds : Wall: 2.37 s, CPU: 0.66 s, VmPeak: 982 MB, VmSize: 975 MB, VmRSS: 206 MB, VmData: 233 MB, maxrss: 0.21386 MB Stage coadds finished: 2020-08-07T09:36:17.407230 Resources for stage coadds : 7.629 s worker CPU, 7.982 s worker Wall, Wall: 2.374 s, Cores in use: 3.49, Total efficiency (on 16 cores): 21.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:36:17.441105 Cut to 1 unWISE tiles Reading WISE tile 1928p772 band 1 Reading WISE tile 1928p772 band 4 Reading WISE tile 1928p772 band 3 Reading WISE tile 1928p772 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 808 MB, VmSize: 803 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.191728 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 808 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.208076 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 808 MB, VmSize: 801 MB, VmRSS: 145 MB, VmData: 179 MB, maxrss: 0.201088 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/192/1928p772/unwise-1928p772-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 804 MB, VmSize: 802 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.20932 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/tmp-legacysurvey-custom-193939p77910-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/tmp-legacysurvey-custom-193939p77910-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 56.87 s, CPU: 0.53 s, VmPeak: 982 MB, VmSize: 975 MB, VmRSS: 207 MB, VmData: 233 MB, maxrss: 0.21386 MB Stage wise_forced finished: 2020-08-07T09:37:14.311856 Resources for stage wise_forced : 2.803 s worker CPU, 73.710 s worker Wall, Wall: 56.872 s, Cores in use: 0.06, Total efficiency (on 16 cores): 0.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:37:14.353435 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/coadd/cus/custom-193939p77910/legacysurvey-custom-193939p77910-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/tractor-i/cus/tractor-custom-193939p77910.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/tractor/cus/tractor-custom-193939p77910.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/tractor/cus/brick-custom-193939p77910.sha256sum Stage writecat : Wall: 0.66 s, CPU: 0.44 s, VmPeak: 1107 MB, VmSize: 979 MB, VmRSS: 208 MB, VmData: 233 MB, maxrss: 0.344508 MB Stage writecat finished: 2020-08-07T09:37:15.014714 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.663 s, Cores in use: 0.67, Total efficiency (on 16 cores): 4.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/193/PGC2775080/PGC2775080-largegalaxy-writecat.p All done: 26.025 s worker CPU, 723.361 s worker Wall, Wall: 276.934 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 % Finished galaxy PGC2775080 in 4.654 minutes.