Started working on galaxy PGC2190180_GROUP at Sun Jun 7 17:39:03 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:39:04.377444 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '122.39577120901455', '41.97693615926183', '--width', '283', '--height', '283', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 122.39577120901455 41.97693615926183 Starting process 13403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 13405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 13407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 13408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:39:04.889832 Keeping 13 CCDs: k4m_160216_054437_ooi_zd_ls9.fits.fz k4m_160216_054437_ooi_zd_ls9-CCD3 z exptime 80.103 propid 2016A-0453 seeing 0.80 MJD 57434.239 object MzLS_614478_z k4m_160127_072519_ooi_zd_ls9.fits.fz k4m_160127_072519_ooi_zd_ls9-CCD2 z exptime 89.104 propid 2016A-0453 seeing 1.14 MJD 57414.309 object MzLS_612610_z k4m_170202_063823_ooi_zd_ls9.fits.fz k4m_170202_063823_ooi_zd_ls9-CCD2 z exptime 80.104 propid 2016A-0453 seeing 1.11 MJD 57786.277 object MzLS_612610_z k4m_151214_103054_ooi_zd_ls9.fits.fz k4m_151214_103054_ooi_zd_ls9-CCD4 z exptime 101.105 propid 2015B-2001 seeing 1.07 MJD 57370.438 object MzLS_613545_z ksb_161106_121644_ooi_g_ls9.fits.fz ksb_161106_121644_ooi_g_ls9-CCD4 g exptime 87.1 propid BASS seeing 1.07 MJD 57698.512 object 16361 ksb_170320_040526_ooi_r_ls9.fits.fz ksb_170320_040526_ooi_r_ls9-CCD4 r exptime 72.262 propid BASS seeing 1.16 MJD 57832.170 object 16361 ksb_160304_040822_ooi_g_ls9.fits.fz ksb_160304_040822_ooi_g_ls9-CCD2 g exptime 126.0 propid 2015A-0801 seeing 1.27 MJD 57451.172 object 16352 ksb_170202_073515_ooi_r_ls9.fits.fz ksb_170202_073515_ooi_r_ls9-CCD2 r exptime 138.37 propid BASS seeing 1.52 MJD 57786.316 object 16352 ksb_160304_042255_ooi_g_ls9.fits.fz ksb_160304_042255_ooi_g_ls9-CCD4 g exptime 116.9 propid 2015A-0801 seeing 1.28 MJD 57451.183 object 16362 ksb_170202_074748_ooi_r_ls9.fits.fz ksb_170202_074748_ooi_r_ls9-CCD4 r exptime 189.32 propid BASS seeing 1.38 MJD 57786.325 object 16362 ksb_170302_060026_ooi_g_ls9.fits.fz ksb_170302_060026_ooi_g_ls9-CCD3 g exptime 113.675 propid BASS seeing 1.57 MJD 57814.250 object 16363 ksb_170205_073018_ooi_r_ls9.fits.fz ksb_170205_073018_ooi_r_ls9-CCD3 r exptime 202.95 propid BASS seeing 1.21 MJD 57789.313 object 16363 ksb_170205_054554_ooi_r_ls9.fits.fz ksb_170205_054554_ooi_r_ls9-CCD3 r exptime 225.5 propid BASS seeing 1.19 MJD 57789.240 object 16363 mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2815 3104 and amp range 2048 4095 and image y 2785 3071 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.009154885 -> scaling image by 0.9916034885139223 mosaic get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1717 2005 and amp range 0 2005 and image y 2331 2620 and amp range 2040 4078 Range in image: x 0 289 , y 0 290 (with image size 289 x 290) dzp 0.0022078273 -> scaling image by 1.0020355530120029 mosaic get_fwhm: self.fwhm = 4.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 135 418 and amp range 0 2047 and image y 0 183 and amp range 0 2021 Range in image: x 0 284 , y 0 184 (with image size 284 x 184) dzp 0.005139143 -> scaling image by 1.0047445456970268 mosaic get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2808 3097 and amp range 2048 4095 and image y 2794 3080 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 175 and amp range 0 2015 and image y 1826 1990 and amp range 0 2047 Range in image: x 0 161 , y 0 165 (with image size 161 x 165) dzp 0.0029025706 -> scaling image by 1.002676942990926 Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 45 209 and amp range 0 2015 and image y 1866 2030 and amp range 0 2047 Range in image: x 0 165 , y 0 165 (with image size 165 x 165) dzp 0.004145757 -> scaling image by 1.0038256824624485 Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1948 2114 and amp range 0 2015 and image y 286 454 and amp range 0 2047 Range in image: x 0 68 , y 0 169 (with image size 167 x 169) dzp -0.008523628 -> scaling image by 0.992180183483648 Found overlap: image x 1948 2114 and amp range 2016 4031 and image y 286 454 and amp range 0 2047 Range in image: x 68 167 , y 0 169 (with image size 167 x 169) dzp -0.008960029 -> scaling image by 0.9917814665476246 Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1984 2149 and amp range 0 2015 and image y 285 453 and amp range 0 2047 Range in image: x 0 32 , y 0 169 (with image size 166 x 169) dzp 0.005335051 -> scaling image by 1.0049258559887364 Found overlap: image x 1984 2149 and amp range 2016 4031 and image y 285 453 and amp range 0 2047 Range in image: x 32 166 , y 0 169 (with image size 166 x 169) dzp 0.032776505 -> scaling image by 1.0306485625912574 Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2030 2194 and amp range 2016 4031 and image y 3865 4031 and amp range 2048 4095 Range in image: x 0 165 , y 0 167 (with image size 165 x 167) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2005 2170 and amp range 0 2015 and image y 3860 4026 and amp range 2048 4095 Range in image: x 0 11 , y 0 167 (with image size 166 x 167) dzp 0.009255477 -> scaling image by 1.0085610475070432 Found overlap: image x 2005 2170 and amp range 2016 4031 and image y 3860 4026 and amp range 2048 4095 Range in image: x 11 166 , y 0 167 (with image size 166 x 167) dzp 0.0013913503 -> scaling image by 1.001282302423891 Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 90prime get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2214 2378 and amp range 2016 4031 and image y 15 29 and amp range 0 2047 Range in image: x 0 165 , y 0 15 (with image size 165 x 15) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2215 2379 and amp range 2016 4031 and image y 15 34 and amp range 0 2047 Range in image: x 0 165 , y 0 20 (with image size 165 x 20) dzp -0.0023383768 -> scaling image by 0.9978485929508539 Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2224 2388 and amp range 2016 4031 and image y 15 32 and amp range 0 2047 Range in image: x 0 165 , y 0 18 (with image size 165 x 18) dzp -0.0023383768 -> scaling image by 0.9978485929508539 Stage tims : Wall: 6.76 s, CPU: 1.03 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.56652 MB Stage tims finished: 2020-06-07T17:39:11.647172 Resources for stage tims : 3.792 s worker CPU, 17.689 s worker Wall, Wall: 6.758 s, Cores in use: 0.71, Total efficiency (on 4 cores): 17.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:39:11.710460 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02027.fits Matched 13 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/reference-custom-122395p41976.fits Stage refs : Wall: 2.32 s, CPU: 1.92 s, VmPeak: 973 MB, VmSize: 963 MB, VmRSS: 195 MB, VmData: 228 MB, maxrss: 0.56652 MB Stage refs finished: 2020-06-07T17:39:14.034675 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.325 s, Cores in use: 0.82, Total efficiency (on 4 cores): 20.6 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:39:14.036114 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-pre-custom-122395p41976.jpg Image ksb_160304_040822_ooi_g_ls9-CCD2 g : masking 172 positive outlier pixels and 0 negative outlier pixels Image ksb_160304_042255_ooi_g_ls9-CCD4 g : masking 52 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_073515_ooi_r_ls9-CCD2 r : masking 60 positive outlier pixels and 0 negative outlier pixels Image ksb_170320_040526_ooi_r_ls9-CCD4 r : masking 76 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_074748_ooi_r_ls9-CCD4 r : masking 65 positive outlier pixels and 0 negative outlier pixels Image k4m_160127_072519_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 214 negative outlier pixels Image k4m_151214_103054_ooi_zd_ls9-CCD4 z : masking 148 positive outlier pixels and 0 negative outlier pixels Image k4m_160216_054437_ooi_zd_ls9-CCD3 z : masking 1104 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-post-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-pos-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-neg-custom-122395p41976.jpg Stage outliers : Wall: 1.14 s, CPU: 0.82 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.56652 MB Stage outliers finished: 2020-06-07T17:39:15.172295 Resources for stage outliers : 1.360 s worker CPU, 1.393 s worker Wall, Wall: 1.137 s, Cores in use: 1.92, Total efficiency (on 4 cores): 47.9 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:39:15.173998 Stage halos : Wall: 0.26 s, CPU: 0.25 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.56652 MB Stage halos finished: 2020-06-07T17:39:15.433399 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.260 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T17:39:15.434924 PSF sigmas in coadd pixels: ['1.75', '2.07', '2.08', '2.55'] Using average PSF sigma 2.112832611556003 Gaussian PSF norm 0.13351497427244294 vs pixelized 0.116714574 average tim pixel scale / coadd scale: 1.7300596558897692 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.47', '2.25', '1.97', '1.94'] Using average PSF sigma 2.0978524769646016 Gaussian PSF norm 0.1344683646116257 vs pixelized 0.11580692 average tim pixel scale / coadd scale: 1.729795591948369 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.29', '1.86', '1.80', '1.74'] Using average PSF sigma 1.6739669714253038 Gaussian PSF norm 0.16851873220275532 vs pixelized 0.13936733 average tim pixel scale / coadd scale: 0.9908802200371811 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.56652 MB Stage fit_on_coadds finished: 2020-06-07T17:39:15.673740 Resources for stage fit_on_coadds : 0.258 s worker CPU, 0.274 s worker Wall, Wall: 0.240 s, Cores in use: 2.00, Total efficiency (on 4 cores): 49.9 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:39:15.676446 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 7 in veto map, 5 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 90 potential peaks Of 90 potential peaks: 84 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 62 potential peaks Of 62 potential peaks: 53 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 94 potential peaks Of 94 potential peaks: 85 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 91 potential peaks Of 91 potential peaks: 81 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 26 new sources Median coadd sky for g : 0.00028723778 Median coadd sky for r : 0.0009798518 Median coadd sky for z : -7.268405e-05 Stage srcs : Wall: 0.72 s, CPU: 0.66 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.56652 MB Stage srcs finished: 2020-06-07T17:39:16.393145 Resources for stage srcs : 0.125 s worker CPU, 0.125 s worker Wall, Wall: 0.718 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:39:16.411583 Blob 1 of 9, id: 0, sources: 16, size: 242x265, npix 30023, brick X: 0,242, Y: 1,266, one pixel: 186 1 Blob 2 of 9, id: 7, sources: 4, size: 48x58, npix 1511, brick X: 230,278, Y: 137,195, one pixel: 252 137 Blob 3 of 9, id: 5, sources: 2, size: 46x36, npix 947, brick X: 46,92, Y: 89,125, one pixel: 56 89 Blob 4 of 9, id: 2, sources: 1, size: 32x35, npix 724, brick X: 6,38, Y: 67,102, one pixel: 20 67 Blob 5 of 9, id: 1, sources: 1, size: 25x27, npix 436, brick X: 241,266, Y: 15,42, one pixel: 252 15 Blob 4 finished, total: Wall: 0.87 s, CPU: 0.86 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143136 MB Blob 6 of 9, id: 4, sources: 1, size: 27x24, npix 383, brick X: 233,260, Y: 83,107, one pixel: 243 83 Blob 3 finished, total: Wall: 1.56 s, CPU: 1.56 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14402 MB Blob 7 of 9, id: 8, sources: 2, size: 16x31, npix 354, brick X: 267,283, Y: 188,219, one pixel: 279 188 Blob 8 of 9, id: 6, sources: 1, size: 23x23, npix 319, brick X: 39,62, Y: 122,145, one pixel: 49 122 Blob 5 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143712 MB Blob 9 of 9, id: 3, sources: 1, size: 17x17, npix 145, brick X: 256,273, Y: 67,84, one pixel: 264 67 Blob 2 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143144 MB Blob 6 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14402 MB Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.14402 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (122.38173, 41.98148), pm (-0.7, -1.2), parallax -0.161 with NanoMaggies: g=19.6, r=19.1, z=18.8 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Blob 7 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143712 MB Blob 8 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143144 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.26106, ee1=-0.071949, ee2=0.306311 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.14272, ee1=0.265335, ee2=-0.119066 Measuring 9 iterative sources Blob 1 finished, total: Wall: 26.64 s, CPU: 26.64 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 158 MB, VmData: 190 MB, maxrss: 0.175484 MB Old catalog: 32 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/blobs-custom-122395p41976.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/all-models-custom-122395p41976.fits Stage fitblobs : Wall: 27.42 s, CPU: 0.62 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.56652 MB Stage fitblobs finished: 2020-06-07T17:39:43.833151 Resources for stage fitblobs : 33.450 s worker CPU, 34.160 s worker Wall, Wall: 27.423 s, Cores in use: 1.24, Total efficiency (on 4 cores): 31.1 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:39:43.835520 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-resid.jpg Stage coadds : Wall: 1.51 s, CPU: 0.70 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.56652 MB Stage coadds finished: 2020-06-07T17:39:45.343760 Resources for stage coadds : 2.244 s worker CPU, 2.366 s worker Wall, Wall: 1.509 s, Cores in use: 1.95, Total efficiency (on 4 cores): 48.7 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:39:45.345328 Cut to 2 unWISE tiles Reading WISE tile 1213p424 band 1 Reading WISE tile 1213p424 band 2 Reading WISE tile 1213p424 band 3 Reading WISE tile 1213p424 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 1 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209176 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.15 s, CPU: 0.15 s, VmPeak: 805 MB, VmSize: 801 MB, VmRSS: 157 MB, VmData: 183 MB, maxrss: 0.204556 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 862 MB, VmSize: 862 MB, VmRSS: 214 MB, VmData: 244 MB, maxrss: 0.21944 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.208956 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.60 s, CPU: 0.49 s, VmPeak: 973 MB, VmSize: 973 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.56652 MB Stage wise_forced finished: 2020-06-07T17:39:48.948084 Resources for stage wise_forced : 8.195 s worker CPU, 10.712 s worker Wall, Wall: 3.604 s, Cores in use: 2.41, Total efficiency (on 4 cores): 60.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:39:48.949784 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor-i/cus/tractor-custom-122395p41976.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/tractor-custom-122395p41976.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/brick-custom-122395p41976.sha256sum Stage writecat : Wall: 0.79 s, CPU: 0.61 s, VmPeak: 1105 MB, VmSize: 977 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.56652 MB Stage writecat finished: 2020-06-07T17:39:49.744097 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.795 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.1 % Stage writecat finished All done: 49.425 s worker CPU, 66.721 s worker Wall, Wall: 44.860 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.6 % Finished galaxy PGC2190180_GROUP in 0.780 minutes. Started working on galaxy PGC2190180_GROUP at Mon Aug 3 05:26:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-03T05:26:02.734576 legacypipe git version: DR9.5.10-2-ge83842ef Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '122.39577120901455', '41.97693615926183', '--width', '283', '--height', '283', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 122.39577120901455 41.97693615926183 Starting process 42793 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 42794 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 42795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 42796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 42797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 42798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 42799 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 42800 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 42801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 42802 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 42803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 42804 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 42805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 42806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 42807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 42808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 42809 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058916 MB Starting process 42810 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058916 MB Starting process 42811 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058924 MB Starting process 42812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 42813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 42814 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058932 MB Starting process 42815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058936 MB Starting process 42816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058936 MB Starting process 42817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058936 MB Starting process 42818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058936 MB Starting process 42819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058936 MB Starting process 42820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05894 MB Starting process 42821 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05894 MB Starting process 42822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.058948 MB Starting process 42823 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.058948 MB Starting process 42824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.058948 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-03T05:26:03.318284 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 13 CCDs: k4m_160216_054437_ooi_zd_ls9-CCD3 z expnum 69402 exptime 80.103 propid 2016A-0453 seeing 0.80 MJD 57434.239 object MzLS_614478_z mosaic/CP/V4.3/CP20160215/k4m_160216_054437_ooi_zd_ls9.fits.fz k4m_160127_072519_ooi_zd_ls9-CCD2 z expnum 64326 exptime 89.104 propid 2016A-0453 seeing 1.14 MJD 57414.309 object MzLS_612610_z mosaic/CP/V4.3/CP20160126/k4m_160127_072519_ooi_zd_ls9.fits.fz k4m_170202_063823_ooi_zd_ls9-CCD2 z expnum 3106016 exptime 80.104 propid 2016A-0453 seeing 1.11 MJD 57786.277 object MzLS_612610_z mosaic/CP/V4.3/CP20170201/k4m_170202_063823_ooi_zd_ls9.fits.fz k4m_151214_103054_ooi_zd_ls9-CCD4 z expnum 62954 exptime 101.105 propid 2015B-2001 seeing 1.07 MJD 57370.438 object MzLS_613545_z mosaic/CP/V4.3/CP20151213/k4m_151214_103054_ooi_zd_ls9.fits.fz ksb_161106_121644_ooi_g_ls9-CCD4 g expnum 76980198 exptime 87.1 propid BASS seeing 1.07 MJD 57698.512 object 16361 90prime/CP/V2.3/CP20161105/ksb_161106_121644_ooi_g_ls9.fits.fz ksb_170320_040526_ooi_r_ls9-CCD4 r expnum 78320074 exptime 72.262 propid BASS seeing 1.16 MJD 57832.170 object 16361 90prime/CP/V2.3/CP20170319/ksb_170320_040526_ooi_r_ls9.fits.fz ksb_160304_040822_ooi_g_ls9-CCD2 g expnum 74510060 exptime 126.0 propid 2015A-0801 seeing 1.27 MJD 57451.172 object 16352 90prime/CP/V2.3/CP20160303/ksb_160304_040822_ooi_g_ls9.fits.fz ksb_170202_073515_ooi_r_ls9-CCD2 r expnum 77860137 exptime 138.37 propid BASS seeing 1.52 MJD 57786.316 object 16352 90prime/CP/V2.3/CP20170201/ksb_170202_073515_ooi_r_ls9.fits.fz ksb_160304_042255_ooi_g_ls9-CCD4 g expnum 74510065 exptime 116.9 propid 2015A-0801 seeing 1.28 MJD 57451.183 object 16362 90prime/CP/V2.3/CP20160303/ksb_160304_042255_ooi_g_ls9.fits.fz ksb_170202_074748_ooi_r_ls9-CCD4 r expnum 77860141 exptime 189.32 propid BASS seeing 1.38 MJD 57786.325 object 16362 90prime/CP/V2.3/CP20170201/ksb_170202_074748_ooi_r_ls9.fits.fz ksb_170302_060026_ooi_g_ls9-CCD3 g expnum 78140139 exptime 113.675 propid BASS seeing 1.57 MJD 57814.250 object 16363 90prime/CP/V2.3/CP20170301/ksb_170302_060026_ooi_g_ls9.fits.fz ksb_170205_073018_ooi_r_ls9-CCD3 r expnum 77890114 exptime 202.95 propid BASS seeing 1.21 MJD 57789.313 object 16363 90prime/CP/V2.3/CP20170204/ksb_170205_073018_ooi_r_ls9.fits.fz ksb_170205_054554_ooi_r_ls9-CCD3 r expnum 77890088 exptime 225.5 propid BASS seeing 1.19 MJD 57789.240 object 16363 90prime/CP/V2.3/CP20170204/ksb_170205_054554_ooi_r_ls9.fits.fz Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 90prime get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2214 2378 and amp range 2016 4031 and image y 15 29 and amp range 0 2047 Range in image: x 0 165 , y 0 15 (with image size 165 x 15) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 45 209 and amp range 0 2015 and image y 1866 2030 and amp range 0 2047 Range in image: x 0 165 , y 0 165 (with image size 165 x 165) dzp 0.004145757 -> scaling image by 1.0038256824624485 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1948 2114 and amp range 0 2015 and image y 286 454 and amp range 0 2047 Range in image: x 0 68 , y 0 169 (with image size 167 x 169) dzp -0.008523628 -> scaling image by 0.992180183483648 Found overlap: image x 1948 2114 and amp range 2016 4031 and image y 286 454 and amp range 0 2047 Range in image: x 68 167 , y 0 169 (with image size 167 x 169) dzp -0.008960029 -> scaling image by 0.9917814665476246 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2030 2194 and amp range 2016 4031 and image y 3865 4031 and amp range 2048 4095 Range in image: x 0 165 , y 0 167 (with image size 165 x 167) dzp 0.0004463038 -> scaling image by 1.0004111454932232 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 175 and amp range 0 2015 and image y 1826 1990 and amp range 0 2047 Range in image: x 0 161 , y 0 165 (with image size 161 x 165) dzp 0.0029025706 -> scaling image by 1.002676942990926 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2005 2170 and amp range 0 2015 and image y 3860 4026 and amp range 2048 4095 Range in image: x 0 11 , y 0 167 (with image size 166 x 167) dzp 0.009255477 -> scaling image by 1.0085610475070432 Found overlap: image x 2005 2170 and amp range 2016 4031 and image y 3860 4026 and amp range 2048 4095 Range in image: x 11 166 , y 0 167 (with image size 166 x 167) dzp 0.0013913503 -> scaling image by 1.001282302423891 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2215 2379 and amp range 2016 4031 and image y 15 34 and amp range 0 2047 Range in image: x 0 165 , y 0 20 (with image size 165 x 20) dzp -0.0023383768 -> scaling image by 0.9978485929508539 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2224 2388 and amp range 2016 4031 and image y 15 32 and amp range 0 2047 Range in image: x 0 165 , y 0 18 (with image size 165 x 18) dzp -0.0023383768 -> scaling image by 0.9978485929508539 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.13 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 135 418 and amp range 0 2047 and image y 0 183 and amp range 0 2021 Range in image: x 0 284 , y 0 184 (with image size 284 x 184) dzp 0.005139143 -> scaling image by 1.0047445456970268 Found overlap: image x 2808 3097 and amp range 2048 4095 and image y 2794 3080 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.032976374 -> scaling image by 0.9700842429001929 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1717 2005 and amp range 0 2005 and image y 2331 2620 and amp range 2040 4078 Range in image: x 0 289 , y 0 290 (with image size 289 x 290) dzp 0.0022078273 -> scaling image by 1.0020355530120029 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2815 3104 and amp range 2048 4095 and image y 2785 3071 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.009154885 -> scaling image by 0.9916034885139223 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1984 2149 and amp range 0 2015 and image y 285 453 and amp range 0 2047 Range in image: x 0 32 , y 0 169 (with image size 166 x 169) dzp 0.005335051 -> scaling image by 1.0049258559887364 Found overlap: image x 1984 2149 and amp range 2016 4031 and image y 285 453 and amp range 0 2047 Range in image: x 32 166 , y 0 169 (with image size 166 x 169) dzp 0.032776505 -> scaling image by 1.0306485625912574 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 14.15 s, CPU: 1.09 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 176 MB, VmData: 209 MB, maxrss: 0.180516 MB Stage tims finished: 2020-08-03T05:26:17.465895 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.797 s worker CPU, 45.986 s worker Wall, Wall: 14.151 s, Cores in use: 0.56, Total efficiency (on 32 cores): 1.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-03T05:26:17.554225 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02027.fits Matched 13 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/reference-custom-122395p41976.fits Stage refs : Wall: 8.54 s, CPU: 2.31 s, VmPeak: 982 MB, VmSize: 974 MB, VmRSS: 200 MB, VmData: 231 MB, maxrss: 0.204248 MB Stage refs finished: 2020-08-03T05:26:26.092333 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.541 s, Cores in use: 0.27, Total efficiency (on 32 cores): 0.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-03T05:26:26.159529 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-pre-custom-122395p41976.jpg Image ksb_160304_040822_ooi_g_ls9-CCD2 g : masking 172 positive outlier pixels and 0 negative outlier pixels Image ksb_160304_042255_ooi_g_ls9-CCD4 g : masking 52 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_073515_ooi_r_ls9-CCD2 r : masking 60 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_074748_ooi_r_ls9-CCD4 r : masking 65 positive outlier pixels and 0 negative outlier pixels Image ksb_170320_040526_ooi_r_ls9-CCD4 r : masking 76 positive outlier pixels and 0 negative outlier pixels Image k4m_160216_054437_ooi_zd_ls9-CCD3 z : masking 1104 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_103054_ooi_zd_ls9-CCD4 z : masking 148 positive outlier pixels and 0 negative outlier pixels Image k4m_160127_072519_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 214 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-post-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-pos-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-neg-custom-122395p41976.jpg Stage outliers : Wall: 1.36 s, CPU: 1.01 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.222632 MB Stage outliers finished: 2020-08-03T05:26:27.522660 Resources for stage outliers : 1.210 s worker CPU, 1.384 s worker Wall, Wall: 1.366 s, Cores in use: 1.62, Total efficiency (on 32 cores): 5.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-03T05:26:27.614120 Stage halos : Wall: 0.49 s, CPU: 0.47 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 218 MB, VmData: 246 MB, maxrss: 0.223004 MB Stage halos finished: 2020-08-03T05:26:28.099760 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.488 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-03T05:26:28.240978 PSF sigmas in coadd pixels: ['1.75', '2.07', '2.08', '2.55'] Using average PSF sigma 2.112832611556003 Gaussian PSF norm 0.13351497427244294 vs pixelized 0.116714574 average tim pixel scale / coadd scale: 1.7300596558897692 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.47', '2.25', '1.97', '1.94'] Using average PSF sigma 2.0978524769646016 Gaussian PSF norm 0.1344683646116257 vs pixelized 0.11580693 average tim pixel scale / coadd scale: 1.729795591948369 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.29', '1.86', '1.80', '1.74'] Using average PSF sigma 1.6739669714253038 Gaussian PSF norm 0.16851873220275532 vs pixelized 0.13936733 average tim pixel scale / coadd scale: 0.9908802200371811 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.19 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.225612 MB Stage fit_on_coadds finished: 2020-08-03T05:26:28.458070 Resources for stage fit_on_coadds : 0.218 s worker CPU, 0.218 s worker Wall, Wall: 0.220 s, Cores in use: 1.85, Total efficiency (on 32 cores): 5.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-03T05:26:28.479981 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 6 in veto map, 5 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 91 potential peaks Of 91 potential peaks: 85 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 63 potential peaks Of 63 potential peaks: 53 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 96 potential peaks Of 96 potential peaks: 87 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 93 potential peaks Of 93 potential peaks: 83 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 28 new sources Median coadd sky for g : 0.0002889345 Median coadd sky for r : 0.0010013762 Median coadd sky for z : -6.193317e-05 Stage srcs : Wall: 0.78 s, CPU: 0.74 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 221 MB, VmData: 247 MB, maxrss: 0.225988 MB Stage srcs finished: 2020-08-03T05:26:29.261081 Resources for stage srcs : 0.099 s worker CPU, 0.110 s worker Wall, Wall: 0.784 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-03T05:26:29.277536 Blob 1 of 9, id: 0, sources: 16, size: 242x265, npix 30023, brick X: 0,242, Y: 1,266, one pixel: 186 1 Blob 2 of 9, id: 8, sources: 8, size: 53x82, npix 2206, brick X: 230,283, Y: 137,219, one pixel: 252 137 Blob 3 of 9, id: 5, sources: 2, size: 46x36, npix 947, brick X: 46,92, Y: 89,125, one pixel: 56 89 Blob 4 of 9, id: 2, sources: 1, size: 32x35, npix 724, brick X: 6,38, Y: 67,102, one pixel: 20 67 Blob 5 of 9, id: 6, sources: 1, size: 20x41, npix 579, brick X: 263,283, Y: 97,138, one pixel: 279 97 Blob 6 of 9, id: 1, sources: 1, size: 25x27, npix 436, brick X: 241,266, Y: 15,42, one pixel: 252 15 Blob 7 of 9, id: 4, sources: 1, size: 27x24, npix 383, brick X: 233,260, Y: 83,107, one pixel: 243 83 Blob 8 of 9, id: 7, sources: 1, size: 23x23, npix 319, brick X: 39,62, Y: 122,145, one pixel: 49 122 Blob 9 of 9, id: 3, sources: 1, size: 17x17, npix 145, brick X: 256,273, Y: 67,84, one pixel: 264 67 Blob 9 finished, total: Wall: 0.14 s, CPU: 0.06 s, VmPeak: 802 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14778 MB Blob 5 finished, total: Wall: 0.26 s, CPU: 0.17 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093636 MB Blob 8 finished, total: Wall: 0.43 s, CPU: 0.35 s, VmPeak: 800 MB, VmSize: 724 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149664 MB Blob 7 finished, total: Wall: 0.47 s, CPU: 0.37 s, VmPeak: 801 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147836 MB Blob 6 finished, total: Wall: 0.66 s, CPU: 0.58 s, VmPeak: 797 MB, VmSize: 724 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150072 MB Blob 4 finished, total: Wall: 0.67 s, CPU: 0.58 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.0965 MB Blob 3 finished, total: Wall: 1.08 s, CPU: 1.00 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 94 MB, VmData: 139 MB, maxrss: 0.096588 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (122.37131, 41.97976), pm (2.0, -0.4), parallax 1.790 with NanoMaggies: g=14.6, r=14, z=13.8 Reset brightness to NanoMaggies: g=14.6, r=14, z=13.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (122.38173, 41.98148), pm (-0.7, -1.2), parallax -0.161 with NanoMaggies: g=19.6, r=19.1, z=18.8 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Blob 2 finished, total: Wall: 2.02 s, CPU: 1.93 s, VmPeak: 797 MB, VmSize: 725 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150244 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.20183, ee1=-0.055992, ee2=0.286874 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.385069, ee1=0.30331, ee2=-0.220989 Measuring 3 iterative sources Blob 1 finished, total: Wall: 23.15 s, CPU: 23.13 s, VmPeak: 801 MB, VmSize: 736 MB, VmRSS: 164 MB, VmData: 194 MB, maxrss: 0.1679 MB Old catalog: 34 New catalog: 28 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/blobs-custom-122395p41976.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/all-models-custom-122395p41976.fits Stage fitblobs : Wall: 23.52 s, CPU: 0.34 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 222 MB, VmData: 248 MB, maxrss: 0.227416 MB Stage fitblobs finished: 2020-08-03T05:26:52.796266 Resources for stage fitblobs : 28.321 s worker CPU, 29.173 s worker Wall, Wall: 23.522 s, Cores in use: 1.22, Total efficiency (on 32 cores): 3.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-03T05:26:52.864812 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-resid.jpg Stage coadds : Wall: 3.25 s, CPU: 0.79 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 223 MB, VmData: 248 MB, maxrss: 0.22806 MB Stage coadds finished: 2020-08-03T05:26:56.113503 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 21.067 s worker CPU, 38.913 s worker Wall, Wall: 3.251 s, Cores in use: 6.72, Total efficiency (on 32 cores): 21.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-03T05:26:56.130140 Cut to 2 unWISE tiles Reading WISE tile 1213p424 band 1 Reading WISE tile 1213p424 band 3 Reading WISE tile 1213p424 band 2 Reading WISE tile 1213p424 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.31 s, CPU: 0.14 s, VmPeak: 801 MB, VmSize: 797 MB, VmRSS: 147 MB, VmData: 177 MB, maxrss: 0.189444 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 793 MB, VmSize: 793 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.19844 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 800 MB, VmSize: 793 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.205168 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 797 MB, VmSize: 793 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.205356 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.39 s, CPU: 0.45 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 223 MB, VmData: 248 MB, maxrss: 0.228704 MB Stage wise_forced finished: 2020-08-03T05:27:02.524064 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 5.785 s worker CPU, 15.289 s worker Wall, Wall: 6.397 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-03T05:27:02.617716 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor-i/cus/tractor-custom-122395p41976.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/tractor-custom-122395p41976.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/brick-custom-122395p41976.sha256sum Stage writecat : Wall: 0.74 s, CPU: 0.54 s, VmPeak: 1116 MB, VmSize: 988 MB, VmRSS: 225 MB, VmData: 248 MB, maxrss: 0.36152 MB Stage writecat finished: 2020-08-03T05:27:03.354818 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.740 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-writecat.p All done: 63.505 s worker CPU, 131.081 s worker Wall, Wall: 60.059 s, Cores in use: 1.19, Total efficiency (on 32 cores): 3.7 % Finished galaxy PGC2190180_GROUP in 1.035 minutes. Started working on galaxy PGC2190180_GROUP at Thu Aug 6 07:35:39 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-06T07:35:40.715094 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '122.39577120901455', '41.97693615926183', '--width', '283', '--height', '283', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 122.39577120901455 41.97693615926183 Starting process 33927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 33928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 33929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 33930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 33931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059528 MB Starting process 33932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 33933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 33934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 33935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 33936 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33938 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 33939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 33940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 33941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 33942 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 33943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 33946 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33947 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33948 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33949 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 33950 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 33951 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 33952 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 33953 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 33954 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 33955 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 33956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 33957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 33958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-06T07:35:42.334151 Keeping 13 CCDs: k4m_160216_054437_ooi_zd_ls9-CCD3 z expnum 69402 exptime 80.103 propid 2016A-0453 seeing 0.80 MJD 57434.239 object MzLS_614478_z mosaic/CP/V4.3/CP20160215/k4m_160216_054437_ooi_zd_ls9.fits.fz k4m_160127_072519_ooi_zd_ls9-CCD2 z expnum 64326 exptime 89.104 propid 2016A-0453 seeing 1.14 MJD 57414.309 object MzLS_612610_z mosaic/CP/V4.3/CP20160126/k4m_160127_072519_ooi_zd_ls9.fits.fz k4m_170202_063823_ooi_zd_ls9-CCD2 z expnum 3106016 exptime 80.104 propid 2016A-0453 seeing 1.11 MJD 57786.277 object MzLS_612610_z mosaic/CP/V4.3/CP20170201/k4m_170202_063823_ooi_zd_ls9.fits.fz k4m_151214_103054_ooi_zd_ls9-CCD4 z expnum 62954 exptime 101.105 propid 2015B-2001 seeing 1.07 MJD 57370.438 object MzLS_613545_z mosaic/CP/V4.3/CP20151213/k4m_151214_103054_ooi_zd_ls9.fits.fz ksb_161106_121644_ooi_g_ls9-CCD4 g expnum 76980198 exptime 87.1 propid BASS seeing 1.07 MJD 57698.512 object 16361 90prime/CP/V2.3/CP20161105/ksb_161106_121644_ooi_g_ls9.fits.fz ksb_170320_040526_ooi_r_ls9-CCD4 r expnum 78320074 exptime 72.262 propid BASS seeing 1.16 MJD 57832.170 object 16361 90prime/CP/V2.3/CP20170319/ksb_170320_040526_ooi_r_ls9.fits.fz ksb_160304_040822_ooi_g_ls9-CCD2 g expnum 74510060 exptime 126.0 propid 2015A-0801 seeing 1.27 MJD 57451.172 object 16352 90prime/CP/V2.3/CP20160303/ksb_160304_040822_ooi_g_ls9.fits.fz ksb_170202_073515_ooi_r_ls9-CCD2 r expnum 77860137 exptime 138.37 propid BASS seeing 1.52 MJD 57786.316 object 16352 90prime/CP/V2.3/CP20170201/ksb_170202_073515_ooi_r_ls9.fits.fz ksb_160304_042255_ooi_g_ls9-CCD4 g expnum 74510065 exptime 116.9 propid 2015A-0801 seeing 1.28 MJD 57451.183 object 16362 90prime/CP/V2.3/CP20160303/ksb_160304_042255_ooi_g_ls9.fits.fz ksb_170202_074748_ooi_r_ls9-CCD4 r expnum 77860141 exptime 189.32 propid BASS seeing 1.38 MJD 57786.325 object 16362 90prime/CP/V2.3/CP20170201/ksb_170202_074748_ooi_r_ls9.fits.fz ksb_170302_060026_ooi_g_ls9-CCD3 g expnum 78140139 exptime 113.675 propid BASS seeing 1.57 MJD 57814.250 object 16363 90prime/CP/V2.3/CP20170301/ksb_170302_060026_ooi_g_ls9.fits.fz ksb_170205_073018_ooi_r_ls9-CCD3 r expnum 77890114 exptime 202.95 propid BASS seeing 1.21 MJD 57789.313 object 16363 90prime/CP/V2.3/CP20170204/ksb_170205_073018_ooi_r_ls9.fits.fz ksb_170205_054554_ooi_r_ls9-CCD3 r expnum 77890088 exptime 225.5 propid BASS seeing 1.19 MJD 57789.240 object 16363 90prime/CP/V2.3/CP20170204/ksb_170205_054554_ooi_r_ls9.fits.fz Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2224 2388 and amp range 2016 4031 and image y 15 32 and amp range 0 2047 Range in image: x 0 165 , y 0 18 (with image size 165 x 18) dzp -0.0023383768 -> scaling image by 0.9978485929508539 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2215 2379 and amp range 2016 4031 and image y 15 34 and amp range 0 2047 Range in image: x 0 165 , y 0 20 (with image size 165 x 20) dzp -0.0023383768 -> scaling image by 0.9978485929508539 Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1984 2149 and amp range 0 2015 and image y 285 453 and amp range 0 2047 Range in image: x 0 32 , y 0 169 (with image size 166 x 169) dzp 0.005335051 -> scaling image by 1.0049258559887364 Found overlap: image x 1984 2149 and amp range 2016 4031 and image y 285 453 and amp range 0 2047 Range in image: x 32 166 , y 0 169 (with image size 166 x 169) dzp 0.032776505 -> scaling image by 1.0306485625912574 mosaic get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1717 2005 and amp range 0 2005 and image y 2331 2620 and amp range 2040 4078 Range in image: x 0 289 , y 0 290 (with image size 289 x 290) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 90prime get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2214 2378 and amp range 2016 4031 and image y 15 29 and amp range 0 2047 Range in image: x 0 165 , y 0 15 (with image size 165 x 15) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2815 3104 and amp range 2048 4095 and image y 2785 3071 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.009154885 -> scaling image by 0.9916034885139223 mosaic get_fwhm: self.fwhm = 4.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 135 418 and amp range 0 2047 and image y 0 183 and amp range 0 2021 Range in image: x 0 284 , y 0 184 (with image size 284 x 184) dzp 0.005139143 -> scaling image by 1.0047445456970268 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2005 2170 and amp range 0 2015 and image y 3860 4026 and amp range 2048 4095 Range in image: x 0 11 , y 0 167 (with image size 166 x 167) dzp 0.009255477 -> scaling image by 1.0085610475070432 Found overlap: image x 2005 2170 and amp range 2016 4031 and image y 3860 4026 and amp range 2048 4095 Range in image: x 11 166 , y 0 167 (with image size 166 x 167) dzp 0.0013913503 -> scaling image by 1.001282302423891 Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1948 2114 and amp range 0 2015 and image y 286 454 and amp range 0 2047 Range in image: x 0 68 , y 0 169 (with image size 167 x 169) dzp -0.008523628 -> scaling image by 0.992180183483648 Found overlap: image x 1948 2114 and amp range 2016 4031 and image y 286 454 and amp range 0 2047 Range in image: x 68 167 , y 0 169 (with image size 167 x 169) dzp -0.008960029 -> scaling image by 0.9917814665476246 mosaic get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2808 3097 and amp range 2048 4095 and image y 2794 3080 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 175 and amp range 0 2015 and image y 1826 1990 and amp range 0 2047 Range in image: x 0 161 , y 0 165 (with image size 161 x 165) dzp 0.0029025706 -> scaling image by 1.002676942990926 Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 45 209 and amp range 0 2015 and image y 1866 2030 and amp range 0 2047 Range in image: x 0 165 , y 0 165 (with image size 165 x 165) dzp 0.004145757 -> scaling image by 1.0038256824624485 Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2030 2194 and amp range 2016 4031 and image y 3865 4031 and amp range 2048 4095 Range in image: x 0 165 , y 0 167 (with image size 165 x 167) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Stage tims : Wall: 2.89 s, CPU: 0.99 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179176 MB Stage tims finished: 2020-08-06T07:35:45.219303 Resources for stage tims : 6.888 s worker CPU, 16.490 s worker Wall, Wall: 2.888 s, Cores in use: 2.73, Total efficiency (on 32 cores): 8.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-06T07:35:45.265230 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02027.fits Matched 13 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/reference-custom-122395p41976.fits Stage refs : Wall: 2.13 s, CPU: 1.99 s, VmPeak: 983 MB, VmSize: 974 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202932 MB Stage refs finished: 2020-08-06T07:35:47.398210 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.135 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-06T07:35:47.515263 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-pre-custom-122395p41976.jpg Image ksb_160304_040822_ooi_g_ls9-CCD2 g : masking 172 positive outlier pixels and 0 negative outlier pixels Image ksb_160304_042255_ooi_g_ls9-CCD4 g : masking 52 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_074748_ooi_r_ls9-CCD4 r : masking 65 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_073515_ooi_r_ls9-CCD2 r : masking 60 positive outlier pixels and 0 negative outlier pixels Image ksb_170320_040526_ooi_r_ls9-CCD4 r : masking 76 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_103054_ooi_zd_ls9-CCD4 z : masking 148 positive outlier pixels and 0 negative outlier pixels Image k4m_160216_054437_ooi_zd_ls9-CCD3 z : masking 1104 positive outlier pixels and 0 negative outlier pixels Image k4m_160127_072519_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 214 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-post-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-pos-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-neg-custom-122395p41976.jpg Stage outliers : Wall: 0.93 s, CPU: 0.61 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.222804 MB Stage outliers finished: 2020-08-06T07:35:48.440609 Resources for stage outliers : 1.203 s worker CPU, 1.414 s worker Wall, Wall: 0.927 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-06T07:35:48.541448 Stage halos : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.223056 MB Stage halos finished: 2020-08-06T07:35:48.734294 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.195 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-06T07:35:48.767168 PSF sigmas in coadd pixels: ['1.75', '2.07', '2.08', '2.55'] Using average PSF sigma 2.112832611556003 Gaussian PSF norm 0.13351497427244294 vs pixelized 0.116714574 average tim pixel scale / coadd scale: 1.7300596558897692 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.47', '2.25', '1.97', '1.94'] Using average PSF sigma 2.0978524769646016 Gaussian PSF norm 0.1344683646116257 vs pixelized 0.11580693 average tim pixel scale / coadd scale: 1.729795591948369 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.29', '1.86', '1.80', '1.74'] Using average PSF sigma 1.6739669714253038 Gaussian PSF norm 0.16851873220275532 vs pixelized 0.13936733 average tim pixel scale / coadd scale: 0.9908802200371811 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 219 MB, VmData: 248 MB, maxrss: 0.224652 MB Stage fit_on_coadds finished: 2020-08-06T07:35:48.952968 Resources for stage fit_on_coadds : 0.206 s worker CPU, 0.206 s worker Wall, Wall: 0.188 s, Cores in use: 2.08, Total efficiency (on 32 cores): 6.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-06T07:35:48.964588 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 6 in veto map, 5 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 91 potential peaks Of 91 potential peaks: 85 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 63 potential peaks Of 63 potential peaks: 53 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 96 potential peaks Of 96 potential peaks: 87 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 93 potential peaks Of 93 potential peaks: 83 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 28 new sources Median coadd sky for g : 0.0002889345 Median coadd sky for r : 0.0010013762 Median coadd sky for z : -6.193317e-05 Stage srcs : Wall: 0.58 s, CPU: 0.53 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.225008 MB Stage srcs finished: 2020-08-06T07:35:49.541104 Resources for stage srcs : 0.118 s worker CPU, 0.118 s worker Wall, Wall: 0.579 s, Cores in use: 1.12, Total efficiency (on 32 cores): 3.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-06T07:35:49.554556 Blob 1 of 9, id: 0, sources: 16, size: 242x265, npix 30023, brick X: 0,242, Y: 1,266, one pixel: 186 1 Blob 2 of 9, id: 8, sources: 8, size: 53x82, npix 2206, brick X: 230,283, Y: 137,219, one pixel: 252 137 Blob 3 of 9, id: 5, sources: 2, size: 46x36, npix 947, brick X: 46,92, Y: 89,125, one pixel: 56 89 Blob 4 of 9, id: 2, sources: 1, size: 32x35, npix 724, brick X: 6,38, Y: 67,102, one pixel: 20 67 Blob 5 of 9, id: 6, sources: 1, size: 20x41, npix 579, brick X: 263,283, Y: 97,138, one pixel: 279 97 Blob 6 of 9, id: 1, sources: 1, size: 25x27, npix 436, brick X: 241,266, Y: 15,42, one pixel: 252 15 Blob 7 of 9, id: 4, sources: 1, size: 27x24, npix 383, brick X: 233,260, Y: 83,107, one pixel: 243 83 Blob 8 of 9, id: 7, sources: 1, size: 23x23, npix 319, brick X: 39,62, Y: 122,145, one pixel: 49 122 Blob 9 of 9, id: 3, sources: 1, size: 17x17, npix 145, brick X: 256,273, Y: 67,84, one pixel: 264 67 Blob 9 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147224 MB Blob 5 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09368 MB Blob 8 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092908 MB Blob 7 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146032 MB Blob 6 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148536 MB Blob 4 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146584 MB Blob 3 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.0963 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (122.37131, 41.97976), pm (2.0, -0.4), parallax 1.790 with NanoMaggies: g=14.6, r=14, z=13.8 Reset brightness to NanoMaggies: g=14.6, r=14, z=13.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (122.38173, 41.98148), pm (-0.7, -1.2), parallax -0.161 with NanoMaggies: g=19.6, r=19.1, z=18.8 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Blob 2 finished, total: Wall: 1.87 s, CPU: 1.87 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096272 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.261, ee1=-0.0719544, ee2=0.306318 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.14127, ee1=0.265509, ee2=-0.119348 Measuring 8 iterative sources Blob 1 finished, total: Wall: 24.10 s, CPU: 24.09 s, VmPeak: 803 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 190 MB, maxrss: 0.176968 MB Old catalog: 34 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/blobs-custom-122395p41976.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/all-models-custom-122395p41976.fits Stage fitblobs : Wall: 24.41 s, CPU: 0.29 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.225416 MB Stage fitblobs finished: 2020-08-06T07:36:13.968564 Resources for stage fitblobs : 29.308 s worker CPU, 29.334 s worker Wall, Wall: 24.416 s, Cores in use: 1.21, Total efficiency (on 32 cores): 3.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-06T07:36:13.993295 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-resid.jpg Stage coadds : Wall: 2.36 s, CPU: 0.79 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.225932 MB Stage coadds finished: 2020-08-06T07:36:16.355296 Resources for stage coadds : 22.560 s worker CPU, 26.212 s worker Wall, Wall: 2.364 s, Cores in use: 9.88, Total efficiency (on 32 cores): 30.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-06T07:36:16.394464 Cut to 2 unWISE tiles Reading WISE tile 1213p424 band 4 Reading WISE tile 1213p424 band 3 Reading WISE tile 1213p424 band 2 Reading WISE tile 1213p424 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 807 MB, VmSize: 800 MB, VmRSS: 148 MB, VmData: 178 MB, maxrss: 0.18326 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 804 MB, VmSize: 793 MB, VmRSS: 137 MB, VmData: 171 MB, maxrss: 0.198492 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 793 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.199112 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 795 MB, VmSize: 795 MB, VmRSS: 139 MB, VmData: 174 MB, maxrss: 0.195376 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.49 s, CPU: 1.14 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.226636 MB Stage wise_forced finished: 2020-08-06T07:36:20.887246 Resources for stage wise_forced : 6.023 s worker CPU, 9.468 s worker Wall, Wall: 4.495 s, Cores in use: 1.59, Total efficiency (on 32 cores): 5.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-06T07:36:21.064451 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor-i/cus/tractor-custom-122395p41976.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/tractor-custom-122395p41976.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/brick-custom-122395p41976.sha256sum Stage writecat : Wall: 2.74 s, CPU: 1.98 s, VmPeak: 1116 MB, VmSize: 988 MB, VmRSS: 223 MB, VmData: 248 MB, maxrss: 0.359648 MB Stage writecat finished: 2020-08-06T07:36:23.800173 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.738 s, Cores in use: 0.72, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-writecat.p All done: 66.312 s worker CPU, 83.249 s worker Wall, Wall: 41.702 s, Cores in use: 1.80, Total efficiency (on 32 cores): 5.6 % Finished galaxy PGC2190180_GROUP in 0.745 minutes. Started working on galaxy PGC2190180_GROUP at Thu Aug 13 13:31:12 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-13T13:31:13.188136 legacypipe git version: DR9.5.11-watershed-9-g82106209 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '122.39577120901455', '41.97693615926183', '--width', '283', '--height', '283', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.39577120901455 41.97693615926183 --width 283 --height 283 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 122.39577120901455 41.97693615926183 Starting process 12656 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 12657 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 12658 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 12659 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 12660 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 12661 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 12662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 12663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 12664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 12665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 12666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 12667 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 12668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 12669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 12670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 12671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 12672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 12673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 12674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 12675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 12676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 12677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 12678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 12679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 12680 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 12681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 12682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 12683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 12684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 12685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 12686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 12687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-13T13:31:13.573606 Keeping 13 CCDs: k4m_160216_054437_ooi_zd_ls9-CCD3 z expnum 69402 exptime 80.103 propid 2016A-0453 seeing 0.80 MJD 57434.239 object MzLS_614478_z mosaic/CP/V4.3/CP20160215/k4m_160216_054437_ooi_zd_ls9.fits.fz k4m_160127_072519_ooi_zd_ls9-CCD2 z expnum 64326 exptime 89.104 propid 2016A-0453 seeing 1.14 MJD 57414.309 object MzLS_612610_z mosaic/CP/V4.3/CP20160126/k4m_160127_072519_ooi_zd_ls9.fits.fz k4m_170202_063823_ooi_zd_ls9-CCD2 z expnum 3106016 exptime 80.104 propid 2016A-0453 seeing 1.11 MJD 57786.277 object MzLS_612610_z mosaic/CP/V4.3/CP20170201/k4m_170202_063823_ooi_zd_ls9.fits.fz k4m_151214_103054_ooi_zd_ls9-CCD4 z expnum 62954 exptime 101.105 propid 2015B-2001 seeing 1.07 MJD 57370.438 object MzLS_613545_z mosaic/CP/V4.3/CP20151213/k4m_151214_103054_ooi_zd_ls9.fits.fz ksb_161106_121644_ooi_g_ls9-CCD4 g expnum 76980198 exptime 87.1 propid BASS seeing 1.07 MJD 57698.512 object 16361 90prime/CP/V2.3/CP20161105/ksb_161106_121644_ooi_g_ls9.fits.fz ksb_170320_040526_ooi_r_ls9-CCD4 r expnum 78320074 exptime 72.262 propid BASS seeing 1.16 MJD 57832.170 object 16361 90prime/CP/V2.3/CP20170319/ksb_170320_040526_ooi_r_ls9.fits.fz ksb_160304_040822_ooi_g_ls9-CCD2 g expnum 74510060 exptime 126.0 propid 2015A-0801 seeing 1.27 MJD 57451.172 object 16352 90prime/CP/V2.3/CP20160303/ksb_160304_040822_ooi_g_ls9.fits.fz ksb_170202_073515_ooi_r_ls9-CCD2 r expnum 77860137 exptime 138.37 propid BASS seeing 1.52 MJD 57786.316 object 16352 90prime/CP/V2.3/CP20170201/ksb_170202_073515_ooi_r_ls9.fits.fz ksb_160304_042255_ooi_g_ls9-CCD4 g expnum 74510065 exptime 116.9 propid 2015A-0801 seeing 1.28 MJD 57451.183 object 16362 90prime/CP/V2.3/CP20160303/ksb_160304_042255_ooi_g_ls9.fits.fz ksb_170202_074748_ooi_r_ls9-CCD4 r expnum 77860141 exptime 189.32 propid BASS seeing 1.38 MJD 57786.325 object 16362 90prime/CP/V2.3/CP20170201/ksb_170202_074748_ooi_r_ls9.fits.fz ksb_170302_060026_ooi_g_ls9-CCD3 g expnum 78140139 exptime 113.675 propid BASS seeing 1.57 MJD 57814.250 object 16363 90prime/CP/V2.3/CP20170301/ksb_170302_060026_ooi_g_ls9.fits.fz ksb_170205_073018_ooi_r_ls9-CCD3 r expnum 77890114 exptime 202.95 propid BASS seeing 1.21 MJD 57789.313 object 16363 90prime/CP/V2.3/CP20170204/ksb_170205_073018_ooi_r_ls9.fits.fz ksb_170205_054554_ooi_r_ls9-CCD3 r expnum 77890088 exptime 225.5 propid BASS seeing 1.19 MJD 57789.240 object 16363 90prime/CP/V2.3/CP20170204/ksb_170205_054554_ooi_r_ls9.fits.fz Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 Faked up EXPNUM 77890088 90prime get_fwhm: self.fwhm = 2.63 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2224 2388 and amp range 2016 4031 and image y 15 32 and amp range 0 2047 Range in image: x 0 165 , y 0 18 (with image size 165 x 18) dzp -0.0023383768 -> scaling image by 0.9978485929508539 mosaic get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1717 2005 and amp range 0 2005 and image y 2331 2620 and amp range 2040 4078 Range in image: x 0 289 , y 0 290 (with image size 289 x 290) dzp 0.0022078273 -> scaling image by 1.0020355530120029 mosaic get_fwhm: self.fwhm = 4.13 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 Faked up EXPNUM 77860137 90prime get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 135 418 and amp range 0 2047 and image y 0 183 and amp range 0 2021 Found overlap: image x 1984 2149 and amp range 0 2015 and image y 285 453 and amp range 0 2047 Range in image: x 0 284 , y 0 184 (with image size 284 x 184) Range in image: x 0 32 , y 0 169 (with image size 166 x 169) dzp 0.005139143 -> scaling image by 1.0047445456970268 dzp 0.005335051 -> scaling image by 1.0049258559887364 Found overlap: image x 1984 2149 and amp range 2016 4031 and image y 285 453 and amp range 0 2047 Range in image: x 32 166 , y 0 169 (with image size 166 x 169) dzp 0.032776505 -> scaling image by 1.0306485625912574 Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 Faked up EXPNUM 76980198 90prime get_fwhm: self.fwhm = 2.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 175 and amp range 0 2015 and image y 1826 1990 and amp range 0 2047 Range in image: x 0 161 , y 0 165 (with image size 161 x 165) dzp 0.0029025706 -> scaling image by 1.002676942990926 mosaic get_fwhm: self.fwhm = 4.27 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2808 3097 and amp range 2048 4095 and image y 2794 3080 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 Faked up EXPNUM 77860141 90prime get_fwhm: self.fwhm = 3.05 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2030 2194 and amp range 2016 4031 and image y 3865 4031 and amp range 2048 4095 Range in image: x 0 165 , y 0 167 (with image size 165 x 167) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 Faked up EXPNUM 74510065 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2005 2170 and amp range 0 2015 and image y 3860 4026 and amp range 2048 4095 Range in image: x 0 11 , y 0 167 (with image size 166 x 167) dzp 0.009255477 -> scaling image by 1.0085610475070432 Found overlap: image x 2005 2170 and amp range 2016 4031 and image y 3860 4026 and amp range 2048 4095 Range in image: x 11 166 , y 0 167 (with image size 166 x 167) dzp 0.0013913503 -> scaling image by 1.001282302423891 Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 Faked up EXPNUM 74510060 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1948 2114 and amp range 0 2015 and image y 286 454 and amp range 0 2047 Range in image: x 0 68 , y 0 169 (with image size 167 x 169) dzp -0.008523628 -> scaling image by 0.992180183483648 Found overlap: image x 1948 2114 and amp range 2016 4031 and image y 286 454 and amp range 0 2047 Range in image: x 68 167 , y 0 169 (with image size 167 x 169) dzp -0.008960029 -> scaling image by 0.9917814665476246 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 Faked up EXPNUM 77890114 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2215 2379 and amp range 2016 4031 and image y 15 34 and amp range 0 2047 Range in image: x 0 165 , y 0 20 (with image size 165 x 20) dzp -0.0023383768 -> scaling image by 0.9978485929508539 mosaic get_fwhm: self.fwhm = 4.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2815 3104 and amp range 2048 4095 and image y 2785 3071 and amp range 2040 4078 Range in image: x 0 290 , y 0 287 (with image size 290 x 287) dzp -0.009154885 -> scaling image by 0.9916034885139223 Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 Faked up EXPNUM 78320074 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 45 209 and amp range 0 2015 and image y 1866 2030 and amp range 0 2047 Range in image: x 0 165 , y 0 165 (with image size 165 x 165) dzp 0.004145757 -> scaling image by 1.0038256824624485 Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 Faked up EXPNUM 78140139 90prime get_fwhm: self.fwhm = 3.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2214 2378 and amp range 2016 4031 and image y 15 29 and amp range 0 2047 Range in image: x 0 165 , y 0 15 (with image size 165 x 15) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 Stage tims : Wall: 3.45 s, CPU: 0.81 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179412 MB Stage tims finished: 2020-08-13T13:31:17.026482 Resources for stage tims : 6.707 s worker CPU, 18.789 s worker Wall, Wall: 3.455 s, Cores in use: 2.18, Total efficiency (on 32 cores): 6.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-13T13:31:17.050842 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02027.fits Matched 13 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/reference-custom-122395p41976.fits Stage refs : Wall: 2.92 s, CPU: 2.03 s, VmPeak: 983 MB, VmSize: 974 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.20318 MB Stage refs finished: 2020-08-13T13:31:19.973349 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.926 s, Cores in use: 0.69, Total efficiency (on 32 cores): 2.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-13T13:31:20.013962 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-pre-custom-122395p41976.jpg Image ksb_160304_040822_ooi_g_ls9-CCD2 g : masking 172 positive outlier pixels and 0 negative outlier pixels Image ksb_160304_042255_ooi_g_ls9-CCD4 g : masking 52 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_073515_ooi_r_ls9-CCD2 r : masking 60 positive outlier pixels and 0 negative outlier pixels Image ksb_170202_074748_ooi_r_ls9-CCD4 r : masking 65 positive outlier pixels and 0 negative outlier pixels Image ksb_170320_040526_ooi_r_ls9-CCD4 r : masking 76 positive outlier pixels and 0 negative outlier pixels Image k4m_160127_072519_ooi_zd_ls9-CCD2 z : masking 0 positive outlier pixels and 214 negative outlier pixels Image k4m_151214_103054_ooi_zd_ls9-CCD4 z : masking 148 positive outlier pixels and 0 negative outlier pixels Image k4m_160216_054437_ooi_zd_ls9-CCD3 z : masking 1104 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outlier-mask-custom-122395p41976.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-post-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-pos-custom-122395p41976.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/outliers-masked-neg-custom-122395p41976.jpg Stage outliers : Wall: 1.03 s, CPU: 0.63 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 217 MB, VmData: 247 MB, maxrss: 0.221984 MB Stage outliers finished: 2020-08-13T13:31:21.045936 Resources for stage outliers : 1.179 s worker CPU, 1.470 s worker Wall, Wall: 1.034 s, Cores in use: 1.75, Total efficiency (on 32 cores): 5.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-13T13:31:21.071896 Stage halos : Wall: 2.10 s, CPU: 1.96 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 217 MB, VmData: 248 MB, maxrss: 0.22228 MB Stage halos finished: 2020-08-13T13:31:23.172937 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 2.103 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-13T13:31:23.212853 PSF sigmas in coadd pixels: ['1.75', '2.07', '2.08', '2.55'] Using average PSF sigma 2.112832611556003 Gaussian PSF norm 0.13351497427244294 vs pixelized 0.116714574 average tim pixel scale / coadd scale: 1.7300596558897692 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.88', '2.47', '2.25', '1.97', '1.94'] Using average PSF sigma 2.0978524769646016 Gaussian PSF norm 0.1344683646116257 vs pixelized 0.11580693 average tim pixel scale / coadd scale: 1.729795591948369 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.29', '1.86', '1.80', '1.74'] Using average PSF sigma 1.6739669714253038 Gaussian PSF norm 0.16851873220275532 vs pixelized 0.13936733 average tim pixel scale / coadd scale: 0.9908802200371811 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.19 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 219 MB, VmData: 248 MB, maxrss: 0.22468 MB Stage fit_on_coadds finished: 2020-08-13T13:31:23.440032 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.238 s worker CPU, 0.238 s worker Wall, Wall: 0.229 s, Cores in use: 1.86, Total efficiency (on 32 cores): 5.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-13T13:31:23.452671 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 32 potential peaks Of 32 potential peaks: 6 in veto map, 5 cut by saddle test, 0 cut by aper test, 21 kept SED z : 21 new peaks Found 91 potential peaks Of 91 potential peaks: 85 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 63 potential peaks Of 63 potential peaks: 53 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 96 potential peaks Of 96 potential peaks: 87 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 93 potential peaks Of 93 potential peaks: 83 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 28 new sources Median coadd sky for g : 0.0002889345 Median coadd sky for r : 0.0010013762 Median coadd sky for z : -6.193317e-05 Stage srcs : Wall: 2.33 s, CPU: 2.30 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.225036 MB Stage srcs finished: 2020-08-13T13:31:25.782681 Resources for stage srcs : 0.088 s worker CPU, 0.088 s worker Wall, Wall: 2.332 s, Cores in use: 1.02, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-13T13:31:25.797406 Blob 1 of 9, id: 0, sources: 16, size: 242x265, npix 30023, brick X: 0,242, Y: 1,266, one pixel: 186 1 Blob 2 of 9, id: 8, sources: 8, size: 53x82, npix 2206, brick X: 230,283, Y: 137,219, one pixel: 252 137 Blob 3 of 9, id: 5, sources: 2, size: 46x36, npix 947, brick X: 46,92, Y: 89,125, one pixel: 56 89 Blob 4 of 9, id: 2, sources: 1, size: 32x35, npix 724, brick X: 6,38, Y: 67,102, one pixel: 20 67 Blob 5 of 9, id: 6, sources: 1, size: 20x41, npix 579, brick X: 263,283, Y: 97,138, one pixel: 279 97 Blob 6 of 9, id: 1, sources: 1, size: 25x27, npix 436, brick X: 241,266, Y: 15,42, one pixel: 252 15 Blob 7 of 9, id: 4, sources: 1, size: 27x24, npix 383, brick X: 233,260, Y: 83,107, one pixel: 243 83 Blob 8 of 9, id: 7, sources: 1, size: 23x23, npix 319, brick X: 39,62, Y: 122,145, one pixel: 49 122 Blob 9 of 9, id: 3, sources: 1, size: 17x17, npix 145, brick X: 256,273, Y: 67,84, one pixel: 264 67 Blob 9 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 87 MB, VmData: 140 MB, maxrss: 0.088888 MB Blob 5 finished, total: Wall: 0.17 s, CPU: 0.17 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09354 MB Blob 8 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14736 MB Blob 7 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093616 MB Reference source: GaiaSource at GaiaPosition: RA, Dec = (122.37131, 41.97976), pm (2.0, -0.4), parallax 1.790 with NanoMaggies: g=14.6, r=14, z=13.8 cat entry: tabledata object with 1 rows and 62 columns Reference source: GaiaSource at GaiaPosition: RA, Dec = (122.38173, 41.98148), pm (-0.7, -1.2), parallax -0.161 with NanoMaggies: g=22.1, r=21, z=20.2 cat entry: tabledata object with 1 rows and 62 columns Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (122.37131, 41.97976), pm (2.0, -0.4), parallax 1.790 with NanoMaggies: g=14.6, r=14, z=13.8 Reset brightness to NanoMaggies: g=14.6, r=14, z=13.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (122.38173, 41.98148), pm (-0.7, -1.2), parallax -0.161 with NanoMaggies: g=22.1, r=21, z=20.2 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Blob 6 finished, total: Wall: 0.60 s, CPU: 0.59 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096916 MB Blob 4 finished, total: Wall: 0.65 s, CPU: 0.64 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148368 MB Blob 3 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093904 MB Blob 2 finished, total: Wall: 1.56 s, CPU: 1.56 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14724 MB Reference source: ExpGalaxy at RaDecPos: RA, Dec = (122.39646, 41.97718) with NanoMaggies: g=17.6, r=16.5, z=15.8 and EllipseWithPriors(0.25): log r_e=1.72301, ee1=0.242172, ee2=-0.107308 cat entry: tabledata object with 1 rows and 62 columns cat entry: tabledata object with 2 rows and 62 columns Reference source: ExpGalaxy at RaDecPos: RA, Dec = (122.39520, 41.97674) with NanoMaggies: g=16.4, r=15.4, z=14.8 and EllipseWithPriors(0.25): log r_e=1.13925, ee1=-0.0476849, ee2=0.306079 cat entry: tabledata object with 1 rows and 62 columns cat entry: tabledata object with 2 rows and 62 columns Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.13925, ee1=-0.0476849, ee2=0.306079 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.72301, ee1=0.242172, ee2=-0.107308 Measuring 8 iterative sources Blob 1 finished, total: Wall: 23.79 s, CPU: 23.74 s, VmPeak: 804 MB, VmSize: 734 MB, VmRSS: 158 MB, VmData: 189 MB, maxrss: 0.174668 MB Old catalog: 34 New catalog: 30 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/blobs-custom-122395p41976.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/metrics/cus/all-models-custom-122395p41976.fits Stage fitblobs : Wall: 27.27 s, CPU: 1.78 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 220 MB, VmData: 248 MB, maxrss: 0.225668 MB Stage fitblobs finished: 2020-08-13T13:31:53.069326 Resources for stage fitblobs : 28.760 s worker CPU, 29.263 s worker Wall, Wall: 27.274 s, Cores in use: 1.12, Total efficiency (on 32 cores): 3.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-13T13:31:53.084593 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-resid.jpg Stage coadds : Wall: 1.94 s, CPU: 0.58 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 221 MB, VmData: 248 MB, maxrss: 0.226204 MB Stage coadds finished: 2020-08-13T13:31:55.026942 Resources for stage coadds : 22.976 s worker CPU, 23.633 s worker Wall, Wall: 1.945 s, Cores in use: 12.11, Total efficiency (on 32 cores): 37.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-13T13:31:55.055624 Cut to 2 unWISE tiles Reading WISE tile 1213p424 band 1 Reading WISE tile 1213p424 band 2 Reading WISE tile 1213p424 band 3 Reading WISE tile 1213p424 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/121/1213p424/unwise-1213p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 1233p424 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 807 MB, VmSize: 800 MB, VmRSS: 145 MB, VmData: 178 MB, maxrss: 0.182808 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 807 MB, VmSize: 793 MB, VmRSS: 137 MB, VmData: 171 MB, maxrss: 0.198292 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 808 MB, VmSize: 793 MB, VmRSS: 138 MB, VmData: 171 MB, maxrss: 0.199168 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1233p424/unwise-1233p424-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 179 MB, maxrss: 0.204244 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/tmp-legacysurvey-custom-122395p41976-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.05 s, CPU: 0.45 s, VmPeak: 984 MB, VmSize: 984 MB, VmRSS: 222 MB, VmData: 248 MB, maxrss: 0.226908 MB Stage wise_forced finished: 2020-08-13T13:31:58.105897 Resources for stage wise_forced : 6.083 s worker CPU, 8.334 s worker Wall, Wall: 3.053 s, Cores in use: 2.14, Total efficiency (on 32 cores): 6.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-13T13:31:58.126843 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/coadd/cus/custom-122395p41976/legacysurvey-custom-122395p41976-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor-i/cus/tractor-custom-122395p41976.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/tractor-custom-122395p41976.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/tractor/cus/brick-custom-122395p41976.sha256sum Stage writecat : Wall: 0.77 s, CPU: 0.56 s, VmPeak: 1116 MB, VmSize: 988 MB, VmRSS: 223 MB, VmData: 248 MB, maxrss: 0.35992 MB Stage writecat finished: 2020-08-13T13:31:58.894957 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.771 s, Cores in use: 0.73, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC2190180_GROUP/PGC2190180_GROUP-largegalaxy-writecat.p All done: 66.038 s worker CPU, 81.823 s worker Wall, Wall: 45.345 s, Cores in use: 1.71, Total efficiency (on 32 cores): 5.3 % Finished galaxy PGC2190180_GROUP in 0.780 minutes.