Started working on galaxy PGC2103159 at Sun Jun 7 17:05:47 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.519515 37.5364 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T17:05:48.749956 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.519515', '37.5364', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.519515 37.5364 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.519515 37.5364 Starting process 8102 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 8103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 8105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 8106 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T17:05:49.343361 Keeping 10 CCDs: k4m_160424_113639_ooi_zd_ls9.fits.fz k4m_160424_113639_ooi_zd_ls9-CCD1 z exptime 81.104 propid 2016A seeing 0.97 MJD 57502.484 object MzLS_593534_z k4m_160424_113046_ooi_zd_ls9.fits.fz k4m_160424_113046_ooi_zd_ls9-CCD4 z exptime 80.103 propid 2016A seeing 1.02 MJD 57502.480 object MzLS_590551_z k4m_160427_114458_ooi_zd_ls9.fits.fz k4m_160427_114458_ooi_zd_ls9-CCD3 z exptime 80.102 propid 2016A-0453 seeing 0.78 MJD 57505.490 object MzLS_592542_z k4m_160420_114616_ooi_zd_ls9.fits.fz k4m_160420_114616_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.96 MJD 57498.490 object MzLS_591548_z ksb_160514_101213_ooi_r_ls9.fits.fz ksb_160514_101213_ooi_r_ls9-CCD3 r exptime 59.5 propid BASS seeing 1.02 MJD 57522.425 object 10972 ksb_160703_074505_ooi_g_ls9.fits.fz ksb_160703_074505_ooi_g_ls9-CCD3 g exptime 76.0 propid BASS seeing 1.16 MJD 57572.323 object 10972 ksb_180518_083724_ooi_r_ls9.fits.fz ksb_180518_083724_ooi_r_ls9-CCD2 r exptime 160.814 propid NOTBASS seeing 1.91 MJD 58256.359 object 12303 ksb_160702_084558_ooi_g_ls9.fits.fz ksb_160702_084558_ooi_g_ls9-CCD2 g exptime 112.6 propid BASS seeing 1.74 MJD 57571.365 object 12303 ksb_160603_091233_ooi_g_ls9.fits.fz ksb_160603_091233_ooi_g_ls9-CCD2 g exptime 91.4 propid BASS seeing 1.17 MJD 57542.384 object 12301 ksb_160531_085852_ooi_r_ls9.fits.fz ksb_160531_085852_ooi_r_ls9-CCD2 r exptime 59.1 propid BASS seeing 1.18 MJD 57539.374 object 12301 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 24 and amp range 0 2005 and image y 3819 4072 and amp range 2040 4078 Range in image: x 0 25 , y 0 254 (with image size 25 x 254) dzp -0.005990375 -> scaling image by 0.994497853444703 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 899 1190 and amp range 0 2047 and image y 2094 2384 and amp range 2022 4060 Range in image: x 0 292 , y 0 291 (with image size 292 x 291) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.01 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2484 2773 and amp range 2006 4053 and image y 1177 1468 and amp range 0 2039 Range in image: x 0 290 , y 0 292 (with image size 290 x 292) dzp -0.00064781494 -> scaling image by 0.9994035183523652 mosaic get_fwhm: self.fwhm = 3.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3628 3928 and amp range 2048 4095 and image y 2125 2420 and amp range 2022 4060 Range in image: x 0 301 , y 0 296 (with image size 301 x 296) dzp -0.0028835079 -> scaling image by 0.9973477146455455 Faked up EXPNUM 75720053 Faked up EXPNUM 75720053 Faked up EXPNUM 75720053 90prime get_fwhm: self.fwhm = 2.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1766 1933 and amp range 0 2015 and image y 141 309 and amp range 0 2047 Range in image: x 0 168 , y 0 169 (with image size 168 x 169) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 75220162 Faked up EXPNUM 75220162 Faked up EXPNUM 75220162 90prime get_fwhm: self.fwhm = 2.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1760 1927 and amp range 0 2015 and image y 168 335 and amp range 0 2047 Range in image: x 0 168 , y 0 168 (with image size 168 x 168) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 82560156 Faked up EXPNUM 82560156 Faked up EXPNUM 82560156 90prime get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1509 1677 and amp range 0 2015 and image y 1960 2128 and amp range 0 2047 Range in image: x 0 169 , y 0 88 (with image size 169 x 169) dzp -0.003875085 -> scaling image by 0.9964372765054066 Found overlap: image x 1509 1677 and amp range 0 2015 and image y 1960 2128 and amp range 2048 4095 Range in image: x 0 169 , y 88 169 (with image size 169 x 169) dzp 0.0503617 -> scaling image by 1.047477444828492 Faked up EXPNUM 75710110 Faked up EXPNUM 75710110 Faked up EXPNUM 75710110 90prime get_fwhm: self.fwhm = 3.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1515 1683 and amp range 0 2015 and image y 1980 2149 and amp range 0 2047 Range in image: x 0 169 , y 0 68 (with image size 169 x 170) dzp -0.008523628 -> scaling image by 0.992180183483648 Found overlap: image x 1515 1683 and amp range 0 2015 and image y 1980 2149 and amp range 2048 4095 Range in image: x 0 169 , y 68 170 (with image size 169 x 170) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75390182 Faked up EXPNUM 75390182 Faked up EXPNUM 75390182 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3515 3683 and amp range 2016 4031 and image y 3996 4080 and amp range 2048 4095 Range in image: x 0 169 , y 0 85 (with image size 169 x 85) dzp 0.0002007609 -> scaling image by 1.0001849247187462 Faked up EXPNUM 75420135 Faked up EXPNUM 75420135 Faked up EXPNUM 75420135 90prime get_fwhm: self.fwhm = 2.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3520 3688 and amp range 2016 4031 and image y 3989 4080 and amp range 2048 4095 Range in image: x 0 169 , y 0 92 (with image size 169 x 92) dzp 0.0026774607 -> scaling image by 1.002469075566243 Stage tims : Wall: 6.12 s, CPU: 0.95 s, VmPeak: 941 MB, VmSize: 941 MB, VmRSS: 172 MB, VmData: 205 MB, maxrss: 0.56826 MB Stage tims finished: 2020-06-07T17:05:55.465375 Resources for stage tims : 3.866 s worker CPU, 12.753 s worker Wall, Wall: 6.123 s, Cores in use: 0.79, Total efficiency (on 4 cores): 19.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T17:05:56.499231 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02466.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02594.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02467.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02338.fits Matched 1 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/reference-custom-277519p37536.fits Stage refs : Wall: 11.43 s, CPU: 8.88 s, VmPeak: 1040 MB, VmSize: 1034 MB, VmRSS: 267 MB, VmData: 297 MB, maxrss: 0.56826 MB Stage refs finished: 2020-06-07T17:06:07.928383 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.430 s, Cores in use: 0.78, Total efficiency (on 4 cores): 19.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T17:06:07.929938 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/outlier-mask-custom-277519p37536.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/outliers-pre-custom-277519p37536.jpg Image ksb_160702_084558_ooi_g_ls9-CCD2 g : masking 108 positive outlier pixels and 0 negative outlier pixels Image k4m_160424_113639_ooi_zd_ls9-CCD1 z : masking 119 positive outlier pixels and 0 negative outlier pixels Image k4m_160424_113046_ooi_zd_ls9-CCD4 z : masking 312 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/outlier-mask-custom-277519p37536.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/outliers-post-custom-277519p37536.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/outliers-masked-pos-custom-277519p37536.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/outliers-masked-neg-custom-277519p37536.jpg Stage outliers : Wall: 1.04 s, CPU: 0.72 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 280 MB, VmData: 309 MB, maxrss: 0.56826 MB Stage outliers finished: 2020-06-07T17:06:08.972919 Resources for stage outliers : 1.057 s worker CPU, 1.078 s worker Wall, Wall: 1.044 s, Cores in use: 1.71, Total efficiency (on 4 cores): 42.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T17:06:08.974462 Stage halos : Wall: 0.36 s, CPU: 0.34 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 280 MB, VmData: 309 MB, maxrss: 0.56826 MB Stage halos finished: 2020-06-07T17:06:09.334795 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.361 s, Cores in use: 0.96, Total efficiency (on 4 cores): 23.9 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T17:06:09.336644 PSF sigmas in coadd pixels: ['1.88', '2.83', '1.91'] Using average PSF sigma 2.2050847953714316 Gaussian PSF norm 0.12792922628916917 vs pixelized 0.10488015 average tim pixel scale / coadd scale: 1.7292114847361018 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.66', '3.10', '1.92'] Using average PSF sigma 2.225634717331697 Gaussian PSF norm 0.1267480191502765 vs pixelized 0.09994729 average tim pixel scale / coadd scale: 1.729792272778697 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.65', '1.27', '1.56'] Using average PSF sigma 1.5117267123649896 Gaussian PSF norm 0.18660435743214515 vs pixelized 0.1573675 average tim pixel scale / coadd scale: 0.9909487528929074 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.20 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.56826 MB Stage fit_on_coadds finished: 2020-06-07T17:06:09.584119 Resources for stage fit_on_coadds : 0.293 s worker CPU, 0.307 s worker Wall, Wall: 0.249 s, Cores in use: 1.98, Total efficiency (on 4 cores): 49.6 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T17:06:09.586858 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 70 potential peaks Of 70 potential peaks: 35 in veto map, 11 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 83 potential peaks Of 83 potential peaks: 65 in veto map, 12 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 84 potential peaks Of 84 potential peaks: 75 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 96 potential peaks Of 96 potential peaks: 82 in veto map, 11 cut by saddle test, 1 cut by aper test, 2 kept SED Flat : 2 new peaks Found 109 potential peaks Of 109 potential peaks: 94 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 33 new sources Median coadd sky for g : 0.0002933283 Median coadd sky for r : 0.00059694046 Median coadd sky for z : -7.059917e-05 Stage srcs : Wall: 0.80 s, CPU: 0.73 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.56826 MB Stage srcs finished: 2020-06-07T17:06:10.387568 Resources for stage srcs : 0.171 s worker CPU, 0.180 s worker Wall, Wall: 0.802 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/PGC2103159-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T17:06:10.401902 Blob 1 of 7, id: 0, sources: 35, size: 219x287, npix 45397, brick X: 68,287, Y: 0,287, one pixel: 162 0 Blob 2 of 7, id: 2, sources: 4, size: 34x59, npix 1445, brick X: 0,34, Y: 68,127, one pixel: 16 68 Blob 3 of 7, id: 1, sources: 2, size: 53x29, npix 957, brick X: 22,75, Y: 26,55, one pixel: 60 26 Blob 4 of 7, id: 3, sources: 2, size: 37x39, npix 750, brick X: 19,56, Y: 176,215, one pixel: 41 176 Blob 5 of 7, id: 5, sources: 1, size: 28x29, npix 565, brick X: 76,104, Y: 208,237, one pixel: 86 208 Blob 4 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143068 MB Blob 6 of 7, id: 4, sources: 1, size: 22x22, npix 294, brick X: 119,141, Y: 205,227, one pixel: 128 205 Blob 7 of 7, id: 6, sources: 2, size: 15x25, npix 260, brick X: 0,15, Y: 233,258, one pixel: 3 233 Blob 3 finished, total: Wall: 1.44 s, CPU: 1.43 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143128 MB Blob 6 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143128 MB Blob 5 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 812 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143068 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.53325, 37.54384), pm (-2.5, -5.8), parallax -0.097 with NanoMaggies: g=20, r=18.8, z=18.6 Reset brightness to NanoMaggies: g=19.1, r=18.5, z=18.3 Blob 7 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 811 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143128 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.53509, 37.53402), pm (2.9, 4.5), parallax 1.201 with NanoMaggies: g=12.7, r=12.6, z=(flux -282) Reset brightness to NanoMaggies: g=21.2, r=19.9, z=19.1 Measuring 1 iterative sources Blob 2 finished, total: Wall: 3.62 s, CPU: 3.62 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14364 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.51330, 37.53011), pm (-7.0, -16.2), parallax 1.456 with NanoMaggies: g=13.6, r=13.3, z=12.7 Reset brightness to NanoMaggies: g=13, r=12.7, z=12.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.07747, ee1=-0.303924, ee2=0.485121 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.50999, 37.52368), pm (0.6, 2.0), parallax 0.396 with NanoMaggies: g=20.3, r=19.6, z=19.2 Reset brightness to NanoMaggies: g=20.3, r=19.6, z=19.2 Measuring 1 iterative sources Blob 1 finished, total: Wall: 21.70 s, CPU: 21.69 s, VmPeak: 809 MB, VmSize: 752 MB, VmRSS: 189 MB, VmData: 218 MB, maxrss: 0.193424 MB Old catalog: 52 New catalog: 42 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/blobs-custom-277519p37536.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/metrics/cus/all-models-custom-277519p37536.fits Stage fitblobs : Wall: 22.19 s, CPU: 0.42 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 285 MB, VmData: 311 MB, maxrss: 0.56826 MB Stage fitblobs finished: 2020-06-07T17:06:32.589038 Resources for stage fitblobs : 28.994 s worker CPU, 29.080 s worker Wall, Wall: 22.191 s, Cores in use: 1.33, Total efficiency (on 4 cores): 33.1 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T17:06:32.593272 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/tmp-legacysurvey-custom-277519p37536-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/tmp-legacysurvey-custom-277519p37536-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/tmp-legacysurvey-custom-277519p37536-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/tmp-legacysurvey-custom-277519p37536-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-resid.jpg Stage coadds : Wall: 1.51 s, CPU: 0.65 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 285 MB, VmData: 311 MB, maxrss: 0.56826 MB Stage coadds finished: 2020-06-07T17:06:34.100755 Resources for stage coadds : 2.528 s worker CPU, 2.682 s worker Wall, Wall: 1.509 s, Cores in use: 2.10, Total efficiency (on 4 cores): 52.6 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T17:06:34.102540 Cut to 1 unWISE tiles Reading WISE tile 2766p378 band 1 Reading WISE tile 2766p378 band 3 Reading WISE tile 2766p378 band 2 Reading WISE tile 2766p378 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 809 MB, VmSize: 807 MB, VmRSS: 167 MB, VmData: 189 MB, maxrss: 0.213588 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 811 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212316 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 173 MB, maxrss: 0.212224 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2766p378/unwise-2766p378-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212272 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/tmp-legacysurvey-custom-277519p37536-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/tmp-legacysurvey-custom-277519p37536-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.67 s, CPU: 0.74 s, VmPeak: 1043 MB, VmSize: 1043 MB, VmRSS: 286 MB, VmData: 311 MB, maxrss: 0.56826 MB Stage wise_forced finished: 2020-06-07T17:06:36.774058 Resources for stage wise_forced : 5.116 s worker CPU, 6.456 s worker Wall, Wall: 2.673 s, Cores in use: 2.19, Total efficiency (on 4 cores): 54.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T17:06:36.776095 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/coadd/cus/custom-277519p37536/legacysurvey-custom-277519p37536-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/tractor-i/cus/tractor-custom-277519p37536.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/tractor/cus/tractor-custom-277519p37536.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC2103159/tractor/cus/brick-custom-277519p37536.sha256sum Stage writecat : Wall: 1.69 s, CPU: 0.61 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 288 MB, VmData: 311 MB, maxrss: 0.56826 MB Stage writecat finished: 2020-06-07T17:06:38.463380 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.688 s, Cores in use: 0.36, Total efficiency (on 4 cores): 9.1 % Stage writecat finished All done: 42.028 s worker CPU, 52.538 s worker Wall, Wall: 49.126 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.7 % Finished galaxy PGC2103159 in 0.861 minutes.