Started working on galaxy PGC2075140 at Wed Aug 5 20:48:53 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.37942749999996 36.111908 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:48:54.939352 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.37942749999996', '36.111908', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.37942749999996 36.111908 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.37942749999996 36.111908 Starting process 55104 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 55105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55106 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55107 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 55108 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 55109 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 55110 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 55111 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 55112 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 55113 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 55114 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 55115 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55116 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55117 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55118 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 55119 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:48:55.852980 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_160501_103847_ooi_zd_ls9-CCD2 z expnum 86240 exptime 88.103 propid 2016A-0453 seeing 1.10 MJD 57509.444 object MzLS_583493_z mosaic/CP/V4.3/CP20160430/k4m_160501_103847_ooi_zd_ls9.fits.fz k4m_170603_110439_ooi_zd_ls9-CCD1 z expnum 131529 exptime 90.104 propid 2016A-0453 seeing 0.86 MJD 57907.462 object MzLS_585521_z mosaic/CP/V4.3/CP20170602/k4m_170603_110439_ooi_zd_ls9.fits.fz k4m_170414_120946_ooi_zd_ls9-CCD4 z expnum 121912 exptime 84.106 propid 2016A-0453 seeing 0.81 MJD 57857.507 object MzLS_584508_z mosaic/CP/V4.3/CP20170413/k4m_170414_120946_ooi_zd_ls9.fits.fz ksb_160511_105540_ooi_r_ls9-CCD2 r expnum 75190248 exptime 56.0 propid BASS seeing 1.04 MJD 57519.455 object 09592 90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz ksb_160703_071935_ooi_g_ls9-CCD2 g expnum 75720041 exptime 74.4 propid BASS seeing 1.11 MJD 57572.305 object 09592 90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz ksb_160606_104535_ooi_g_ls9-CCD2 g expnum 75450149 exptime 250.0 propid BASS seeing 1.41 MJD 57545.448 object 09592 90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz ksb_160503_110310_ooi_g_ls9-CCD3 g expnum 75110183 exptime 90.0 propid BASS seeing 1.47 MJD 57511.461 object 09601 90prime/CP/V2.3/CP20160502/ksb_160503_110310_ooi_g_ls9.fits.fz ksb_160702_080412_ooi_g_ls9-CCD3 g expnum 75710096 exptime 124.3 propid BASS seeing 1.88 MJD 57571.336 object 09603 90prime/CP/V2.3/CP20160701/ksb_160702_080412_ooi_g_ls9.fits.fz ksb_160628_075640_ooi_r_ls9-CCD3 r expnum 75670114 exptime 142.4 propid BASS seeing 1.20 MJD 57567.331 object 09603 90prime/CP/V2.3/CP20160627/ksb_160628_075640_ooi_r_ls9.fits.fz ksb_160503_105821_ooi_g_ls9-CCD1 g expnum 75110181 exptime 89.8 propid BASS seeing 1.50 MJD 57511.457 object 09591 90prime/CP/V2.3/CP20160502/ksb_160503_105821_ooi_g_ls9.fits.fz ksb_160430_101915_ooi_r_ls9-CCD1 r expnum 75080178 exptime 126.4 propid BASS seeing 1.58 MJD 57508.430 object 09591 90prime/CP/V2.3/CP20160429/ksb_160430_101915_ooi_r_ls9.fits.fz Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 922 1076 and amp range 0 2015 and image y 2426 2579 and amp range 2048 4095 Range in image: x 0 155 , y 0 154 (with image size 155 x 154) dzp 0.016961161 -> scaling image by 1.0157444649385616 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3156 3309 and amp range 2016 4031 and image y 4015 4080 and amp range 2048 4095 Range in image: x 0 154 , y 0 66 (with image size 154 x 66) dzp -0.0012536051 -> scaling image by 0.9988460533227724 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1179 1332 and amp range 0 2015 and image y 1956 2109 and amp range 0 2047 Range in image: x 0 154 , y 0 92 (with image size 154 x 154) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 1179 1332 and amp range 0 2015 and image y 1956 2109 and amp range 2048 4095 Range in image: x 0 154 , y 92 154 (with image size 154 x 154) dzp -0.011545347 -> scaling image by 0.9894226798649194 mosaic get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 124 388 and amp range 0 2047 and image y 0 174 and amp range 0 2021 Range in image: x 0 265 , y 0 175 (with image size 265 x 175) dzp -0.018417627 -> scaling image by 0.9831798050134541 mosaic get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1684 1952 and amp range 0 2005 and image y 2771 3036 and amp range 2040 4078 Range in image: x 0 269 , y 0 266 (with image size 269 x 266) dzp 0.032569118 -> scaling image by 1.0304517167935139 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3106 3261 and amp range 2016 4031 and image y 434 589 and amp range 0 2047 Range in image: x 0 156 , y 0 156 (with image size 156 x 156) dzp -0.0041296566 -> scaling image by 0.9962036700684744 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 927 1080 and amp range 0 2015 and image y 2412 2565 and amp range 2048 4095 Range in image: x 0 154 , y 0 154 (with image size 154 x 154) dzp 0.01693853 -> scaling image by 1.015723292931903 mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2828 3099 and amp range 2048 4095 and image y 1199 1470 and amp range 0 2039 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.0072022504 -> scaling image by 1.0066555682883527 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3093 3248 and amp range 2016 4031 and image y 437 593 and amp range 0 2047 Range in image: x 0 156 , y 0 157 (with image size 156 x 157) dzp -0.0032519526 -> scaling image by 0.9970093219958882 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 90prime get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1165 1318 and amp range 0 2015 and image y 2009 2163 and amp range 0 2047 Range in image: x 0 154 , y 0 39 (with image size 154 x 155) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1165 1318 and amp range 0 2015 and image y 2009 2163 and amp range 2048 4095 Range in image: x 0 154 , y 39 155 (with image size 154 x 155) dzp -0.0045482004 -> scaling image by 0.9958197144381092 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 925 1079 and amp range 0 2015 and image y 2414 2568 and amp range 2048 4095 Range in image: x 0 155 , y 0 155 (with image size 155 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 6.52 s, CPU: 2.09 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179064 MB Stage tims finished: 2020-08-05T20:49:02.370374 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.513 s worker CPU, 27.547 s worker Wall, Wall: 6.519 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:49:02.473771 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/reference-custom-272379p36111.fits Stage refs : Wall: 14.19 s, CPU: 6.10 s, VmPeak: 1035 MB, VmSize: 1029 MB, VmRSS: 249 MB, VmData: 279 MB, maxrss: 0.254892 MB Stage refs finished: 2020-08-05T20:49:16.660280 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 14.188 s, Cores in use: 0.43, Total efficiency (on 16 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:49:16.702568 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outlier-mask-custom-272379p36111.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-pre-custom-272379p36111.jpg Image ksb_160606_104535_ooi_g_ls9-CCD2 g : masking 903 positive outlier pixels and 0 negative outlier pixels Image ksb_160503_105821_ooi_g_ls9-CCD1 g : masking 114 positive outlier pixels and 0 negative outlier pixels Image ksb_160430_101915_ooi_r_ls9-CCD1 r : masking 185 positive outlier pixels and 0 negative outlier pixels Image k4m_160501_103847_ooi_zd_ls9-CCD2 z : masking 411 positive outlier pixels and 0 negative outlier pixels Image k4m_170603_110439_ooi_zd_ls9-CCD1 z : masking 226 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outlier-mask-custom-272379p36111.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-post-custom-272379p36111.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-masked-pos-custom-272379p36111.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-masked-neg-custom-272379p36111.jpg Stage outliers : Wall: 1.64 s, CPU: 1.38 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 265 MB, VmData: 292 MB, maxrss: 0.271116 MB Stage outliers finished: 2020-08-05T20:49:18.339694 Resources for stage outliers : 0.891 s worker CPU, 0.957 s worker Wall, Wall: 1.638 s, Cores in use: 1.38, Total efficiency (on 16 cores): 8.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:49:18.453975 Stage halos : Wall: 1.21 s, CPU: 1.19 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 265 MB, VmData: 292 MB, maxrss: 0.271692 MB Stage halos finished: 2020-08-05T20:49:19.665680 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.213 s, Cores in use: 0.98, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:49:19.795298 PSF sigmas in coadd pixels: ['1.80', '2.29', '2.39', '3.05', '2.44'] Using average PSF sigma 2.3945774249550906 Gaussian PSF norm 0.11780566743594383 vs pixelized 0.09548406 average tim pixel scale / coadd scale: 1.7293466642527406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '1.95', '2.57'] Using average PSF sigma 2.0677903484144764 Gaussian PSF norm 0.1364233042243284 vs pixelized 0.11005315 average tim pixel scale / coadd scale: 1.7292885321284863 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.40', '1.32'] Using average PSF sigma 1.4997692893507988 Gaussian PSF norm 0.1880921244200085 vs pixelized 0.14947583 average tim pixel scale / coadd scale: 0.9909398384562885 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.17 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.274036 MB Stage fit_on_coadds finished: 2020-08-05T20:49:19.990628 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.218 s worker CPU, 0.218 s worker Wall, Wall: 0.197 s, Cores in use: 1.98, Total efficiency (on 16 cores): 12.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:49:20.009423 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 47 potential peaks Of 47 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 116 potential peaks Of 116 potential peaks: 111 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 84 potential peaks Of 84 potential peaks: 78 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 60 potential peaks Of 60 potential peaks: 52 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 57 potential peaks Of 57 potential peaks: 51 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 28 new sources Median coadd sky for g : 0.00016902335 Median coadd sky for r : 0.00021423437 Median coadd sky for z : 4.7750837e-05 Stage srcs : Wall: 0.83 s, CPU: 0.79 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.274612 MB Stage srcs finished: 2020-08-05T20:49:20.840465 Resources for stage srcs : 0.088 s worker CPU, 0.088 s worker Wall, Wall: 0.832 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:49:20.855039 Blob 1 of 16, id: 1, sources: 17, size: 186x205, npix 21744, brick X: 64,250, Y: 0,205, one pixel: 162 0 Blob 2 of 16, id: 6, sources: 1, size: 34x41, npix 1025, brick X: 0,34, Y: 141,182, one pixel: 10 141 Blob 3 of 16, id: 0, sources: 3, size: 38x34, npix 968, brick X: 0,38, Y: 0,34, one pixel: 0 0 Blob 4 of 16, id: 12, sources: 3, size: 51x30, npix 854, brick X: 37,88, Y: 221,251, one pixel: 71 221 Blob 5 of 16, id: 13, sources: 1, size: 27x32, npix 580, brick X: 205,232, Y: 231,263, one pixel: 214 231 Blob 6 of 16, id: 8, sources: 2, size: 25x29, npix 512, brick X: 0,25, Y: 190,219, one pixel: 6 190 Blob 7 of 16, id: 14, sources: 1, size: 25x24, npix 403, brick X: 158,183, Y: 239,263, one pixel: 167 239 Blob 8 of 16, id: 5, sources: 1, size: 24x24, npix 353, brick X: 3,27, Y: 112,136, one pixel: 13 112 Blob 9 of 16, id: 11, sources: 1, size: 24x24, npix 350, brick X: 109,133, Y: 220,244, one pixel: 121 220 Blob 10 of 16, id: 9, sources: 1, size: 23x24, npix 326, brick X: 187,210, Y: 195,219, one pixel: 198 195 Blob 11 of 16, id: 2, sources: 1, size: 22x23, npix 295, brick X: 112,134, Y: 2,25, one pixel: 121 2 Blob 12 of 16, id: 10, sources: 1, size: 23x21, npix 293, brick X: 240,263, Y: 205,226, one pixel: 250 205 Blob 13 of 16, id: 4, sources: 1, size: 22x21, npix 270, brick X: 18,40, Y: 58,79, one pixel: 27 58 Blob 14 of 16, id: 7, sources: 1, size: 22x22, npix 270, brick X: 57,79, Y: 148,170, one pixel: 66 148 Blob 15 of 16, id: 15, sources: 2, size: 25x15, npix 267, brick X: 81,106, Y: 248,263, one pixel: 91 248 Blob 16 of 16, id: 3, sources: 1, size: 17x17, npix 145, brick X: 69,86, Y: 55,72, one pixel: 77 55 Blob 16 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 814 MB, VmSize: 731 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14866 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.38289, 36.12196), pm (-2.8, 0.5), parallax 0.103 with NanoMaggies: g=19.6, r=18.6, z=19.2 Reset brightness to NanoMaggies: g=19.4, r=18.8, z=18.6 Blob 15 finished, total: Wall: 0.18 s, CPU: 0.17 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150696 MB Blob 11 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09364 MB Blob 12 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151368 MB Blob 13 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150456 MB Blob 10 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095584 MB Blob 14 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 816 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.151036 MB Blob 9 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 788 MB, VmSize: 719 MB, VmRSS: 135 MB, VmData: 171 MB, maxrss: 0.138528 MB Blob 8 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.1513 MB Blob 5 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.096936 MB Blob 7 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 93 MB, VmData: 138 MB, maxrss: 0.094836 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.39072, 36.10218), pm (-3.9, -8.1), parallax 0.693 with NanoMaggies: g=18.2, r=17.2, z=16.9 Reset brightness to NanoMaggies: g=18.1, r=17.2, z=16.7 Blob 3 finished, total: Wall: 0.86 s, CPU: 0.85 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150896 MB Blob 6 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15046 MB Blob 2 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094772 MB Blob 4 finished, total: Wall: 1.33 s, CPU: 1.33 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14988 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.07779, ee1=0.0703607, ee2=0.245578 Measuring 1 iterative sources Blob 1 finished, total: Wall: 11.21 s, CPU: 11.21 s, VmPeak: 810 MB, VmSize: 737 MB, VmRSS: 161 MB, VmData: 189 MB, maxrss: 0.16438 MB Old catalog: 49 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/blobs-custom-272379p36111.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/all-models-custom-272379p36111.fits Stage fitblobs : Wall: 11.75 s, CPU: 0.52 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.27494 MB Stage fitblobs finished: 2020-08-05T20:49:32.606038 Resources for stage fitblobs : 19.604 s worker CPU, 19.706 s worker Wall, Wall: 11.752 s, Cores in use: 1.71, Total efficiency (on 16 cores): 10.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:49:32.628142 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/tmp-legacysurvey-custom-272379p36111-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/tmp-legacysurvey-custom-272379p36111-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/tmp-legacysurvey-custom-272379p36111-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/tmp-legacysurvey-custom-272379p36111-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-resid.jpg Stage coadds : Wall: 3.89 s, CPU: 1.76 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 269 MB, VmData: 293 MB, maxrss: 0.275264 MB Stage coadds finished: 2020-08-05T20:49:36.519104 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.592 s worker CPU, 13.518 s worker Wall, Wall: 3.892 s, Cores in use: 2.66, Total efficiency (on 16 cores): 16.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T20:49:36.536029 Cut to 1 unWISE tiles Reading WISE tile 2723p363 band 1 Reading WISE tile 2723p363 band 2 Reading WISE tile 2723p363 band 3 Reading WISE tile 2723p363 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 811 MB, VmSize: 809 MB, VmRSS: 154 MB, VmData: 177 MB, maxrss: 0.196912 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 813 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.2074 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 804 MB, VmRSS: 148 MB, VmData: 171 MB, maxrss: 0.21282 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.209648 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/tmp-legacysurvey-custom-272379p36111-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/tmp-legacysurvey-custom-272379p36111-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.99 s, CPU: 0.72 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 269 MB, VmData: 293 MB, maxrss: 0.275776 MB Stage wise_forced finished: 2020-08-05T20:49:40.525676 Resources for stage wise_forced : 2.998 s worker CPU, 5.816 s worker Wall, Wall: 3.991 s, Cores in use: 0.93, Total efficiency (on 16 cores): 5.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:49:40.556395 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/tractor-i/cus/tractor-custom-272379p36111.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/tractor/cus/tractor-custom-272379p36111.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/tractor/cus/brick-custom-272379p36111.sha256sum Stage writecat : Wall: 2.96 s, CPU: 2.07 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 271 MB, VmData: 293 MB, maxrss: 0.408704 MB Stage writecat finished: 2020-08-05T20:49:43.518480 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.964 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-writecat.p All done: 38.909 s worker CPU, 67.855 s worker Wall, Wall: 47.700 s, Cores in use: 1.17, Total efficiency (on 16 cores): 7.3 % Finished galaxy PGC2075140 in 0.844 minutes. Started working on galaxy PGC2075140 at Wed Aug 5 22:15:41 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.37942749999996 36.111908 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:15:43.040013 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.37942749999996', '36.111908', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.37942749999996 36.111908 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.37942749999996 36.111908 Starting process 5573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 5574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 5575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 5576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 5577 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 5578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 5579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 5580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 5582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 5583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 5584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 5585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 5586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 5590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 5591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 5592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 5593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 5594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 5595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 5596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 5597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 5598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 5599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 5600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 5601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 5602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 5603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 5604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:15:43.518729 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_160501_103847_ooi_zd_ls9-CCD2 z expnum 86240 exptime 88.103 propid 2016A-0453 seeing 1.10 MJD 57509.444 object MzLS_583493_z mosaic/CP/V4.3/CP20160430/k4m_160501_103847_ooi_zd_ls9.fits.fz k4m_170603_110439_ooi_zd_ls9-CCD1 z expnum 131529 exptime 90.104 propid 2016A-0453 seeing 0.86 MJD 57907.462 object MzLS_585521_z mosaic/CP/V4.3/CP20170602/k4m_170603_110439_ooi_zd_ls9.fits.fz k4m_170414_120946_ooi_zd_ls9-CCD4 z expnum 121912 exptime 84.106 propid 2016A-0453 seeing 0.81 MJD 57857.507 object MzLS_584508_z mosaic/CP/V4.3/CP20170413/k4m_170414_120946_ooi_zd_ls9.fits.fz ksb_160511_105540_ooi_r_ls9-CCD2 r expnum 75190248 exptime 56.0 propid BASS seeing 1.04 MJD 57519.455 object 09592 90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz ksb_160703_071935_ooi_g_ls9-CCD2 g expnum 75720041 exptime 74.4 propid BASS seeing 1.11 MJD 57572.305 object 09592 90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz ksb_160606_104535_ooi_g_ls9-CCD2 g expnum 75450149 exptime 250.0 propid BASS seeing 1.41 MJD 57545.448 object 09592 90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz ksb_160503_110310_ooi_g_ls9-CCD3 g expnum 75110183 exptime 90.0 propid BASS seeing 1.47 MJD 57511.461 object 09601 90prime/CP/V2.3/CP20160502/ksb_160503_110310_ooi_g_ls9.fits.fz ksb_160702_080412_ooi_g_ls9-CCD3 g expnum 75710096 exptime 124.3 propid BASS seeing 1.88 MJD 57571.336 object 09603 90prime/CP/V2.3/CP20160701/ksb_160702_080412_ooi_g_ls9.fits.fz ksb_160628_075640_ooi_r_ls9-CCD3 r expnum 75670114 exptime 142.4 propid BASS seeing 1.20 MJD 57567.331 object 09603 90prime/CP/V2.3/CP20160627/ksb_160628_075640_ooi_r_ls9.fits.fz ksb_160503_105821_ooi_g_ls9-CCD1 g expnum 75110181 exptime 89.8 propid BASS seeing 1.50 MJD 57511.457 object 09591 90prime/CP/V2.3/CP20160502/ksb_160503_105821_ooi_g_ls9.fits.fz ksb_160430_101915_ooi_r_ls9-CCD1 r expnum 75080178 exptime 126.4 propid BASS seeing 1.58 MJD 57508.430 object 09591 90prime/CP/V2.3/CP20160429/ksb_160430_101915_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1684 1952 and amp range 0 2005 and image y 2771 3036 and amp range 2040 4078 Range in image: x 0 269 , y 0 266 (with image size 269 x 266) dzp 0.032569118 -> scaling image by 1.0304517167935139 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 925 1079 and amp range 0 2015 and image y 2414 2568 and amp range 2048 4095 Range in image: x 0 155 , y 0 155 (with image size 155 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1179 1332 and amp range 0 2015 and image y 1956 2109 and amp range 0 2047 Range in image: x 0 154 , y 0 92 (with image size 154 x 154) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 1179 1332 and amp range 0 2015 and image y 1956 2109 and amp range 2048 4095 Range in image: x 0 154 , y 92 154 (with image size 154 x 154) dzp -0.011545347 -> scaling image by 0.9894226798649194 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3093 3248 and amp range 2016 4031 and image y 437 593 and amp range 0 2047 Range in image: x 0 156 , y 0 157 (with image size 156 x 157) dzp -0.0032519526 -> scaling image by 0.9970093219958882 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2828 3099 and amp range 2048 4095 and image y 1199 1470 and amp range 0 2039 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 922 1076 and amp range 0 2015 and image y 2426 2579 and amp range 2048 4095 Range in image: x 0 155 , y 0 154 (with image size 155 x 154) dzp 0.016961161 -> scaling image by 1.0157444649385616 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 927 1080 and amp range 0 2015 and image y 2412 2565 and amp range 2048 4095 Range in image: x 0 154 , y 0 154 (with image size 154 x 154) dzp 0.01693853 -> scaling image by 1.015723292931903 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 90prime get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1165 1318 and amp range 0 2015 and image y 2009 2163 and amp range 0 2047 Range in image: x 0 154 , y 0 39 (with image size 154 x 155) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1165 1318 and amp range 0 2015 and image y 2009 2163 and amp range 2048 4095 Range in image: x 0 154 , y 39 155 (with image size 154 x 155) dzp -0.0045482004 -> scaling image by 0.9958197144381092 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3156 3309 and amp range 2016 4031 and image y 4015 4080 and amp range 2048 4095 Range in image: x 0 154 , y 0 66 (with image size 154 x 66) dzp -0.0012536051 -> scaling image by 0.9988460533227724 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 124 388 and amp range 0 2047 and image y 0 174 and amp range 0 2021 Range in image: x 0 265 , y 0 175 (with image size 265 x 175) dzp -0.018417627 -> scaling image by 0.9831798050134541 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3106 3261 and amp range 2016 4031 and image y 434 589 and amp range 0 2047 Range in image: x 0 156 , y 0 156 (with image size 156 x 156) dzp -0.0041296566 -> scaling image by 0.9962036700684744 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 9.04 s, CPU: 0.92 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 175 MB, VmData: 207 MB, maxrss: 0.179404 MB Stage tims finished: 2020-08-05T22:15:52.555592 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.005 s worker CPU, 31.742 s worker Wall, Wall: 9.040 s, Cores in use: 0.77, Total efficiency (on 32 cores): 2.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-05T22:15:59.209301 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 8 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/reference-custom-272379p36111.fits Stage refs : Wall: 14.86 s, CPU: 6.89 s, VmPeak: 1035 MB, VmSize: 1029 MB, VmRSS: 249 MB, VmData: 279 MB, maxrss: 0.254948 MB Stage refs finished: 2020-08-05T22:16:14.065492 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 14.858 s, Cores in use: 0.46, Total efficiency (on 32 cores): 1.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-refs.p Running stage outliers WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T22:16:14.232231 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outlier-mask-custom-272379p36111.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-pre-custom-272379p36111.jpg Image ksb_160606_104535_ooi_g_ls9-CCD2 g : masking 903 positive outlier pixels and 0 negative outlier pixels Image ksb_160503_105821_ooi_g_ls9-CCD1 g : masking 114 positive outlier pixels and 0 negative outlier pixels Image ksb_160430_101915_ooi_r_ls9-CCD1 r : masking 185 positive outlier pixels and 0 negative outlier pixels Image k4m_170603_110439_ooi_zd_ls9-CCD1 z : masking 226 positive outlier pixels and 0 negative outlier pixels Image k4m_160501_103847_ooi_zd_ls9-CCD2 z : masking 411 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outlier-mask-custom-272379p36111.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-post-custom-272379p36111.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-masked-pos-custom-272379p36111.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/outliers-masked-neg-custom-272379p36111.jpg Stage outliers : Wall: 1.00 s, CPU: 0.62 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 265 MB, VmData: 292 MB, maxrss: 0.271764 MB Stage outliers finished: 2020-08-05T22:16:15.230231 Resources for stage outliers : 1.083 s worker CPU, 1.362 s worker Wall, Wall: 1.000 s, Cores in use: 1.70, Total efficiency (on 32 cores): 5.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:16:15.382897 Stage halos : Wall: 0.31 s, CPU: 0.30 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 266 MB, VmData: 293 MB, maxrss: 0.272204 MB Stage halos finished: 2020-08-05T22:16:15.695380 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.315 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T22:16:15.792613 PSF sigmas in coadd pixels: ['1.80', '2.29', '2.39', '3.05', '2.44'] Using average PSF sigma 2.3945774249550906 Gaussian PSF norm 0.11780566743594383 vs pixelized 0.09548406 average tim pixel scale / coadd scale: 1.7293466642527406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '1.95', '2.57'] Using average PSF sigma 2.0677903484144764 Gaussian PSF norm 0.1364233042243284 vs pixelized 0.11005313 average tim pixel scale / coadd scale: 1.7292885321284863 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.40', '1.32'] Using average PSF sigma 1.4997692893507988 Gaussian PSF norm 0.1880921244200085 vs pixelized 0.14947583 average tim pixel scale / coadd scale: 0.9909398384562885 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.27434 MB Stage fit_on_coadds finished: 2020-08-05T22:16:15.968004 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.183 s worker CPU, 0.183 s worker Wall, Wall: 0.178 s, Cores in use: 2.00, Total efficiency (on 32 cores): 6.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:16:15.983069 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 47 potential peaks Of 47 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 116 potential peaks Of 116 potential peaks: 111 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 84 potential peaks Of 84 potential peaks: 78 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 60 potential peaks Of 60 potential peaks: 52 in veto map, 3 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 63 potential peaks Of 63 potential peaks: 57 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 28 new sources Median coadd sky for g : 0.00016902335 Median coadd sky for r : 0.00021423436 Median coadd sky for z : 4.7750837e-05 Stage srcs : Wall: 0.58 s, CPU: 0.53 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 293 MB, maxrss: 0.274844 MB Stage srcs finished: 2020-08-05T22:16:16.566074 Resources for stage srcs : 0.111 s worker CPU, 0.111 s worker Wall, Wall: 0.585 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:16:16.581386 Blob 1 of 16, id: 1, sources: 17, size: 186x205, npix 21744, brick X: 64,250, Y: 0,205, one pixel: 162 0 Blob 2 of 16, id: 6, sources: 1, size: 34x41, npix 1025, brick X: 0,34, Y: 141,182, one pixel: 10 141 Blob 3 of 16, id: 0, sources: 3, size: 38x34, npix 968, brick X: 0,38, Y: 0,34, one pixel: 0 0 Blob 4 of 16, id: 12, sources: 3, size: 51x30, npix 854, brick X: 37,88, Y: 221,251, one pixel: 71 221 Blob 5 of 16, id: 13, sources: 1, size: 27x32, npix 580, brick X: 205,232, Y: 231,263, one pixel: 214 231 Blob 6 of 16, id: 8, sources: 2, size: 25x29, npix 512, brick X: 0,25, Y: 190,219, one pixel: 6 190 Blob 7 of 16, id: 14, sources: 1, size: 25x24, npix 403, brick X: 158,183, Y: 239,263, one pixel: 167 239 Blob 8 of 16, id: 5, sources: 1, size: 24x24, npix 353, brick X: 3,27, Y: 112,136, one pixel: 13 112 Blob 9 of 16, id: 11, sources: 1, size: 24x24, npix 350, brick X: 109,133, Y: 220,244, one pixel: 121 220 Blob 10 of 16, id: 9, sources: 1, size: 23x24, npix 326, brick X: 187,210, Y: 195,219, one pixel: 198 195 Blob 11 of 16, id: 2, sources: 1, size: 22x23, npix 295, brick X: 112,134, Y: 2,25, one pixel: 121 2 Blob 12 of 16, id: 10, sources: 1, size: 23x21, npix 293, brick X: 240,263, Y: 205,226, one pixel: 250 205 Blob 13 of 16, id: 4, sources: 1, size: 22x21, npix 270, brick X: 18,40, Y: 58,79, one pixel: 27 58 Blob 14 of 16, id: 7, sources: 1, size: 22x22, npix 270, brick X: 57,79, Y: 148,170, one pixel: 66 148 Blob 15 of 16, id: 15, sources: 2, size: 25x15, npix 267, brick X: 81,106, Y: 248,263, one pixel: 91 248 Blob 16 of 16, id: 3, sources: 1, size: 17x17, npix 145, brick X: 69,86, Y: 55,72, one pixel: 77 55 Blob 16 finished, total: Wall: 0.04 s, CPU: 0.04 s, VmPeak: 813 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.1506 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.38289, 36.12196), pm (-2.8, 0.5), parallax 0.103 with NanoMaggies: g=19.6, r=18.6, z=19.2 Reset brightness to NanoMaggies: g=19.4, r=18.8, z=18.6 Blob 15 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150632 MB Blob 11 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091744 MB Blob 12 finished, total: Wall: 0.21 s, CPU: 0.20 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096328 MB Blob 10 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 810 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15096 MB Blob 13 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 811 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150724 MB Blob 14 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092812 MB Blob 8 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09354 MB Blob 9 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092404 MB Blob 7 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.09522 MB Blob 5 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15058 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.39072, 36.10218), pm (-3.9, -8.1), parallax 0.693 with NanoMaggies: g=18.2, r=17.2, z=16.9 Reset brightness to NanoMaggies: g=18.1, r=17.2, z=16.7 Blob 3 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092784 MB Blob 2 finished, total: Wall: 0.80 s, CPU: 0.79 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094684 MB Blob 6 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09664 MB Blob 4 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 814 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151228 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.07779, ee1=0.0703606, ee2=0.245578 Measuring 1 iterative sources Blob 1 finished, total: Wall: 11.67 s, CPU: 11.67 s, VmPeak: 701 MB, VmSize: 691 MB, VmRSS: 124 MB, VmData: 162 MB, maxrss: 0.135376 MB Old catalog: 49 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/blobs-custom-272379p36111.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/metrics/cus/all-models-custom-272379p36111.fits Stage fitblobs : Wall: 16.67 s, CPU: 0.41 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 269 MB, VmData: 293 MB, maxrss: 0.275172 MB Stage fitblobs finished: 2020-08-05T22:16:33.246449 Resources for stage fitblobs : 18.899 s worker CPU, 19.046 s worker Wall, Wall: 16.667 s, Cores in use: 1.16, Total efficiency (on 32 cores): 3.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:16:33.264383 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/272/PGC2075140/coadd/cus/custom-272379p36111/legacysurvey-custom-272379p36111-blobmodel-r.fits.fz Started working on galaxy PGC2075140 at Fri Aug 7 09:20:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:20:27.085276 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.3784680246166', '36.110269344691304', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.3784680246166 36.110269344691304 Starting process 26769 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 26770 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 26771 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 26772 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 26773 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 26774 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 26775 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 26776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 26777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 26778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 26779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 26780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 26781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 26782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 26783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 26784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p and forcing stage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T09:20:27.482129 Keeping 11 CCDs: k4m_160501_103847_ooi_zd_ls9-CCD2 z expnum 86240 exptime 88.103 propid 2016A-0453 seeing 1.10 MJD 57509.444 object MzLS_583493_z mosaic/CP/V4.3/CP20160430/k4m_160501_103847_ooi_zd_ls9.fits.fz k4m_170603_110439_ooi_zd_ls9-CCD1 z expnum 131529 exptime 90.104 propid 2016A-0453 seeing 0.86 MJD 57907.462 object MzLS_585521_z mosaic/CP/V4.3/CP20170602/k4m_170603_110439_ooi_zd_ls9.fits.fz k4m_170414_120946_ooi_zd_ls9-CCD4 z expnum 121912 exptime 84.106 propid 2016A-0453 seeing 0.81 MJD 57857.507 object MzLS_584508_z mosaic/CP/V4.3/CP20170413/k4m_170414_120946_ooi_zd_ls9.fits.fz ksb_160511_105540_ooi_r_ls9-CCD2 r expnum 75190248 exptime 56.0 propid BASS seeing 1.04 MJD 57519.455 object 09592 90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz ksb_160703_071935_ooi_g_ls9-CCD2 g expnum 75720041 exptime 74.4 propid BASS seeing 1.11 MJD 57572.305 object 09592 90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz ksb_160606_104535_ooi_g_ls9-CCD2 g expnum 75450149 exptime 250.0 propid BASS seeing 1.41 MJD 57545.448 object 09592 90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz ksb_160503_110310_ooi_g_ls9-CCD3 g expnum 75110183 exptime 90.0 propid BASS seeing 1.47 MJD 57511.461 object 09601 90prime/CP/V2.3/CP20160502/ksb_160503_110310_ooi_g_ls9.fits.fz ksb_160702_080412_ooi_g_ls9-CCD3 g expnum 75710096 exptime 124.3 propid BASS seeing 1.88 MJD 57571.336 object 09603 90prime/CP/V2.3/CP20160701/ksb_160702_080412_ooi_g_ls9.fits.fz ksb_160628_075640_ooi_r_ls9-CCD3 r expnum 75670114 exptime 142.4 propid BASS seeing 1.20 MJD 57567.331 object 09603 90prime/CP/V2.3/CP20160627/ksb_160628_075640_ooi_r_ls9.fits.fz ksb_160503_105821_ooi_g_ls9-CCD1 g expnum 75110181 exptime 89.8 propid BASS seeing 1.50 MJD 57511.457 object 09591 90prime/CP/V2.3/CP20160502/ksb_160503_105821_ooi_g_ls9.fits.fz ksb_160430_101915_ooi_r_ls9-CCD1 r expnum 75080178 exptime 126.4 propid BASS seeing 1.58 MJD 57508.430 object 09591 90prime/CP/V2.3/CP20160429/ksb_160430_101915_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2806 3076 and amp range 2048 4095 and image y 1189 1460 and amp range 0 2039 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0072022504 -> scaling image by 1.0066555682883527 mosaic get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 101 365 and amp range 0 2047 and image y 0 163 and amp range 0 2021 Range in image: x 0 265 , y 0 164 (with image size 265 x 164) dzp -0.018417627 -> scaling image by 0.9831798050134541 mosaic get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1661 1929 and amp range 0 2005 and image y 2761 3025 and amp range 2040 4078 Range in image: x 0 269 , y 0 265 (with image size 269 x 265) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3119 3274 and amp range 2016 4031 and image y 440 595 and amp range 0 2047 Range in image: x 0 156 , y 0 156 (with image size 156 x 156) dzp -0.0041296566 -> scaling image by 0.9962036700684744 Found overlap: image x 935 1089 and amp range 0 2015 and image y 2432 2585 and amp range 2048 4095 Range in image: x 0 155 , y 0 154 (with image size 155 x 154) dzp 0.016961161 -> scaling image by 1.0157444649385616 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 940 1093 and amp range 0 2015 and image y 2418 2572 and amp range 2048 4095 Range in image: x 0 154 , y 0 155 (with image size 154 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 938 1092 and amp range 0 2015 and image y 2420 2574 and amp range 2048 4095 Range in image: x 0 155 , y 0 155 (with image size 155 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3106 3261 and amp range 2016 4031 and image y 443 599 and amp range 0 2047 Range in image: x 0 156 , y 0 157 (with image size 156 x 157) dzp -0.0032519526 -> scaling image by 0.9970093219958882 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3169 3322 and amp range 2016 4031 and image y 4021 4080 and amp range 2048 4095 Range in image: x 0 154 , y 0 60 (with image size 154 x 60) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 0 2047 Range in image: x 0 154 , y 0 86 (with image size 154 x 155) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 2048 4095 Range in image: x 0 154 , y 86 155 (with image size 154 x 155) dzp -0.011545347 -> scaling image by 0.9894226798649194 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 90prime get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 0 2047 Range in image: x 0 154 , y 0 32 (with image size 154 x 154) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 2048 4095 Range in image: x 0 154 , y 32 154 (with image size 154 x 154) dzp -0.0045482004 -> scaling image by 0.9958197144381092 Stage tims : Wall: 127.87 s, CPU: 1.00 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.1773 MB Stage tims finished: 2020-08-07T09:22:35.348231 Resources for stage tims : 5.597 s worker CPU, 625.664 s worker Wall, Wall: 127.868 s, Cores in use: 0.05, Total efficiency (on 16 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:22:35.407537 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/reference-custom-272378p36110.fits Stage refs : Wall: 7.55 s, CPU: 6.06 s, VmPeak: 1028 MB, VmSize: 1023 MB, VmRSS: 247 MB, VmData: 278 MB, maxrss: 0.253372 MB Stage refs finished: 2020-08-07T09:22:42.956735 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.551 s, Cores in use: 0.80, Total efficiency (on 16 cores): 5.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:22:42.983157 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/outlier-mask-custom-272378p36110.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/outliers-pre-custom-272378p36110.jpg Image ksb_160606_104535_ooi_g_ls9-CCD2 g : masking 1047 positive outlier pixels and 0 negative outlier pixels Image ksb_160503_105821_ooi_g_ls9-CCD1 g : masking 112 positive outlier pixels and 0 negative outlier pixels Image ksb_160430_101915_ooi_r_ls9-CCD1 r : masking 126 positive outlier pixels and 0 negative outlier pixels Image k4m_170603_110439_ooi_zd_ls9-CCD1 z : masking 229 positive outlier pixels and 0 negative outlier pixels Image k4m_160501_103847_ooi_zd_ls9-CCD2 z : masking 397 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/outlier-mask-custom-272378p36110.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/outliers-post-custom-272378p36110.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/outliers-masked-pos-custom-272378p36110.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/outliers-masked-neg-custom-272378p36110.jpg Stage outliers : Wall: 0.85 s, CPU: 0.64 s, VmPeak: 1032 MB, VmSize: 1032 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.267952 MB Stage outliers finished: 2020-08-07T09:22:43.828725 Resources for stage outliers : 0.880 s worker CPU, 0.969 s worker Wall, Wall: 0.847 s, Cores in use: 1.80, Total efficiency (on 16 cores): 11.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:22:43.891231 Stage halos : Wall: 0.29 s, CPU: 0.28 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.268248 MB Stage halos finished: 2020-08-07T09:22:44.186102 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.296 s, Cores in use: 0.95, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:22:44.314028 PSF sigmas in coadd pixels: ['1.80', '2.29', '2.39', '3.05', '2.44'] Using average PSF sigma 2.3945774249550906 Gaussian PSF norm 0.11780566743594383 vs pixelized 0.09547798 average tim pixel scale / coadd scale: 1.7293466642527406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '1.95', '2.57'] Using average PSF sigma 2.0677903484144764 Gaussian PSF norm 0.1364233042243284 vs pixelized 0.11007217 average tim pixel scale / coadd scale: 1.7292885321284863 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.40', '1.32'] Using average PSF sigma 1.4997692893507988 Gaussian PSF norm 0.1880921244200085 vs pixelized 0.1494749 average tim pixel scale / coadd scale: 0.9909398384562885 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.17 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 264 MB, VmData: 291 MB, maxrss: 0.270636 MB Stage fit_on_coadds finished: 2020-08-07T09:22:44.493125 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.210 s worker CPU, 0.210 s worker Wall, Wall: 0.181 s, Cores in use: 2.10, Total efficiency (on 16 cores): 13.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:22:44.505314 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 39 potential peaks Of 39 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 111 potential peaks Of 111 potential peaks: 107 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 89 potential peaks Of 89 potential peaks: 82 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 52 potential peaks Of 52 potential peaks: 42 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 55 potential peaks Of 55 potential peaks: 45 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 24 new sources Median coadd sky for g : 0.00028330926 Median coadd sky for r : 0.00024959742 Median coadd sky for z : -4.369298e-06 Stage srcs : Wall: 0.56 s, CPU: 0.52 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 265 MB, VmData: 291 MB, maxrss: 0.27124 MB Stage srcs finished: 2020-08-07T09:22:45.063905 Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 0.560 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:22:45.075790 Blob 1 of 16, id: 2, sources: 16, size: 184x222, npix 22011, brick X: 53,237, Y: 6,228, one pixel: 169 6 Blob 2 of 16, id: 0, sources: 3, size: 27x57, npix 1077, brick X: 0,27, Y: 0,57, one pixel: 3 0 Blob 3 of 16, id: 4, sources: 1, size: 25x38, npix 681, brick X: 238,263, Y: 60,98, one pixel: 250 60 Blob 4 of 16, id: 9, sources: 1, size: 23x37, npix 644, brick X: 0,23, Y: 166,203, one pixel: 4 166 Blob 5 of 16, id: 11, sources: 2, size: 29x35, npix 528, brick X: 229,258, Y: 214,249, one pixel: 246 214 Blob 6 of 16, id: 14, sources: 1, size: 27x20, npix 374, brick X: 50,77, Y: 243,263, one pixel: 62 243 Blob 7 of 16, id: 13, sources: 1, size: 24x23, npix 320, brick X: 176,200, Y: 218,241, one pixel: 186 218 Blob 8 of 16, id: 15, sources: 1, size: 24x20, npix 319, brick X: 98,122, Y: 243,263, one pixel: 109 243 Blob 9 of 16, id: 3, sources: 1, size: 22x23, npix 305, brick X: 101,123, Y: 24,47, one pixel: 111 24 Blob 10 of 16, id: 6, sources: 1, size: 22x21, npix 269, brick X: 8,30, Y: 80,101, one pixel: 18 80 Blob 11 of 16, id: 10, sources: 1, size: 21x21, npix 268, brick X: 47,68, Y: 171,192, one pixel: 55 171 Blob 12 of 16, id: 7, sources: 1, size: 16x21, npix 239, brick X: 0,16, Y: 136,157, one pixel: 4 136 Blob 13 of 16, id: 8, sources: 1, size: 21x21, npix 237, brick X: 204,225, Y: 155,176, one pixel: 212 155 Blob 14 of 16, id: 12, sources: 1, size: 14x22, npix 212, brick X: 0,14, Y: 217,239, one pixel: 2 217 Blob 15 of 16, id: 1, sources: 1, size: 17x18, npix 162, brick X: 57,74, Y: 6,24, one pixel: 65 6 Blob 16 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 58,75, Y: 77,95, one pixel: 66 77 Blob 13 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 90 MB, VmData: 140 MB, maxrss: 0.091832 MB Blob 15 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14722 MB Blob 16 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 788 MB, VmSize: 712 MB, VmRSS: 129 MB, VmData: 170 MB, maxrss: 0.132232 MB Blob 9 finished, total: Wall: 0.22 s, CPU: 0.21 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146112 MB Blob 8 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147724 MB Blob 10 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095172 MB Blob 11 finished, total: Wall: 0.31 s, CPU: 0.30 s, VmPeak: 816 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146924 MB Blob 7 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.146956 MB Measuring 2 iterative sources Blob 12 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147472 MB Blob 5 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094672 MB Blob 14 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.0963 MB Blob 6 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146692 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.39072, 36.10218), pm (-3.9, -8.1), parallax 0.693 with NanoMaggies: g=18.2, r=17.1, z=16.6 Reset brightness to NanoMaggies: g=18.1, r=17.2, z=16.7 Blob 2 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147292 MB Blob 4 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146344 MB Blob 3 finished, total: Wall: 1.00 s, CPU: 0.99 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148064 MB Exception in one_blob: brick custom-272378p36110, iblob 2 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2075140; please check the logfile. Finished galaxy PGC2075140 in 2.397 minutes. Started working on galaxy PGC2075140 at Fri Aug 7 12:04:50 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:04:51.125074 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.3784680246166', '36.110269344691304', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.3784680246166 36.110269344691304 Starting process 16316 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16317 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16318 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16319 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16320 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 16321 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16322 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16326 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16330 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16331 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16332 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16333 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16334 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16335 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16336 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16337 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16338 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 16339 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 16340 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16341 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16342 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16343 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16344 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16345 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16346 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16347 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p and forcing stage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:04:51.842868 Keeping 11 CCDs: k4m_160501_103847_ooi_zd_ls9-CCD2 z expnum 86240 exptime 88.103 propid 2016A-0453 seeing 1.10 MJD 57509.444 object MzLS_583493_z mosaic/CP/V4.3/CP20160430/k4m_160501_103847_ooi_zd_ls9.fits.fz k4m_170603_110439_ooi_zd_ls9-CCD1 z expnum 131529 exptime 90.104 propid 2016A-0453 seeing 0.86 MJD 57907.462 object MzLS_585521_z mosaic/CP/V4.3/CP20170602/k4m_170603_110439_ooi_zd_ls9.fits.fz k4m_170414_120946_ooi_zd_ls9-CCD4 z expnum 121912 exptime 84.106 propid 2016A-0453 seeing 0.81 MJD 57857.507 object MzLS_584508_z mosaic/CP/V4.3/CP20170413/k4m_170414_120946_ooi_zd_ls9.fits.fz ksb_160511_105540_ooi_r_ls9-CCD2 r expnum 75190248 exptime 56.0 propid BASS seeing 1.04 MJD 57519.455 object 09592 90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz ksb_160703_071935_ooi_g_ls9-CCD2 g expnum 75720041 exptime 74.4 propid BASS seeing 1.11 MJD 57572.305 object 09592 90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz ksb_160606_104535_ooi_g_ls9-CCD2 g expnum 75450149 exptime 250.0 propid BASS seeing 1.41 MJD 57545.448 object 09592 90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz ksb_160503_110310_ooi_g_ls9-CCD3 g expnum 75110183 exptime 90.0 propid BASS seeing 1.47 MJD 57511.461 object 09601 90prime/CP/V2.3/CP20160502/ksb_160503_110310_ooi_g_ls9.fits.fz ksb_160702_080412_ooi_g_ls9-CCD3 g expnum 75710096 exptime 124.3 propid BASS seeing 1.88 MJD 57571.336 object 09603 90prime/CP/V2.3/CP20160701/ksb_160702_080412_ooi_g_ls9.fits.fz ksb_160628_075640_ooi_r_ls9-CCD3 r expnum 75670114 exptime 142.4 propid BASS seeing 1.20 MJD 57567.331 object 09603 90prime/CP/V2.3/CP20160627/ksb_160628_075640_ooi_r_ls9.fits.fz ksb_160503_105821_ooi_g_ls9-CCD1 g expnum 75110181 exptime 89.8 propid BASS seeing 1.50 MJD 57511.457 object 09591 90prime/CP/V2.3/CP20160502/ksb_160503_105821_ooi_g_ls9.fits.fz ksb_160430_101915_ooi_r_ls9-CCD1 r expnum 75080178 exptime 126.4 propid BASS seeing 1.58 MJD 57508.430 object 09591 90prime/CP/V2.3/CP20160429/ksb_160430_101915_ooi_r_ls9.fits.fz Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 938 1092 and amp range 0 2015 and image y 2420 2574 and amp range 2048 4095 Range in image: x 0 155 , y 0 155 (with image size 155 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 935 1089 and amp range 0 2015 and image y 2432 2585 and amp range 2048 4095 Range in image: x 0 155 , y 0 154 (with image size 155 x 154) dzp 0.016961161 -> scaling image by 1.0157444649385616 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 940 1093 and amp range 0 2015 and image y 2418 2572 and amp range 2048 4095 Range in image: x 0 154 , y 0 155 (with image size 154 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3119 3274 and amp range 2016 4031 and image y 440 595 and amp range 0 2047 Range in image: x 0 156 , y 0 156 (with image size 156 x 156) dzp -0.0041296566 -> scaling image by 0.9962036700684744 mosaic get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 101 365 and amp range 0 2047 and image y 0 163 and amp range 0 2021 Range in image: x 0 265 , y 0 164 (with image size 265 x 164) dzp -0.018417627 -> scaling image by 0.9831798050134541 mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2806 3076 and amp range 2048 4095 and image y 1189 1460 and amp range 0 2039 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 0 2047 Range in image: x 0 154 , y 0 86 (with image size 154 x 155) dzp -0.024507914 -> scaling image by 0.9776802328037623 Found overlap: image x 3169 3322 and amp range 2016 4031 and image y 4021 4080 and amp range 2048 4095 Range in image: x 0 154 , y 0 60 (with image size 154 x 60) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 2048 4095 Range in image: x 0 154 , y 86 155 (with image size 154 x 155) dzp -0.011545347 -> scaling image by 0.9894226798649194 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3106 3261 and amp range 2016 4031 and image y 443 599 and amp range 0 2047 Range in image: x 0 156 , y 0 157 (with image size 156 x 157) dzp -0.0032519526 -> scaling image by 0.9970093219958882 mosaic get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1661 1929 and amp range 0 2005 and image y 2761 3025 and amp range 2040 4078 Range in image: x 0 269 , y 0 265 (with image size 269 x 265) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 90prime get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 0 2047 Range in image: x 0 154 , y 0 32 (with image size 154 x 154) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 2048 4095 Range in image: x 0 154 , y 32 154 (with image size 154 x 154) dzp -0.0045482004 -> scaling image by 0.9958197144381092 Stage tims : Wall: 2.26 s, CPU: 0.87 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.178016 MB Stage tims finished: 2020-08-07T12:04:54.105605 Resources for stage tims : 5.702 s worker CPU, 11.725 s worker Wall, Wall: 2.266 s, Cores in use: 2.90, Total efficiency (on 32 cores): 9.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:04:55.717785 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/reference-custom-272378p36110.fits Stage refs : Wall: 6.16 s, CPU: 5.96 s, VmPeak: 1028 MB, VmSize: 1023 MB, VmRSS: 248 MB, VmData: 279 MB, maxrss: 0.25366 MB Stage refs finished: 2020-08-07T12:05:01.880034 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 6.165 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:05:01.902664 Stage outliers : Wall: 0.35 s, CPU: 0.29 s, VmPeak: 1028 MB, VmSize: 1023 MB, VmRSS: 249 MB, VmData: 279 MB, maxrss: 0.254532 MB Stage outliers finished: 2020-08-07T12:05:02.248639 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.348 s, Cores in use: 0.84, Total efficiency (on 32 cores): 2.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:05:02.280276 Stage halos : Wall: 0.22 s, CPU: 0.21 s, VmPeak: 1028 MB, VmSize: 1023 MB, VmRSS: 251 MB, VmData: 283 MB, maxrss: 0.25732 MB Stage halos finished: 2020-08-07T12:05:02.500380 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.222 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:05:02.584124 PSF sigmas in coadd pixels: ['1.80', '2.29', '2.39', '3.05', '2.44'] Using average PSF sigma 2.3945774249550906 Gaussian PSF norm 0.11780566743594383 vs pixelized 0.095477976 average tim pixel scale / coadd scale: 1.7293466642527406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '1.95', '2.57'] Using average PSF sigma 2.0677903484144764 Gaussian PSF norm 0.1364233042243284 vs pixelized 0.11007215 average tim pixel scale / coadd scale: 1.7292885321284863 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.40', '1.32'] Using average PSF sigma 1.4997692893507988 Gaussian PSF norm 0.1880921244200085 vs pixelized 0.1494749 average tim pixel scale / coadd scale: 0.9909398384562885 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.17 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.267884 MB Stage fit_on_coadds finished: 2020-08-07T12:05:02.785028 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.245 s worker CPU, 0.325 s worker Wall, Wall: 0.203 s, Cores in use: 2.05, Total efficiency (on 32 cores): 6.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:05:02.811781 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 39 potential peaks Of 39 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 111 potential peaks Of 111 potential peaks: 107 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 89 potential peaks Of 89 potential peaks: 82 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 52 potential peaks Of 52 potential peaks: 42 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 55 potential peaks Of 55 potential peaks: 45 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 24 new sources Median coadd sky for g : 0.00028330917 Median coadd sky for r : 0.0002495974 Median coadd sky for z : -4.369298e-06 Stage srcs : Wall: 0.52 s, CPU: 0.47 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.268748 MB Stage srcs finished: 2020-08-07T12:05:03.329527 Resources for stage srcs : 0.101 s worker CPU, 0.120 s worker Wall, Wall: 0.520 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:05:03.361311 Blob 1 of 16, id: 2, sources: 16, size: 184x222, npix 22011, brick X: 53,237, Y: 6,228, one pixel: 169 6 Blob 2 of 16, id: 0, sources: 3, size: 27x57, npix 1077, brick X: 0,27, Y: 0,57, one pixel: 3 0 Blob 3 of 16, id: 4, sources: 1, size: 25x38, npix 681, brick X: 238,263, Y: 60,98, one pixel: 250 60 Blob 4 of 16, id: 9, sources: 1, size: 23x37, npix 644, brick X: 0,23, Y: 166,203, one pixel: 4 166 Blob 5 of 16, id: 11, sources: 2, size: 29x35, npix 528, brick X: 229,258, Y: 214,249, one pixel: 246 214 Blob 6 of 16, id: 14, sources: 1, size: 27x20, npix 374, brick X: 50,77, Y: 243,263, one pixel: 62 243 Blob 7 of 16, id: 13, sources: 1, size: 24x23, npix 320, brick X: 176,200, Y: 218,241, one pixel: 186 218 Blob 8 of 16, id: 15, sources: 1, size: 24x20, npix 319, brick X: 98,122, Y: 243,263, one pixel: 109 243 Blob 9 of 16, id: 3, sources: 1, size: 22x23, npix 305, brick X: 101,123, Y: 24,47, one pixel: 111 24 Blob 10 of 16, id: 6, sources: 1, size: 22x21, npix 269, brick X: 8,30, Y: 80,101, one pixel: 18 80 Blob 11 of 16, id: 10, sources: 1, size: 21x21, npix 268, brick X: 47,68, Y: 171,192, one pixel: 55 171 Blob 12 of 16, id: 7, sources: 1, size: 16x21, npix 239, brick X: 0,16, Y: 136,157, one pixel: 4 136 Blob 13 of 16, id: 8, sources: 1, size: 21x21, npix 237, brick X: 204,225, Y: 155,176, one pixel: 212 155 Blob 14 of 16, id: 12, sources: 1, size: 14x22, npix 212, brick X: 0,14, Y: 217,239, one pixel: 2 217 Blob 15 of 16, id: 1, sources: 1, size: 17x18, npix 162, brick X: 57,74, Y: 6,24, one pixel: 65 6 Blob 16 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 58,75, Y: 77,95, one pixel: 66 77 Blob 15 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145452 MB Blob 13 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.143924 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.39072, 36.10218), pm (-3.9, -8.1), parallax 0.693 with NanoMaggies: g=20.5, r=18.8, z=17.6 Reset brightness to NanoMaggies: g=18.1, r=17.2, z=16.7 Blob 16 finished, total: Wall: 0.14 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083796 MB Blob 9 finished, total: Wall: 0.20 s, CPU: 0.16 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089604 MB Blob 11 finished, total: Wall: 0.20 s, CPU: 0.19 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146728 MB Blob 10 finished, total: Wall: 0.23 s, CPU: 0.20 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089552 MB Blob 7 finished, total: Wall: 0.26 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089652 MB Blob 5 finished, total: Wall: 0.34 s, CPU: 0.31 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089928 MB Blob 8 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089668 MB Blob 12 finished, total: Wall: 0.40 s, CPU: 0.37 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089484 MB Measuring 2 iterative sources Blob 14 finished, total: Wall: 0.47 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089584 MB Blob 6 finished, total: Wall: 0.57 s, CPU: 0.53 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089552 MB Blob 2 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 788 MB, VmSize: 712 MB, VmRSS: 129 MB, VmData: 170 MB, maxrss: 0.131872 MB Blob 4 finished, total: Wall: 0.84 s, CPU: 0.81 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089796 MB Blob 3 finished, total: Wall: 1.10 s, CPU: 1.07 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090816 MB Exception in one_blob: brick custom-272378p36110, iblob 2 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2075140; please check the logfile. Finished galaxy PGC2075140 in 0.288 minutes. Started working on galaxy PGC2075140 at Fri Aug 7 12:31:57 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:31:58.333671 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.3784680246166', '36.110269344691304', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.3784680246166 36.110269344691304 Starting process 19530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 19531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 19535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19546 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19547 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 19548 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19549 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19550 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19551 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 19553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 19554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 19555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 19556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:31:58.729795 Keeping 11 CCDs: k4m_160501_103847_ooi_zd_ls9-CCD2 z expnum 86240 exptime 88.103 propid 2016A-0453 seeing 1.10 MJD 57509.444 object MzLS_583493_z mosaic/CP/V4.3/CP20160430/k4m_160501_103847_ooi_zd_ls9.fits.fz k4m_170603_110439_ooi_zd_ls9-CCD1 z expnum 131529 exptime 90.104 propid 2016A-0453 seeing 0.86 MJD 57907.462 object MzLS_585521_z mosaic/CP/V4.3/CP20170602/k4m_170603_110439_ooi_zd_ls9.fits.fz k4m_170414_120946_ooi_zd_ls9-CCD4 z expnum 121912 exptime 84.106 propid 2016A-0453 seeing 0.81 MJD 57857.507 object MzLS_584508_z mosaic/CP/V4.3/CP20170413/k4m_170414_120946_ooi_zd_ls9.fits.fz ksb_160511_105540_ooi_r_ls9-CCD2 r expnum 75190248 exptime 56.0 propid BASS seeing 1.04 MJD 57519.455 object 09592 90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz ksb_160703_071935_ooi_g_ls9-CCD2 g expnum 75720041 exptime 74.4 propid BASS seeing 1.11 MJD 57572.305 object 09592 90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz ksb_160606_104535_ooi_g_ls9-CCD2 g expnum 75450149 exptime 250.0 propid BASS seeing 1.41 MJD 57545.448 object 09592 90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz ksb_160503_110310_ooi_g_ls9-CCD3 g expnum 75110183 exptime 90.0 propid BASS seeing 1.47 MJD 57511.461 object 09601 90prime/CP/V2.3/CP20160502/ksb_160503_110310_ooi_g_ls9.fits.fz ksb_160702_080412_ooi_g_ls9-CCD3 g expnum 75710096 exptime 124.3 propid BASS seeing 1.88 MJD 57571.336 object 09603 90prime/CP/V2.3/CP20160701/ksb_160702_080412_ooi_g_ls9.fits.fz ksb_160628_075640_ooi_r_ls9-CCD3 r expnum 75670114 exptime 142.4 propid BASS seeing 1.20 MJD 57567.331 object 09603 90prime/CP/V2.3/CP20160627/ksb_160628_075640_ooi_r_ls9.fits.fz ksb_160503_105821_ooi_g_ls9-CCD1 g expnum 75110181 exptime 89.8 propid BASS seeing 1.50 MJD 57511.457 object 09591 90prime/CP/V2.3/CP20160502/ksb_160503_105821_ooi_g_ls9.fits.fz ksb_160430_101915_ooi_r_ls9-CCD1 r expnum 75080178 exptime 126.4 propid BASS seeing 1.58 MJD 57508.430 object 09591 90prime/CP/V2.3/CP20160429/ksb_160430_101915_ooi_r_ls9.fits.fz Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 938 1092 and amp range 0 2015 and image y 2420 2574 and amp range 2048 4095 Range in image: x 0 155 , y 0 155 (with image size 155 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 940 1093 and amp range 0 2015 and image y 2418 2572 and amp range 2048 4095 Range in image: x 0 154 , y 0 155 (with image size 154 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3119 3274 and amp range 2016 4031 and image y 440 595 and amp range 0 2047 Range in image: x 0 156 , y 0 156 (with image size 156 x 156) dzp -0.0041296566 -> scaling image by 0.9962036700684744 mosaic get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 101 365 and amp range 0 2047 and image y 0 163 and amp range 0 2021 Range in image: x 0 265 , y 0 164 (with image size 265 x 164) dzp -0.018417627 -> scaling image by 0.9831798050134541 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 935 1089 and amp range 0 2015 and image y 2432 2585 and amp range 2048 4095 Range in image: x 0 155 , y 0 154 (with image size 155 x 154) dzp 0.016961161 -> scaling image by 1.0157444649385616 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 0 2047 Found overlap: image x 3106 3261 and amp range 2016 4031 and image y 443 599 and amp range 0 2047 Range in image: x 0 154 , y 0 86 (with image size 154 x 155) Range in image: x 0 156 , y 0 157 (with image size 156 x 157) dzp -0.024507914 -> scaling image by 0.9776802328037623 dzp -0.0032519526 -> scaling image by 0.9970093219958882 Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 2048 4095 Range in image: x 0 154 , y 86 155 (with image size 154 x 155) dzp -0.011545347 -> scaling image by 0.9894226798649194 mosaic get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1661 1929 and amp range 0 2005 and image y 2761 3025 and amp range 2040 4078 Range in image: x 0 269 , y 0 265 (with image size 269 x 265) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3169 3322 and amp range 2016 4031 and image y 4021 4080 and amp range 2048 4095 Range in image: x 0 154 , y 0 60 (with image size 154 x 60) dzp -0.0012536051 -> scaling image by 0.9988460533227724 mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2806 3076 and amp range 2048 4095 and image y 1189 1460 and amp range 0 2039 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 90prime get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 0 2047 Range in image: x 0 154 , y 0 32 (with image size 154 x 154) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 2048 4095 Range in image: x 0 154 , y 32 154 (with image size 154 x 154) dzp -0.0045482004 -> scaling image by 0.9958197144381092 Stage tims : Wall: 2.27 s, CPU: 0.80 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.177488 MB Stage tims finished: 2020-08-07T12:32:00.999572 Resources for stage tims : 5.527 s worker CPU, 12.428 s worker Wall, Wall: 2.272 s, Cores in use: 2.79, Total efficiency (on 32 cores): 8.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:32:01.033735 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/reference-custom-272378p36110.fits Stage refs : Wall: 6.16 s, CPU: 5.91 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 248 MB, VmData: 279 MB, maxrss: 0.253792 MB Stage refs finished: 2020-08-07T12:32:07.194793 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.163 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:32:07.221937 Stage outliers : Wall: 0.29 s, CPU: 0.27 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 248 MB, VmData: 279 MB, maxrss: 0.254436 MB Stage outliers finished: 2020-08-07T12:32:07.514581 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.295 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:32:07.539649 Stage halos : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 251 MB, VmData: 283 MB, maxrss: 0.25724 MB Stage halos finished: 2020-08-07T12:32:07.771467 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.234 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:32:07.796849 PSF sigmas in coadd pixels: ['1.80', '2.29', '2.39', '3.05', '2.44'] Using average PSF sigma 2.3945774249550906 Gaussian PSF norm 0.11780566743594383 vs pixelized 0.095477976 average tim pixel scale / coadd scale: 1.7293466642527406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '1.95', '2.57'] Using average PSF sigma 2.0677903484144764 Gaussian PSF norm 0.1364233042243284 vs pixelized 0.11007215 average tim pixel scale / coadd scale: 1.7292885321284863 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.40', '1.32'] Using average PSF sigma 1.4997692893507988 Gaussian PSF norm 0.1880921244200085 vs pixelized 0.1494749 average tim pixel scale / coadd scale: 0.9909398384562885 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.18 s, CPU: 0.18 s, VmPeak: 1029 MB, VmSize: 1028 MB, VmRSS: 263 MB, VmData: 291 MB, maxrss: 0.269168 MB Stage fit_on_coadds finished: 2020-08-07T12:32:07.980208 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.223 s worker CPU, 0.314 s worker Wall, Wall: 0.185 s, Cores in use: 2.16, Total efficiency (on 32 cores): 6.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:32:07.992522 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 39 potential peaks Of 39 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 111 potential peaks Of 111 potential peaks: 107 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 89 potential peaks Of 89 potential peaks: 82 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 52 potential peaks Of 52 potential peaks: 42 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 55 potential peaks Of 55 potential peaks: 45 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 24 new sources Median coadd sky for g : 0.00028330923 Median coadd sky for r : 0.00024959742 Median coadd sky for z : -4.369299e-06 Stage srcs : Wall: 0.57 s, CPU: 0.52 s, VmPeak: 1029 MB, VmSize: 1028 MB, VmRSS: 264 MB, VmData: 291 MB, maxrss: 0.2699 MB Stage srcs finished: 2020-08-07T12:32:08.564551 Resources for stage srcs : 0.109 s worker CPU, 0.124 s worker Wall, Wall: 0.574 s, Cores in use: 1.10, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:32:08.592247 Blob 1 of 16, id: 2, sources: 16, size: 184x222, npix 22011, brick X: 53,237, Y: 6,228, one pixel: 169 6 Blob 2 of 16, id: 0, sources: 3, size: 27x57, npix 1077, brick X: 0,27, Y: 0,57, one pixel: 3 0 Blob 3 of 16, id: 4, sources: 1, size: 25x38, npix 681, brick X: 238,263, Y: 60,98, one pixel: 250 60 Blob 4 of 16, id: 9, sources: 1, size: 23x37, npix 644, brick X: 0,23, Y: 166,203, one pixel: 4 166 Blob 5 of 16, id: 11, sources: 2, size: 29x35, npix 528, brick X: 229,258, Y: 214,249, one pixel: 246 214 Blob 6 of 16, id: 14, sources: 1, size: 27x20, npix 374, brick X: 50,77, Y: 243,263, one pixel: 62 243 Blob 7 of 16, id: 13, sources: 1, size: 24x23, npix 320, brick X: 176,200, Y: 218,241, one pixel: 186 218 Blob 8 of 16, id: 15, sources: 1, size: 24x20, npix 319, brick X: 98,122, Y: 243,263, one pixel: 109 243 Blob 9 of 16, id: 3, sources: 1, size: 22x23, npix 305, brick X: 101,123, Y: 24,47, one pixel: 111 24 Blob 10 of 16, id: 6, sources: 1, size: 22x21, npix 269, brick X: 8,30, Y: 80,101, one pixel: 18 80 Blob 11 of 16, id: 10, sources: 1, size: 21x21, npix 268, brick X: 47,68, Y: 171,192, one pixel: 55 171 Blob 12 of 16, id: 7, sources: 1, size: 16x21, npix 239, brick X: 0,16, Y: 136,157, one pixel: 4 136 Blob 13 of 16, id: 8, sources: 1, size: 21x21, npix 237, brick X: 204,225, Y: 155,176, one pixel: 212 155 Blob 14 of 16, id: 12, sources: 1, size: 14x22, npix 212, brick X: 0,14, Y: 217,239, one pixel: 2 217 Blob 15 of 16, id: 1, sources: 1, size: 17x18, npix 162, brick X: 57,74, Y: 6,24, one pixel: 65 6 Blob 16 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 58,75, Y: 77,95, one pixel: 66 77 Blob 13 finished, total: Wall: 0.11 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083788 MB Blob 15 finished, total: Wall: 0.14 s, CPU: 0.10 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 82 MB, VmData: 136 MB, maxrss: 0.083672 MB Blob 16 finished, total: Wall: 0.15 s, CPU: 0.12 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.083812 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.39072, 36.10218), pm (-3.9, -8.1), parallax 0.693 with NanoMaggies: g=20.5, r=18.8, z=17.6 Reset brightness to NanoMaggies: g=18.1, r=17.2, z=16.7 Blob 9 finished, total: Wall: 0.19 s, CPU: 0.16 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.08956 MB Blob 7 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145968 MB Blob 11 finished, total: Wall: 0.26 s, CPU: 0.21 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089568 MB Blob 10 finished, total: Wall: 0.32 s, CPU: 0.29 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089552 MB Blob 8 finished, total: Wall: 0.40 s, CPU: 0.36 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08966 MB Blob 14 finished, total: Wall: 0.41 s, CPU: 0.40 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092592 MB Blob 5 finished, total: Wall: 0.44 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090024 MB Blob 12 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.090992 MB Measuring 2 iterative sources Blob 6 finished, total: Wall: 0.59 s, CPU: 0.55 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08982 MB Blob 2 finished, total: Wall: 0.82 s, CPU: 0.79 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090844 MB Blob 4 finished, total: Wall: 0.85 s, CPU: 0.81 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089976 MB Blob 3 finished, total: Wall: 1.05 s, CPU: 1.01 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.09104 MB Exception in one_blob: brick custom-272378p36110, iblob 2 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2075140; please check the logfile. Finished galaxy PGC2075140 in 0.303 minutes. Started working on galaxy PGC2075140 at Fri Aug 7 13:31:48 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:31:49.330850 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '272.3784680246166', '36.110269344691304', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 272.3784680246166 36.110269344691304 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 272.3784680246166 36.110269344691304 Starting process 23190 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 23191 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23192 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23193 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23194 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 23195 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 23196 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 23197 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23198 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23199 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 23200 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23201 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23202 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23203 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23204 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23205 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23206 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 23207 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 23208 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23210 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 23212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 23213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 23214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 23215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 23216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 23217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 23219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:31:49.792992 Keeping 11 CCDs: k4m_160501_103847_ooi_zd_ls9-CCD2 z expnum 86240 exptime 88.103 propid 2016A-0453 seeing 1.10 MJD 57509.444 object MzLS_583493_z mosaic/CP/V4.3/CP20160430/k4m_160501_103847_ooi_zd_ls9.fits.fz k4m_170603_110439_ooi_zd_ls9-CCD1 z expnum 131529 exptime 90.104 propid 2016A-0453 seeing 0.86 MJD 57907.462 object MzLS_585521_z mosaic/CP/V4.3/CP20170602/k4m_170603_110439_ooi_zd_ls9.fits.fz k4m_170414_120946_ooi_zd_ls9-CCD4 z expnum 121912 exptime 84.106 propid 2016A-0453 seeing 0.81 MJD 57857.507 object MzLS_584508_z mosaic/CP/V4.3/CP20170413/k4m_170414_120946_ooi_zd_ls9.fits.fz ksb_160511_105540_ooi_r_ls9-CCD2 r expnum 75190248 exptime 56.0 propid BASS seeing 1.04 MJD 57519.455 object 09592 90prime/CP/V2.3/CP20160510/ksb_160511_105540_ooi_r_ls9.fits.fz ksb_160703_071935_ooi_g_ls9-CCD2 g expnum 75720041 exptime 74.4 propid BASS seeing 1.11 MJD 57572.305 object 09592 90prime/CP/V2.3/CP20160702/ksb_160703_071935_ooi_g_ls9.fits.fz ksb_160606_104535_ooi_g_ls9-CCD2 g expnum 75450149 exptime 250.0 propid BASS seeing 1.41 MJD 57545.448 object 09592 90prime/CP/V2.3/CP20160605/ksb_160606_104535_ooi_g_ls9.fits.fz ksb_160503_110310_ooi_g_ls9-CCD3 g expnum 75110183 exptime 90.0 propid BASS seeing 1.47 MJD 57511.461 object 09601 90prime/CP/V2.3/CP20160502/ksb_160503_110310_ooi_g_ls9.fits.fz ksb_160702_080412_ooi_g_ls9-CCD3 g expnum 75710096 exptime 124.3 propid BASS seeing 1.88 MJD 57571.336 object 09603 90prime/CP/V2.3/CP20160701/ksb_160702_080412_ooi_g_ls9.fits.fz ksb_160628_075640_ooi_r_ls9-CCD3 r expnum 75670114 exptime 142.4 propid BASS seeing 1.20 MJD 57567.331 object 09603 90prime/CP/V2.3/CP20160627/ksb_160628_075640_ooi_r_ls9.fits.fz ksb_160503_105821_ooi_g_ls9-CCD1 g expnum 75110181 exptime 89.8 propid BASS seeing 1.50 MJD 57511.457 object 09591 90prime/CP/V2.3/CP20160502/ksb_160503_105821_ooi_g_ls9.fits.fz ksb_160430_101915_ooi_r_ls9-CCD1 r expnum 75080178 exptime 126.4 propid BASS seeing 1.58 MJD 57508.430 object 09591 90prime/CP/V2.3/CP20160429/ksb_160430_101915_ooi_r_ls9.fits.fz Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 Faked up EXPNUM 75720041 90prime get_fwhm: self.fwhm = 2.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 938 1092 and amp range 0 2015 and image y 2420 2574 and amp range 2048 4095 Range in image: x 0 155 , y 0 155 (with image size 155 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 Faked up EXPNUM 75450149 90prime get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 940 1093 and amp range 0 2015 and image y 2418 2572 and amp range 2048 4095 Range in image: x 0 154 , y 0 155 (with image size 154 x 155) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 Faked up EXPNUM 75190248 90prime get_fwhm: self.fwhm = 2.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 935 1089 and amp range 0 2015 and image y 2432 2585 and amp range 2048 4095 Range in image: x 0 155 , y 0 154 (with image size 155 x 154) dzp 0.016961161 -> scaling image by 1.0157444649385616 mosaic get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1661 1929 and amp range 0 2005 and image y 2761 3025 and amp range 2040 4078 Range in image: x 0 269 , y 0 265 (with image size 269 x 265) dzp 0.032569118 -> scaling image by 1.0304517167935139 mosaic get_fwhm: self.fwhm = 4.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2806 3076 and amp range 2048 4095 and image y 1189 1460 and amp range 0 2039 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 Faked up EXPNUM 75670114 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 0 2047 Range in image: x 0 154 , y 0 86 (with image size 154 x 155) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 Faked up EXPNUM 75080178 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1192 1345 and amp range 0 2015 and image y 1962 2116 and amp range 2048 4095 Range in image: x 0 154 , y 86 155 (with image size 154 x 155) dzp -0.011545347 -> scaling image by 0.9894226798649194 Found overlap: image x 3119 3274 and amp range 2016 4031 and image y 440 595 and amp range 0 2047 Range in image: x 0 156 , y 0 156 (with image size 156 x 156) dzp -0.0041296566 -> scaling image by 0.9962036700684744 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 Faked up EXPNUM 75110181 90prime get_fwhm: self.fwhm = 3.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3106 3261 and amp range 2016 4031 and image y 443 599 and amp range 0 2047 Range in image: x 0 156 , y 0 157 (with image size 156 x 157) dzp -0.0032519526 -> scaling image by 0.9970093219958882 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 Faked up EXPNUM 75710096 90prime get_fwhm: self.fwhm = 4.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 0 2047 Range in image: x 0 154 , y 0 32 (with image size 154 x 154) dzp -0.03470582 -> scaling image by 0.9685402452207784 Found overlap: image x 1178 1331 and amp range 0 2015 and image y 2016 2169 and amp range 2048 4095 Range in image: x 0 154 , y 32 154 (with image size 154 x 154) dzp -0.0045482004 -> scaling image by 0.9958197144381092 mosaic get_fwhm: self.fwhm = 3.13 Found 4 relevant rows in amp-corrections file. Found overlap: image x 101 365 and amp range 0 2047 and image y 0 163 and amp range 0 2021 Range in image: x 0 265 , y 0 164 (with image size 265 x 164) dzp -0.018417627 -> scaling image by 0.9831798050134541 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 Faked up EXPNUM 75110183 90prime get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3169 3322 and amp range 2016 4031 and image y 4021 4080 and amp range 2048 4095 Range in image: x 0 154 , y 0 60 (with image size 154 x 60) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Stage tims : Wall: 5.29 s, CPU: 0.89 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.177304 MB Stage tims finished: 2020-08-07T13:31:55.079832 Resources for stage tims : 5.438 s worker CPU, 17.062 s worker Wall, Wall: 5.289 s, Cores in use: 1.20, Total efficiency (on 32 cores): 3.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T13:31:55.112608 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02592.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02465.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/reference-custom-272378p36110.fits Stage refs : Wall: 6.33 s, CPU: 5.96 s, VmPeak: 1028 MB, VmSize: 1023 MB, VmRSS: 247 MB, VmData: 278 MB, maxrss: 0.253372 MB Stage refs finished: 2020-08-07T13:32:01.446350 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.336 s, Cores in use: 0.94, Total efficiency (on 32 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:32:01.468492 Stage outliers : Wall: 0.36 s, CPU: 0.30 s, VmPeak: 1028 MB, VmSize: 1023 MB, VmRSS: 248 MB, VmData: 279 MB, maxrss: 0.254012 MB Stage outliers finished: 2020-08-07T13:32:01.826254 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.360 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.7 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T13:32:01.852079 Stage halos : Wall: 0.27 s, CPU: 0.26 s, VmPeak: 1028 MB, VmSize: 1023 MB, VmRSS: 251 MB, VmData: 282 MB, maxrss: 0.256904 MB Stage halos finished: 2020-08-07T13:32:02.123961 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.274 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T13:32:02.162477 PSF sigmas in coadd pixels: ['1.80', '2.29', '2.39', '3.05', '2.44'] Using average PSF sigma 2.3945774249550906 Gaussian PSF norm 0.11780566743594383 vs pixelized 0.095477976 average tim pixel scale / coadd scale: 1.7293466642527406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.69', '1.95', '2.57'] Using average PSF sigma 2.0677903484144764 Gaussian PSF norm 0.1364233042243284 vs pixelized 0.11007215 average tim pixel scale / coadd scale: 1.7292885321284863 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.78', '1.40', '1.32'] Using average PSF sigma 1.4997692893507988 Gaussian PSF norm 0.1880921244200085 vs pixelized 0.1494749 average tim pixel scale / coadd scale: 0.9909398384562885 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 261 MB, VmData: 290 MB, maxrss: 0.267536 MB Stage fit_on_coadds finished: 2020-08-07T13:32:02.355652 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.258 s worker CPU, 0.413 s worker Wall, Wall: 0.195 s, Cores in use: 2.25, Total efficiency (on 32 cores): 7.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T13:32:02.380393 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 39 potential peaks Of 39 potential peaks: 22 in veto map, 2 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 111 potential peaks Of 111 potential peaks: 107 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 89 potential peaks Of 89 potential peaks: 82 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 52 potential peaks Of 52 potential peaks: 42 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 55 potential peaks Of 55 potential peaks: 45 in veto map, 8 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 24 new sources Median coadd sky for g : 0.00028330923 Median coadd sky for r : 0.0002495974 Median coadd sky for z : -4.369298e-06 Stage srcs : Wall: 0.80 s, CPU: 0.63 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.268376 MB Stage srcs finished: 2020-08-07T13:32:03.182372 Resources for stage srcs : 0.113 s worker CPU, 0.128 s worker Wall, Wall: 0.804 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:32:03.211380 Blob 1 of 16, id: 2, sources: 16, size: 184x222, npix 22011, brick X: 53,237, Y: 6,228, one pixel: 169 6 Blob 2 of 16, id: 0, sources: 3, size: 27x57, npix 1077, brick X: 0,27, Y: 0,57, one pixel: 3 0 Blob 3 of 16, id: 4, sources: 1, size: 25x38, npix 681, brick X: 238,263, Y: 60,98, one pixel: 250 60 Blob 4 of 16, id: 9, sources: 1, size: 23x37, npix 644, brick X: 0,23, Y: 166,203, one pixel: 4 166 Blob 5 of 16, id: 11, sources: 2, size: 29x35, npix 528, brick X: 229,258, Y: 214,249, one pixel: 246 214 Blob 6 of 16, id: 14, sources: 1, size: 27x20, npix 374, brick X: 50,77, Y: 243,263, one pixel: 62 243 Blob 7 of 16, id: 13, sources: 1, size: 24x23, npix 320, brick X: 176,200, Y: 218,241, one pixel: 186 218 Blob 8 of 16, id: 15, sources: 1, size: 24x20, npix 319, brick X: 98,122, Y: 243,263, one pixel: 109 243 Blob 9 of 16, id: 3, sources: 1, size: 22x23, npix 305, brick X: 101,123, Y: 24,47, one pixel: 111 24 Blob 10 of 16, id: 6, sources: 1, size: 22x21, npix 269, brick X: 8,30, Y: 80,101, one pixel: 18 80 Blob 11 of 16, id: 10, sources: 1, size: 21x21, npix 268, brick X: 47,68, Y: 171,192, one pixel: 55 171 Blob 12 of 16, id: 7, sources: 1, size: 16x21, npix 239, brick X: 0,16, Y: 136,157, one pixel: 4 136 Blob 13 of 16, id: 8, sources: 1, size: 21x21, npix 237, brick X: 204,225, Y: 155,176, one pixel: 212 155 Blob 14 of 16, id: 12, sources: 1, size: 14x22, npix 212, brick X: 0,14, Y: 217,239, one pixel: 2 217 Blob 15 of 16, id: 1, sources: 1, size: 17x18, npix 162, brick X: 57,74, Y: 6,24, one pixel: 65 6 Blob 16 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 58,75, Y: 77,95, one pixel: 66 77 Blob 15 finished, total: Wall: 0.13 s, CPU: 0.06 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087156 MB Blob 13 finished, total: Wall: 0.14 s, CPU: 0.08 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 85 MB, VmData: 138 MB, maxrss: 0.087208 MB Blob 16 finished, total: Wall: 0.13 s, CPU: 0.07 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145408 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (272.39072, 36.10218), pm (-3.9, -8.1), parallax 0.693 with NanoMaggies: g=20.5, r=18.8, z=17.6 Reset brightness to NanoMaggies: g=18.1, r=17.2, z=16.7 Blob 9 finished, total: Wall: 0.23 s, CPU: 0.16 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089564 MB Blob 11 finished, total: Wall: 0.23 s, CPU: 0.19 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146392 MB Blob 7 finished, total: Wall: 0.28 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08964 MB Blob 10 finished, total: Wall: 0.31 s, CPU: 0.24 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.144992 MB Blob 8 finished, total: Wall: 0.41 s, CPU: 0.35 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08972 MB Blob 5 finished, total: Wall: 0.42 s, CPU: 0.32 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08994 MB Blob 12 finished, total: Wall: 0.45 s, CPU: 0.37 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089604 MB Measuring 2 iterative sources Blob 14 finished, total: Wall: 0.49 s, CPU: 0.42 s, VmPeak: 816 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145528 MB Blob 6 finished, total: Wall: 0.55 s, CPU: 0.49 s, VmPeak: 805 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14636 MB Blob 2 finished, total: Wall: 0.83 s, CPU: 0.78 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094596 MB Blob 4 finished, total: Wall: 0.87 s, CPU: 0.81 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 183 MB, maxrss: 0.144804 MB Blob 3 finished, total: Wall: 1.11 s, CPU: 1.04 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145692 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.43, ee1=-0.125329, ee2=0.0291641 Measuring 2 iterative sources Blob 1 finished, total: Wall: 11.28 s, CPU: 11.24 s, VmPeak: 704 MB, VmSize: 691 MB, VmRSS: 121 MB, VmData: 159 MB, maxrss: 0.137004 MB Old catalog: 45 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/blobs-custom-272378p36110.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/metrics/cus/all-models-custom-272378p36110.fits Stage fitblobs : Wall: 12.83 s, CPU: 0.50 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 262 MB, VmData: 290 MB, maxrss: 0.268684 MB Stage fitblobs finished: 2020-08-07T13:32:16.038806 Resources for stage fitblobs : 17.080 s worker CPU, 18.137 s worker Wall, Wall: 12.830 s, Cores in use: 1.37, Total efficiency (on 32 cores): 4.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:32:16.055608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/tmp-legacysurvey-custom-272378p36110-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/tmp-legacysurvey-custom-272378p36110-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/tmp-legacysurvey-custom-272378p36110-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/tmp-legacysurvey-custom-272378p36110-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-resid.jpg Stage coadds : Wall: 2.37 s, CPU: 1.00 s, VmPeak: 1032 MB, VmSize: 1032 MB, VmRSS: 264 MB, VmData: 290 MB, maxrss: 0.270144 MB Stage coadds finished: 2020-08-07T13:32:18.422288 Resources for stage coadds : 24.662 s worker CPU, 25.741 s worker Wall, Wall: 2.369 s, Cores in use: 10.83, Total efficiency (on 32 cores): 33.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:32:18.436821 Cut to 1 unWISE tiles Reading WISE tile 2723p363 band 4 Reading WISE tile 2723p363 band 1 Reading WISE tile 2723p363 band 2 Reading WISE tile 2723p363 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 813 MB, VmSize: 801 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.187056 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 176 MB, maxrss: 0.2041 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 810 MB, VmSize: 792 MB, VmRSS: 136 MB, VmData: 170 MB, maxrss: 0.198692 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/272/2723p363/unwise-2723p363-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 798 MB, VmRSS: 142 MB, VmData: 172 MB, maxrss: 0.204808 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/tmp-legacysurvey-custom-272378p36110-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/tmp-legacysurvey-custom-272378p36110-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.86 s, CPU: 0.43 s, VmPeak: 1032 MB, VmSize: 1032 MB, VmRSS: 264 MB, VmData: 290 MB, maxrss: 0.2707 MB Stage wise_forced finished: 2020-08-07T13:32:20.298700 Resources for stage wise_forced : 3.291 s worker CPU, 4.080 s worker Wall, Wall: 1.864 s, Cores in use: 2.00, Total efficiency (on 32 cores): 6.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:32:20.321928 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/coadd/cus/custom-272378p36110/legacysurvey-custom-272378p36110-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/tractor-i/cus/tractor-custom-272378p36110.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/tractor/cus/tractor-custom-272378p36110.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/tractor/cus/brick-custom-272378p36110.sha256sum Stage writecat : Wall: 0.86 s, CPU: 0.53 s, VmPeak: 1164 MB, VmSize: 1036 MB, VmRSS: 266 MB, VmData: 290 MB, maxrss: 0.403648 MB Stage writecat finished: 2020-08-07T13:32:21.182724 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.863 s, Cores in use: 0.62, Total efficiency (on 32 cores): 1.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/272/PGC2075140/PGC2075140-largegalaxy-writecat.p All done: 50.848 s worker CPU, 65.569 s worker Wall, Wall: 31.412 s, Cores in use: 1.96, Total efficiency (on 32 cores): 6.1 % Finished galaxy PGC2075140 in 0.555 minutes.