Started working on galaxy PGC2063912 at Wed Aug 5 20:21:03 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.89107650000005 35.3980255 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:21:05.942927 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.89107650000005', '35.3980255', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.89107650000005 35.3980255 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.89107650000005 35.3980255 Starting process 54843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 54844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 54845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 54846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 54847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 54848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 54849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 54850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 54851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 54852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 54853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 54854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 54856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 54857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 54855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 54858 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:21:07.872583 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 11 CCDs: k4m_180206_124628_ooi_zd_ls9-CCD1 z expnum 160861 exptime 80.105 propid 2016A-0453 seeing 0.99 MJD 58155.532 object MzLS_582478_z mosaic/CP/V4.3/CP20180205/k4m_180206_124628_ooi_zd_ls9.fits.fz k4m_160418_113311_ooi_zd_ls9-CCD1 z expnum 83118 exptime 80.104 propid 2016A-0453 seeing 1.71 MJD 57496.481 object MzLS_582478_z mosaic/CP/V4.3/CP20160417/k4m_160418_113311_ooi_zd_ls9.fits.fz k4m_160429_105249_ooi_zd_ls9-CCD2 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.34 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz k4m_160415_114739_ooi_zd_ls9-CCD2 z expnum 82531 exptime 100.103 propid 2016A-0453 seeing 0.96 MJD 57493.491 object MzLS_579412_z mosaic/CP/V4.3/CP20160414/k4m_160415_114739_ooi_zd_ls9.fits.fz k4m_160413_115010_ooi_zd_ls9-CCD3 z expnum 82024 exptime 80.102 propid 2016A-0453 seeing 0.80 MJD 57491.493 object MzLS_581458_z mosaic/CP/V4.3/CP20160412/k4m_160413_115010_ooi_zd_ls9.fits.fz ksb_160602_084446_ooi_g_ls9-CCD3 g expnum 75410136 exptime 113.4 propid BASS seeing 1.21 MJD 57541.364 object 08262 90prime/CP/V2.3/CP20160601/ksb_160602_084446_ooi_g_ls9.fits.fz ksb_160510_110205_ooi_r_ls9-CCD3 r expnum 75180255 exptime 58.8 propid BASS seeing 1.05 MJD 57518.460 object 08262 90prime/CP/V2.3/CP20160509/ksb_160510_110205_ooi_r_ls9.fits.fz ksb_160414_114341_ooi_r_ls9-CCD3 r expnum 74920208 exptime 50.7 propid BASS seeing 1.06 MJD 57492.489 object 08261 90prime/CP/V2.3/CP20160413/ksb_160414_114341_ooi_r_ls9.fits.fz ksb_160504_102503_ooi_g_ls9-CCD3 g expnum 75120198 exptime 96.4 propid BASS seeing 1.40 MJD 57512.434 object 08261 90prime/CP/V2.3/CP20160503/ksb_160504_102503_ooi_g_ls9.fits.fz ksb_160628_080419_ooi_r_ls9-CCD4 r expnum 75670116 exptime 157.1 propid BASS seeing 1.12 MJD 57567.336 object 09613 90prime/CP/V2.3/CP20160627/ksb_160628_080419_ooi_r_ls9.fits.fz ksb_160702_081312_ooi_g_ls9-CCD4 g expnum 75710099 exptime 125.7 propid BASS seeing 1.96 MJD 57571.343 object 09613 90prime/CP/V2.3/CP20160701/ksb_160702_081312_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3785 4066 and amp range 2048 4095 and image y 1343 1622 and amp range 0 2039 Range in image: x 0 282 , y 0 280 (with image size 282 x 280) dzp 0.0072022504 -> scaling image by 1.0066555682883527 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2667 2938 and amp range 2006 4053 and image y 1978 2252 and amp range 0 2039 Range in image: x 0 272 , y 0 62 (with image size 272 x 275) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Found overlap: image x 2667 2938 and amp range 2006 4053 and image y 1978 2252 and amp range 2040 4078 Range in image: x 0 272 , y 62 275 (with image size 272 x 275) dzp -0.0026360443 -> scaling image by 0.99757505842151 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 90prime get_fwhm: self.fwhm = 2.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 882 1039 and amp range 0 2015 and image y 45 202 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.024507914 -> scaling image by 0.9776802328037623 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 6.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 184 and amp range 0 2005 and image y 3686 3958 and amp range 2040 4078 Range in image: x 0 185 , y 0 273 (with image size 185 x 273) dzp -0.005990375 -> scaling image by 0.994497853444703 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2646 2804 and amp range 2016 4031 and image y 292 449 and amp range 0 2047 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.010226944 -> scaling image by 1.0094638657706572 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2659 2817 and amp range 2016 4031 and image y 281 438 and amp range 0 2047 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.0047082007 -> scaling image by 1.0043458289369953 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2867 3023 and amp range 2016 4031 and image y 2020 2176 and amp range 0 2047 Range in image: x 0 157 , y 0 28 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Found overlap: image x 2867 3023 and amp range 2016 4031 and image y 2020 2176 and amp range 2048 4095 Range in image: x 0 157 , y 28 157 (with image size 157 x 157) dzp -0.0012536051 -> scaling image by 0.9988460533227724 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1035 1305 and amp range 0 2047 and image y 2703 2974 and amp range 2040 4078 Range in image: x 0 271 , y 0 272 (with image size 271 x 272) dzp 0.008550294 -> scaling image by 1.0079062018164673 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 183 and amp range 0 2005 and image y 3685 3957 and amp range 2040 4078 Range in image: x 0 184 , y 0 273 (with image size 184 x 273) dzp 0.014419514 -> scaling image by 1.0133694453441033 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 90prime get_fwhm: self.fwhm = 2.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2868 3024 and amp range 2016 4031 and image y 2028 2184 and amp range 0 2047 Range in image: x 0 157 , y 0 20 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 Found overlap: image x 2868 3024 and amp range 2016 4031 and image y 2028 2184 and amp range 2048 4095 Range in image: x 0 157 , y 20 157 (with image size 157 x 157) dzp -0.0005558773 -> scaling image by 0.99948814914245 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 886 1043 and amp range 0 2015 and image y 50 207 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.03470582 -> scaling image by 0.9685402452207784 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 10.35 s, CPU: 1.80 s, VmPeak: 958 MB, VmSize: 958 MB, VmRSS: 176 MB, VmData: 208 MB, maxrss: 0.1807 MB Stage tims finished: 2020-08-05T20:21:18.226158 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 6.645 s worker CPU, 48.851 s worker Wall, Wall: 10.355 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-tims.p Running stage refs WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:21:18.249044 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 9 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/reference-custom-273891p35398.fits Stage refs : Wall: 20.67 s, CPU: 7.51 s, VmPeak: 1050 MB, VmSize: 1045 MB, VmRSS: 266 MB, VmData: 295 MB, maxrss: 0.272508 MB Stage refs finished: 2020-08-05T20:21:38.917967 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 20.671 s, Cores in use: 0.36, Total efficiency (on 16 cores): 2.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:21:38.943553 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/outlier-mask-custom-273891p35398.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/outliers-pre-custom-273891p35398.jpg Image ksb_160702_081312_ooi_g_ls9-CCD4 g : masking 92 positive outlier pixels and 0 negative outlier pixels Image ksb_160602_084446_ooi_g_ls9-CCD3 g : masking 126 positive outlier pixels and 0 negative outlier pixels Image ksb_160628_080419_ooi_r_ls9-CCD4 r : masking 63 positive outlier pixels and 0 negative outlier pixels Image k4m_160429_105249_ooi_zd_ls9-CCD2 z : masking 192 positive outlier pixels and 287 negative outlier pixels Image k4m_160415_114739_ooi_zd_ls9-CCD2 z : masking 577 positive outlier pixels and 206 negative outlier pixels Image k4m_160418_113311_ooi_zd_ls9-CCD1 z : masking 1374 positive outlier pixels and 589 negative outlier pixels Image k4m_160413_115010_ooi_zd_ls9-CCD3 z : masking 150 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/outlier-mask-custom-273891p35398.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/outliers-post-custom-273891p35398.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/outliers-masked-pos-custom-273891p35398.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/outliers-masked-neg-custom-273891p35398.jpg Stage outliers : Wall: 1.16 s, CPU: 0.89 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 282 MB, VmData: 309 MB, maxrss: 0.2891 MB Stage outliers finished: 2020-08-05T20:21:40.106433 Resources for stage outliers : 1.050 s worker CPU, 1.169 s worker Wall, Wall: 1.164 s, Cores in use: 1.67, Total efficiency (on 16 cores): 10.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:21:40.268163 Stage halos : Wall: 0.34 s, CPU: 0.33 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 283 MB, VmData: 309 MB, maxrss: 0.289604 MB Stage halos finished: 2020-08-05T20:21:40.611698 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.345 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:21:40.735047 PSF sigmas in coadd pixels: ['1.96', '2.27', '3.19'] Using average PSF sigma 2.4754625557881815 Gaussian PSF norm 0.11395639619523949 vs pixelized 0.09036144 average tim pixel scale / coadd scale: 1.7295615305015035 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.70', '1.71', '1.82'] Using average PSF sigma 1.7443592086240056 Gaussian PSF norm 0.1617182919545577 vs pixelized 0.12692532 average tim pixel scale / coadd scale: 1.7296402441437235 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.61', '2.78', '2.17', '1.56', '1.30'] Using average PSF sigma 1.8850144421701458 Gaussian PSF norm 0.1496512628566989 vs pixelized 0.12207226 average tim pixel scale / coadd scale: 0.9909978506105547 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.20 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 285 MB, VmData: 310 MB, maxrss: 0.291832 MB Stage fit_on_coadds finished: 2020-08-05T20:21:40.967524 Resources for stage fit_on_coadds : 0.233 s worker CPU, 0.233 s worker Wall, Wall: 0.234 s, Cores in use: 1.87, Total efficiency (on 16 cores): 11.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-05T20:21:40.984808 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 16 potential peaks Of 16 potential peaks: 13 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 30 potential peaks Of 30 potential peaks: 26 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 35 potential peaks Of 35 potential peaks: 31 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 26 new sources Median coadd sky for g : 1.2364627e-05 Median coadd sky for r : 8.3626976e-05 Median coadd sky for z : 0.00011807571 Stage srcs : Wall: 2.26 s, CPU: 2.18 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 286 MB, VmData: 310 MB, maxrss: 0.292564 MB Stage srcs finished: 2020-08-05T20:21:43.249041 Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 2.266 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:21:43.277131 Blob 1 of 22, id: 9, sources: 4, size: 138x103, npix 6773, brick X: 71,209, Y: 83,186, one pixel: 88 83 Blob 2 of 22, id: 17, sources: 4, size: 94x63, npix 2851, brick X: 119,213, Y: 201,264, one pixel: 188 201 Blob 3 of 22, id: 20, sources: 3, size: 54x38, npix 1641, brick X: 193,247, Y: 231,269, one pixel: 234 231 Blob 4 of 22, id: 10, sources: 2, size: 59x37, npix 1437, brick X: 8,67, Y: 110,147, one pixel: 43 110 Blob 5 of 22, id: 18, sources: 3, size: 35x57, npix 1228, brick X: 0,35, Y: 202,259, one pixel: 20 202 Blob 6 of 22, id: 21, sources: 1, size: 36x32, npix 820, brick X: 61,97, Y: 237,269, one pixel: 79 237 Blob 7 of 22, id: 2, sources: 1, size: 30x31, npix 630, brick X: 213,243, Y: 24,55, one pixel: 225 24 Blob 8 of 22, id: 13, sources: 1, size: 29x28, npix 526, brick X: 52,81, Y: 148,176, one pixel: 63 148 Blob 9 of 22, id: 3, sources: 1, size: 29x28, npix 525, brick X: 27,56, Y: 31,59, one pixel: 40 31 Blob 10 of 22, id: 6, sources: 1, size: 28x28, npix 498, brick X: 162,190, Y: 38,66, one pixel: 177 38 Blob 11 of 22, id: 14, sources: 1, size: 27x26, npix 443, brick X: 97,124, Y: 155,181, one pixel: 109 155 Blob 12 of 22, id: 5, sources: 2, size: 19x37, npix 434, brick X: 250,269, Y: 34,71, one pixel: 259 34 Blob 13 of 22, id: 0, sources: 1, size: 28x23, npix 413, brick X: 93,121, Y: 13,36, one pixel: 105 13 Blob 14 of 22, id: 19, sources: 1, size: 26x24, npix 397, brick X: 64,90, Y: 212,236, one pixel: 73 212 Blob 15 of 22, id: 8, sources: 1, size: 24x24, npix 353, brick X: 0,24, Y: 67,91, one pixel: 11 67 Blob 16 of 22, id: 11, sources: 1, size: 25x23, npix 353, brick X: 193,218, Y: 121,144, one pixel: 203 121 Blob 17 of 22, id: 7, sources: 1, size: 23x22, npix 298, brick X: 110,133, Y: 40,62, one pixel: 120 40 Blob 18 of 22, id: 4, sources: 1, size: 16x24, npix 272, brick X: 0,16, Y: 33,57, one pixel: 4 33 Blob 13 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151392 MB Blob 16 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.0936 MB Blob 19 of 22, id: 12, sources: 1, size: 21x21, npix 249, brick X: 216,237, Y: 146,167, one pixel: 224 146 Blob 20 of 22, id: 15, sources: 1, size: 20x19, npix 209, brick X: 229,249, Y: 159,178, one pixel: 238 159 Blob 15 finished, total: Wall: 0.35 s, CPU: 0.31 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.0943 MB Blob 21 of 22, id: 16, sources: 1, size: 19x19, npix 199, brick X: 37,56, Y: 184,203, one pixel: 46 184 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.88166, 35.40830), pm (1.7, -9.9), parallax 1.097 with NanoMaggies: g=(flux -2.79), r=19.6, z=(flux -2.54) Reset brightness to NanoMaggies: g=21.7, r=20.5, z=19.7 Measuring 1 iterative sources Blob 17 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151392 MB Blob 22 of 22, id: 1, sources: 1, size: 17x17, npix 145, brick X: 58,75, Y: 18,35, one pixel: 66 18 Blob 8 finished, total: Wall: 0.63 s, CPU: 0.57 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15096 MB Blob 12 finished, total: Wall: 0.63 s, CPU: 0.59 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150888 MB Blob 19 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094408 MB Blob 11 finished, total: Wall: 0.80 s, CPU: 0.74 s, VmPeak: 806 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150612 MB Blob 14 finished, total: Wall: 0.80 s, CPU: 0.74 s, VmPeak: 812 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150556 MB Blob 20 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151392 MB Blob 10 finished, total: Wall: 0.92 s, CPU: 0.87 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.09352 MB Blob 22 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 808 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150888 MB Blob 18 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.093824 MB Blob 9 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 807 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151364 MB Blob 21 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15096 MB Blob 3 finished, total: Wall: 1.00 s, CPU: 0.98 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09354 MB Blob 6 finished, total: Wall: 0.99 s, CPU: 0.97 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150216 MB Blob 7 finished, total: Wall: 1.13 s, CPU: 1.06 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151128 MB Blob 4 finished, total: Wall: 1.75 s, CPU: 1.71 s, VmPeak: 811 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15042 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.28 s, CPU: 2.21 s, VmPeak: 813 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151584 MB Blob 2 finished, total: Wall: 2.33 s, CPU: 2.28 s, VmPeak: 815 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.151472 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.84576, ee1=-0.342337, ee2=-1.26688 Measuring 3 iterative sources Blob 1 finished, total: Wall: 8.11 s, CPU: 8.07 s, VmPeak: 684 MB, VmSize: 681 MB, VmRSS: 109 MB, VmData: 152 MB, maxrss: 0.11486 MB Old catalog: 43 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/blobs-custom-273891p35398.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/metrics/cus/all-models-custom-273891p35398.fits Stage fitblobs : Wall: 11.64 s, CPU: 3.26 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 286 MB, VmData: 310 MB, maxrss: 0.29292 MB Stage fitblobs finished: 2020-08-05T20:21:54.916886 Resources for stage fitblobs : 24.908 s worker CPU, 27.424 s worker Wall, Wall: 11.641 s, Cores in use: 2.42, Total efficiency (on 16 cores): 15.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:21:54.931170 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/tmp-legacysurvey-custom-273891p35398-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/tmp-legacysurvey-custom-273891p35398-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/tmp-legacysurvey-custom-273891p35398-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/tmp-legacysurvey-custom-273891p35398-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-resid.jpg Stage coadds : Wall: 2.98 s, CPU: 0.80 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 286 MB, VmData: 310 MB, maxrss: 0.293244 MB Stage coadds finished: 2020-08-05T20:21:57.913506 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 8.363 s worker CPU, 14.044 s worker Wall, Wall: 2.984 s, Cores in use: 3.07, Total efficiency (on 16 cores): 19.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T20:21:57.930986 Cut to 1 unWISE tiles Reading WISE tile 2741p348 band 1 Reading WISE tile 2741p348 band 2 Reading WISE tile 2741p348 band 3 Reading WISE tile 2741p348 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 809 MB, VmRSS: 150 MB, VmData: 177 MB, maxrss: 0.191528 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212428 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 180 MB, maxrss: 0.209664 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 806 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.21056 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/tmp-legacysurvey-custom-273891p35398-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/tmp-legacysurvey-custom-273891p35398-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.38 s, CPU: 1.12 s, VmPeak: 1055 MB, VmSize: 1055 MB, VmRSS: 287 MB, VmData: 310 MB, maxrss: 0.293756 MB Stage wise_forced finished: 2020-08-05T20:22:02.315046 Resources for stage wise_forced : 3.267 s worker CPU, 8.670 s worker Wall, Wall: 4.386 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:22:02.334605 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/coadd/cus/custom-273891p35398/legacysurvey-custom-273891p35398-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/tractor-i/cus/tractor-custom-273891p35398.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/tractor/cus/tractor-custom-273891p35398.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/tractor/cus/brick-custom-273891p35398.sha256sum Stage writecat : Wall: 1.29 s, CPU: 0.90 s, VmPeak: 1187 MB, VmSize: 1059 MB, VmRSS: 289 MB, VmData: 310 MB, maxrss: 0.426636 MB Stage writecat finished: 2020-08-05T20:22:03.625441 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.293 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/273/PGC2063912/PGC2063912-largegalaxy-writecat.p All done: 44.557 s worker CPU, 100.483 s worker Wall, Wall: 55.777 s, Cores in use: 1.14, Total efficiency (on 16 cores): 7.1 % Finished galaxy PGC2063912 in 1.012 minutes. Started working on galaxy PGC2063912 at Fri Aug 7 09:34:17 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:34:18.576842 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.8909280758087', '35.397689877399024', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.8909280758087 35.397689877399024 Starting process 27750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 27751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 27752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 27753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 27754 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 27755 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 27756 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 27757 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 27758 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 27759 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 27760 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 27761 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 27762 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 27763 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 27764 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 27765 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:34:19.061536 Keeping 11 CCDs: k4m_180206_124628_ooi_zd_ls9-CCD1 z expnum 160861 exptime 80.105 propid 2016A-0453 seeing 0.99 MJD 58155.532 object MzLS_582478_z mosaic/CP/V4.3/CP20180205/k4m_180206_124628_ooi_zd_ls9.fits.fz k4m_160418_113311_ooi_zd_ls9-CCD1 z expnum 83118 exptime 80.104 propid 2016A-0453 seeing 1.71 MJD 57496.481 object MzLS_582478_z mosaic/CP/V4.3/CP20160417/k4m_160418_113311_ooi_zd_ls9.fits.fz k4m_160429_105249_ooi_zd_ls9-CCD2 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.34 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz k4m_160415_114739_ooi_zd_ls9-CCD2 z expnum 82531 exptime 100.103 propid 2016A-0453 seeing 0.96 MJD 57493.491 object MzLS_579412_z mosaic/CP/V4.3/CP20160414/k4m_160415_114739_ooi_zd_ls9.fits.fz k4m_160413_115010_ooi_zd_ls9-CCD3 z expnum 82024 exptime 80.102 propid 2016A-0453 seeing 0.80 MJD 57491.493 object MzLS_581458_z mosaic/CP/V4.3/CP20160412/k4m_160413_115010_ooi_zd_ls9.fits.fz ksb_160602_084446_ooi_g_ls9-CCD3 g expnum 75410136 exptime 113.4 propid BASS seeing 1.21 MJD 57541.364 object 08262 90prime/CP/V2.3/CP20160601/ksb_160602_084446_ooi_g_ls9.fits.fz ksb_160510_110205_ooi_r_ls9-CCD3 r expnum 75180255 exptime 58.8 propid BASS seeing 1.05 MJD 57518.460 object 08262 90prime/CP/V2.3/CP20160509/ksb_160510_110205_ooi_r_ls9.fits.fz ksb_160414_114341_ooi_r_ls9-CCD3 r expnum 74920208 exptime 50.7 propid BASS seeing 1.06 MJD 57492.489 object 08261 90prime/CP/V2.3/CP20160413/ksb_160414_114341_ooi_r_ls9.fits.fz ksb_160504_102503_ooi_g_ls9-CCD3 g expnum 75120198 exptime 96.4 propid BASS seeing 1.40 MJD 57512.434 object 08261 90prime/CP/V2.3/CP20160503/ksb_160504_102503_ooi_g_ls9.fits.fz ksb_160628_080419_ooi_r_ls9-CCD4 r expnum 75670116 exptime 157.1 propid BASS seeing 1.12 MJD 57567.336 object 09613 90prime/CP/V2.3/CP20160627/ksb_160628_080419_ooi_r_ls9.fits.fz ksb_160702_081312_ooi_g_ls9-CCD4 g expnum 75710099 exptime 125.7 propid BASS seeing 1.96 MJD 57571.343 object 09613 90prime/CP/V2.3/CP20160701/ksb_160702_081312_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 0 2039 Range in image: x 0 272 , y 0 64 (with image size 272 x 275) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 2040 4078 Range in image: x 0 272 , y 64 275 (with image size 272 x 275) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1030 1301 and amp range 0 2047 and image y 2701 2972 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.008550294 -> scaling image by 1.0079062018164673 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3780 4061 and amp range 2048 4095 and image y 1341 1620 and amp range 0 2039 Range in image: x 0 282 , y 0 280 (with image size 282 x 280) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2649 2807 and amp range 2016 4031 and image y 293 449 and amp range 0 2047 Range in image: x 0 159 , y 0 157 (with image size 159 x 157) dzp 0.010226944 -> scaling image by 1.0094638657706572 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 90prime get_fwhm: self.fwhm = 2.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 885 1042 and amp range 0 2015 and image y 46 203 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 0 2047 Range in image: x 0 157 , y 0 27 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 2048 4095 Range in image: x 0 157 , y 27 157 (with image size 157 x 157) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 90prime get_fwhm: self.fwhm = 2.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 0 2047 Range in image: x 0 157 , y 0 19 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 2048 4095 Range in image: x 0 157 , y 19 157 (with image size 157 x 157) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3684 3955 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp 0.014419514 -> scaling image by 1.0133694453441033 mosaic get_fwhm: self.fwhm = 6.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 889 1046 and amp range 0 2015 and image y 51 208 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2662 2820 and amp range 2016 4031 and image y 282 439 and amp range 0 2047 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Stage tims : Wall: 304.81 s, CPU: 1.07 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.17864 MB Stage tims finished: 2020-08-07T09:39:23.875783 Resources for stage tims : 5.638 s worker CPU, 1198.387 s worker Wall, Wall: 304.816 s, Cores in use: 0.02, Total efficiency (on 16 cores): 0.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:39:23.980068 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 9 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/reference-custom-273890p35397.fits Stage refs : Wall: 8.18 s, CPU: 6.58 s, VmPeak: 1044 MB, VmSize: 1038 MB, VmRSS: 264 MB, VmData: 295 MB, maxrss: 0.270156 MB Stage refs finished: 2020-08-07T09:39:32.157609 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.179 s, Cores in use: 0.81, Total efficiency (on 16 cores): 5.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:39:32.263602 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/outlier-mask-custom-273890p35397.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/outliers-pre-custom-273890p35397.jpg Image ksb_160602_084446_ooi_g_ls9-CCD3 g : masking 127 positive outlier pixels and 0 negative outlier pixels Image ksb_160628_080419_ooi_r_ls9-CCD4 r : masking 58 positive outlier pixels and 0 negative outlier pixels Image k4m_180206_124628_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 229 negative outlier pixels Image k4m_160418_113311_ooi_zd_ls9-CCD1 z : masking 1265 positive outlier pixels and 472 negative outlier pixels Image k4m_160429_105249_ooi_zd_ls9-CCD2 z : masking 360 positive outlier pixels and 278 negative outlier pixels Image k4m_160415_114739_ooi_zd_ls9-CCD2 z : masking 557 positive outlier pixels and 202 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/outlier-mask-custom-273890p35397.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/outliers-post-custom-273890p35397.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/outliers-masked-pos-custom-273890p35397.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/outliers-masked-neg-custom-273890p35397.jpg Stage outliers : Wall: 1.03 s, CPU: 0.72 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 280 MB, VmData: 308 MB, maxrss: 0.286496 MB Stage outliers finished: 2020-08-07T09:39:33.297139 Resources for stage outliers : 0.926 s worker CPU, 0.972 s worker Wall, Wall: 1.035 s, Cores in use: 1.59, Total efficiency (on 16 cores): 9.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:39:33.320556 Stage halos : Wall: 0.29 s, CPU: 0.28 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 280 MB, VmData: 309 MB, maxrss: 0.287016 MB Stage halos finished: 2020-08-07T09:39:33.614289 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.295 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:39:33.773118 PSF sigmas in coadd pixels: ['1.96', '2.27', '3.19'] Using average PSF sigma 2.4754625557881815 Gaussian PSF norm 0.11395639619523949 vs pixelized 0.0903585 average tim pixel scale / coadd scale: 1.7295615305015035 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.70', '1.71', '1.82'] Using average PSF sigma 1.7443592086240056 Gaussian PSF norm 0.1617182919545577 vs pixelized 0.12690596 average tim pixel scale / coadd scale: 1.7296402441437235 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.61', '2.78', '2.17', '1.56', '1.30'] Using average PSF sigma 1.8850144421701458 Gaussian PSF norm 0.1496512628566989 vs pixelized 0.122071534 average tim pixel scale / coadd scale: 0.9909978506105547 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.289948 MB Stage fit_on_coadds finished: 2020-08-07T09:39:33.958796 Resources for stage fit_on_coadds : 0.222 s worker CPU, 0.222 s worker Wall, Wall: 0.187 s, Cores in use: 2.15, Total efficiency (on 16 cores): 13.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:39:33.968631 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 1.3937864e-05 Median coadd sky for r : 8.188551e-05 Median coadd sky for z : 0.00011360565 Stage srcs : Wall: 0.47 s, CPU: 0.44 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 284 MB, VmData: 310 MB, maxrss: 0.29066 MB Stage srcs finished: 2020-08-07T09:39:34.443051 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage srcs : 0.078 s worker CPU, 0.078 s worker Wall, Wall: 0.476 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:39:34.454808 Blob 1 of 21, id: 9, sources: 5, size: 137x105, npix 6781, brick X: 70,207, Y: 86,191, one pixel: 85 86 Blob 2 of 21, id: 16, sources: 4, size: 94x62, npix 2857, brick X: 117,211, Y: 206,268, one pixel: 185 206 Blob 3 of 21, id: 10, sources: 2, size: 60x38, npix 1435, brick X: 6,66, Y: 114,152, one pixel: 46 114 Blob 4 of 21, id: 19, sources: 3, size: 54x33, npix 1404, brick X: 192,246, Y: 236,269, one pixel: 231 236 Blob 5 of 21, id: 17, sources: 3, size: 33x57, npix 1166, brick X: 0,33, Y: 207,264, one pixel: 17 207 Blob 6 of 21, id: 20, sources: 1, size: 37x27, npix 729, brick X: 59,96, Y: 242,269, one pixel: 74 242 Blob 7 of 21, id: 2, sources: 1, size: 31x31, npix 622, brick X: 211,242, Y: 29,60, one pixel: 223 29 Blob 8 of 21, id: 3, sources: 1, size: 29x29, npix 534, brick X: 26,55, Y: 35,64, one pixel: 39 35 Blob 9 of 21, id: 13, sources: 1, size: 28x27, npix 511, brick X: 51,79, Y: 153,180, one pixel: 61 153 Blob 10 of 21, id: 6, sources: 1, size: 27x28, npix 496, brick X: 161,188, Y: 43,71, one pixel: 174 43 Blob 11 of 21, id: 5, sources: 2, size: 21x38, npix 493, brick X: 248,269, Y: 39,77, one pixel: 257 39 Blob 12 of 21, id: 14, sources: 1, size: 26x26, npix 440, brick X: 96,122, Y: 159,185, one pixel: 108 159 Blob 13 of 21, id: 18, sources: 1, size: 26x25, npix 406, brick X: 62,88, Y: 216,241, one pixel: 73 216 Blob 14 of 21, id: 0, sources: 1, size: 28x22, npix 400, brick X: 91,119, Y: 18,40, one pixel: 103 18 Blob 15 of 21, id: 11, sources: 1, size: 24x24, npix 353, brick X: 192,216, Y: 125,149, one pixel: 203 125 Blob 16 of 21, id: 8, sources: 1, size: 23x24, npix 337, brick X: 0,23, Y: 72,96, one pixel: 9 72 Blob 17 of 21, id: 7, sources: 1, size: 23x21, npix 290, brick X: 108,131, Y: 45,66, one pixel: 117 45 Blob 18 of 21, id: 12, sources: 1, size: 21x21, npix 257, brick X: 214,235, Y: 150,171, one pixel: 224 150 Blob 14 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 797 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.133688 MB Blob 19 of 21, id: 4, sources: 1, size: 14x22, npix 207, brick X: 0,14, Y: 38,60, one pixel: 4 38 Blob 16 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147176 MB Blob 15 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146844 MB Blob 20 of 21, id: 15, sources: 1, size: 18x19, npix 198, brick X: 36,54, Y: 189,208, one pixel: 44 189 Blob 21 of 21, id: 1, sources: 1, size: 17x17, npix 145, brick X: 56,73, Y: 23,40, one pixel: 64 23 Blob 17 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 797 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.133688 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.88166, 35.40830), pm (1.7, -9.9), parallax 1.097 with NanoMaggies: g=18.9, r=(flux -16.6), z=(flux -131) Reset brightness to NanoMaggies: g=21.7, r=20.5, z=19.7 Measuring 1 iterative sources Blob 9 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094096 MB Blob 11 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146496 MB Blob 18 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147176 MB Blob 13 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 789 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.133788 MB Blob 12 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147616 MB Blob 20 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 797 MB, VmSize: 712 MB, VmRSS: 131 MB, VmData: 170 MB, maxrss: 0.133688 MB Blob 21 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094212 MB Blob 8 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147368 MB Blob 19 finished, total: Wall: 0.52 s, CPU: 0.52 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146844 MB Blob 6 finished, total: Wall: 0.94 s, CPU: 0.93 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146812 MB Blob 10 finished, total: Wall: 0.93 s, CPU: 0.92 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094464 MB Blob 4 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094536 MB Blob 7 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093348 MB Blob 3 finished, total: Wall: 1.49 s, CPU: 1.48 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097472 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.03 s, CPU: 2.03 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147608 MB Blob 5 finished, total: Wall: 2.12 s, CPU: 2.11 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148012 MB Exception in one_blob: brick custom-273890p35397, iblob 9 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2063912; please check the logfile. Finished galaxy PGC2063912 in 5.352 minutes. Started working on galaxy PGC2063912 at Fri Aug 7 12:06:05 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:06:06.553438 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.8909280758087', '35.397689877399024', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.8909280758087 35.397689877399024 Starting process 16567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 16572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16577 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16584 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16586 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 16589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16592 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:06:07.042443 Keeping 11 CCDs: k4m_180206_124628_ooi_zd_ls9-CCD1 z expnum 160861 exptime 80.105 propid 2016A-0453 seeing 0.99 MJD 58155.532 object MzLS_582478_z mosaic/CP/V4.3/CP20180205/k4m_180206_124628_ooi_zd_ls9.fits.fz k4m_160418_113311_ooi_zd_ls9-CCD1 z expnum 83118 exptime 80.104 propid 2016A-0453 seeing 1.71 MJD 57496.481 object MzLS_582478_z mosaic/CP/V4.3/CP20160417/k4m_160418_113311_ooi_zd_ls9.fits.fz k4m_160429_105249_ooi_zd_ls9-CCD2 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.34 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz k4m_160415_114739_ooi_zd_ls9-CCD2 z expnum 82531 exptime 100.103 propid 2016A-0453 seeing 0.96 MJD 57493.491 object MzLS_579412_z mosaic/CP/V4.3/CP20160414/k4m_160415_114739_ooi_zd_ls9.fits.fz k4m_160413_115010_ooi_zd_ls9-CCD3 z expnum 82024 exptime 80.102 propid 2016A-0453 seeing 0.80 MJD 57491.493 object MzLS_581458_z mosaic/CP/V4.3/CP20160412/k4m_160413_115010_ooi_zd_ls9.fits.fz ksb_160602_084446_ooi_g_ls9-CCD3 g expnum 75410136 exptime 113.4 propid BASS seeing 1.21 MJD 57541.364 object 08262 90prime/CP/V2.3/CP20160601/ksb_160602_084446_ooi_g_ls9.fits.fz ksb_160510_110205_ooi_r_ls9-CCD3 r expnum 75180255 exptime 58.8 propid BASS seeing 1.05 MJD 57518.460 object 08262 90prime/CP/V2.3/CP20160509/ksb_160510_110205_ooi_r_ls9.fits.fz ksb_160414_114341_ooi_r_ls9-CCD3 r expnum 74920208 exptime 50.7 propid BASS seeing 1.06 MJD 57492.489 object 08261 90prime/CP/V2.3/CP20160413/ksb_160414_114341_ooi_r_ls9.fits.fz ksb_160504_102503_ooi_g_ls9-CCD3 g expnum 75120198 exptime 96.4 propid BASS seeing 1.40 MJD 57512.434 object 08261 90prime/CP/V2.3/CP20160503/ksb_160504_102503_ooi_g_ls9.fits.fz ksb_160628_080419_ooi_r_ls9-CCD4 r expnum 75670116 exptime 157.1 propid BASS seeing 1.12 MJD 57567.336 object 09613 90prime/CP/V2.3/CP20160627/ksb_160628_080419_ooi_r_ls9.fits.fz ksb_160702_081312_ooi_g_ls9-CCD4 g expnum 75710099 exptime 125.7 propid BASS seeing 1.96 MJD 57571.343 object 09613 90prime/CP/V2.3/CP20160701/ksb_160702_081312_ooi_g_ls9.fits.fz Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 889 1046 and amp range 0 2015 and image y 51 208 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 90prime get_fwhm: self.fwhm = 2.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 885 1042 and amp range 0 2015 and image y 46 203 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 90prime get_fwhm: self.fwhm = 2.31 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 0 2047 Range in image: x 0 157 , y 0 19 (with image size 157 x 157) Found overlap: image x 2662 2820 and amp range 2016 4031 and image y 282 439 and amp range 0 2047 dzp 0.004245165 -> scaling image by 1.0039175950705865 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 2048 4095 Range in image: x 0 157 , y 19 157 (with image size 157 x 157) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 6.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 0 2047 Range in image: x 0 157 , y 0 27 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 2048 4095 Range in image: x 0 157 , y 27 157 (with image size 157 x 157) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2649 2807 and amp range 2016 4031 and image y 293 449 and amp range 0 2047 Range in image: x 0 159 , y 0 157 (with image size 159 x 157) dzp 0.010226944 -> scaling image by 1.0094638657706572 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3684 3955 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp 0.014419514 -> scaling image by 1.0133694453441033 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3780 4061 and amp range 2048 4095 and image y 1341 1620 and amp range 0 2039 Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 0 2039 Range in image: x 0 282 , y 0 280 (with image size 282 x 280) Range in image: x 0 272 , y 0 64 (with image size 272 x 275) dzp 0.0072022504 -> scaling image by 1.0066555682883527 dzp -0.00064781494 -> scaling image by 0.9994035183523652 Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 2040 4078 Range in image: x 0 272 , y 64 275 (with image size 272 x 275) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1030 1301 and amp range 0 2047 and image y 2701 2972 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.008550294 -> scaling image by 1.0079062018164673 Stage tims : Wall: 2.35 s, CPU: 0.85 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.17932 MB Stage tims finished: 2020-08-07T12:06:09.395622 Resources for stage tims : 5.678 s worker CPU, 12.072 s worker Wall, Wall: 2.356 s, Cores in use: 2.77, Total efficiency (on 32 cores): 8.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:06:09.429325 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 9 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/reference-custom-273890p35397.fits Stage refs : Wall: 6.69 s, CPU: 6.47 s, VmPeak: 1044 MB, VmSize: 1038 MB, VmRSS: 264 MB, VmData: 296 MB, maxrss: 0.270828 MB Stage refs finished: 2020-08-07T12:06:16.119103 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 6.692 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:06:16.144181 Stage outliers : Wall: 0.37 s, CPU: 0.34 s, VmPeak: 1044 MB, VmSize: 1039 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.271868 MB Stage outliers finished: 2020-08-07T12:06:16.510249 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.368 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:06:16.537261 Stage halos : Wall: 0.31 s, CPU: 0.29 s, VmPeak: 1044 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 300 MB, maxrss: 0.274944 MB Stage halos finished: 2020-08-07T12:06:16.844903 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.310 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:06:16.871205 PSF sigmas in coadd pixels: ['1.96', '2.27', '3.19'] Using average PSF sigma 2.4754625557881815 Gaussian PSF norm 0.11395639619523949 vs pixelized 0.0903585 average tim pixel scale / coadd scale: 1.7295615305015035 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.70', '1.71', '1.82'] Using average PSF sigma 1.7443592086240056 Gaussian PSF norm 0.1617182919545577 vs pixelized 0.12690596 average tim pixel scale / coadd scale: 1.7296402441437235 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.61', '2.78', '2.17', '1.56', '1.30'] Using average PSF sigma 1.8850144421701458 Gaussian PSF norm 0.1496512628566989 vs pixelized 0.122071534 average tim pixel scale / coadd scale: 0.9909978506105547 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.18 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 279 MB, VmData: 308 MB, maxrss: 0.286068 MB Stage fit_on_coadds finished: 2020-08-07T12:06:17.104353 Resources for stage fit_on_coadds : 0.246 s worker CPU, 0.371 s worker Wall, Wall: 0.235 s, Cores in use: 1.83, Total efficiency (on 32 cores): 5.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:06:17.118483 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 1.3937864e-05 Median coadd sky for r : 8.188551e-05 Median coadd sky for z : 0.00011360593 Stage srcs : Wall: 0.52 s, CPU: 0.47 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 280 MB, VmData: 308 MB, maxrss: 0.28692 MB Stage srcs finished: 2020-08-07T12:06:17.643365 Resources for stage srcs : 0.107 s worker CPU, 0.121 s worker Wall, Wall: 0.527 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:06:17.657662 Blob 1 of 21, id: 9, sources: 5, size: 137x105, npix 6781, brick X: 70,207, Y: 86,191, one pixel: 85 86 Blob 2 of 21, id: 16, sources: 4, size: 94x62, npix 2857, brick X: 117,211, Y: 206,268, one pixel: 185 206 Blob 3 of 21, id: 10, sources: 2, size: 60x38, npix 1435, brick X: 6,66, Y: 114,152, one pixel: 46 114 Blob 4 of 21, id: 19, sources: 3, size: 54x33, npix 1404, brick X: 192,246, Y: 236,269, one pixel: 231 236 Blob 5 of 21, id: 17, sources: 3, size: 33x57, npix 1166, brick X: 0,33, Y: 207,264, one pixel: 17 207 Blob 6 of 21, id: 20, sources: 1, size: 37x27, npix 729, brick X: 59,96, Y: 242,269, one pixel: 74 242 Blob 7 of 21, id: 2, sources: 1, size: 31x31, npix 622, brick X: 211,242, Y: 29,60, one pixel: 223 29 Blob 8 of 21, id: 3, sources: 1, size: 29x29, npix 534, brick X: 26,55, Y: 35,64, one pixel: 39 35 Blob 9 of 21, id: 13, sources: 1, size: 28x27, npix 511, brick X: 51,79, Y: 153,180, one pixel: 61 153 Blob 10 of 21, id: 6, sources: 1, size: 27x28, npix 496, brick X: 161,188, Y: 43,71, one pixel: 174 43 Blob 11 of 21, id: 5, sources: 2, size: 21x38, npix 493, brick X: 248,269, Y: 39,77, one pixel: 257 39 Blob 12 of 21, id: 14, sources: 1, size: 26x26, npix 440, brick X: 96,122, Y: 159,185, one pixel: 108 159 Blob 13 of 21, id: 18, sources: 1, size: 26x25, npix 406, brick X: 62,88, Y: 216,241, one pixel: 73 216 Blob 14 of 21, id: 0, sources: 1, size: 28x22, npix 400, brick X: 91,119, Y: 18,40, one pixel: 103 18 Blob 15 of 21, id: 11, sources: 1, size: 24x24, npix 353, brick X: 192,216, Y: 125,149, one pixel: 203 125 Blob 16 of 21, id: 8, sources: 1, size: 23x24, npix 337, brick X: 0,23, Y: 72,96, one pixel: 9 72 Blob 17 of 21, id: 7, sources: 1, size: 23x21, npix 290, brick X: 108,131, Y: 45,66, one pixel: 117 45 Blob 18 of 21, id: 12, sources: 1, size: 21x21, npix 257, brick X: 214,235, Y: 150,171, one pixel: 224 150 Blob 19 of 21, id: 4, sources: 1, size: 14x22, npix 207, brick X: 0,14, Y: 38,60, one pixel: 4 38 Blob 20 of 21, id: 15, sources: 1, size: 18x19, npix 198, brick X: 36,54, Y: 189,208, one pixel: 44 189 Blob 21 of 21, id: 1, sources: 1, size: 17x17, npix 145, brick X: 56,73, Y: 23,40, one pixel: 64 23 Blob 17 finished, total: Wall: 0.16 s, CPU: 0.16 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092744 MB Blob 15 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145604 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.88166, 35.40830), pm (1.7, -9.9), parallax 1.097 with NanoMaggies: g=18.9, r=(flux -16.5), z=(flux -131) Reset brightness to NanoMaggies: g=21.7, r=20.5, z=19.7 Blob 21 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092392 MB Blob 14 finished, total: Wall: 0.29 s, CPU: 0.26 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089732 MB Blob 18 finished, total: Wall: 0.29 s, CPU: 0.25 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.089584 MB Blob 16 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 797 MB, VmSize: 711 MB, VmRSS: 128 MB, VmData: 169 MB, maxrss: 0.131564 MB Blob 20 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092396 MB Blob 9 finished, total: Wall: 0.38 s, CPU: 0.37 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092448 MB Blob 11 finished, total: Wall: 0.39 s, CPU: 0.35 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090044 MB Measuring 1 iterative sources Blob 12 finished, total: Wall: 0.46 s, CPU: 0.45 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146 MB Blob 13 finished, total: Wall: 0.48 s, CPU: 0.47 s, VmPeak: 807 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146536 MB Blob 19 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14564 MB Blob 10 finished, total: Wall: 0.58 s, CPU: 0.56 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.09002 MB Blob 7 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145604 MB Blob 8 finished, total: Wall: 0.71 s, CPU: 0.70 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145036 MB Blob 4 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146292 MB Blob 6 finished, total: Wall: 0.88 s, CPU: 0.85 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090348 MB Blob 3 finished, total: Wall: 1.33 s, CPU: 1.29 s, VmPeak: 667 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.091008 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 1.88 s, CPU: 1.88 s, VmPeak: 789 MB, VmSize: 712 MB, VmRSS: 129 MB, VmData: 170 MB, maxrss: 0.131832 MB Blob 5 finished, total: Wall: 1.93 s, CPU: 1.89 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091412 MB Exception in one_blob: brick custom-273890p35397, iblob 9 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2063912; please check the logfile. Finished galaxy PGC2063912 in 0.257 minutes. Started working on galaxy PGC2063912 at Fri Aug 7 12:32:20 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:32:21.724960 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.8909280758087', '35.397689877399024', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.8909280758087 35.397689877399024 Starting process 19595 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19597 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19599 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 19600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19601 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 19607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 19613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 19616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 19618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 19619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 19622 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19623 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19625 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19626 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:32:22.196921 Keeping 11 CCDs: k4m_180206_124628_ooi_zd_ls9-CCD1 z expnum 160861 exptime 80.105 propid 2016A-0453 seeing 0.99 MJD 58155.532 object MzLS_582478_z mosaic/CP/V4.3/CP20180205/k4m_180206_124628_ooi_zd_ls9.fits.fz k4m_160418_113311_ooi_zd_ls9-CCD1 z expnum 83118 exptime 80.104 propid 2016A-0453 seeing 1.71 MJD 57496.481 object MzLS_582478_z mosaic/CP/V4.3/CP20160417/k4m_160418_113311_ooi_zd_ls9.fits.fz k4m_160429_105249_ooi_zd_ls9-CCD2 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.34 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz k4m_160415_114739_ooi_zd_ls9-CCD2 z expnum 82531 exptime 100.103 propid 2016A-0453 seeing 0.96 MJD 57493.491 object MzLS_579412_z mosaic/CP/V4.3/CP20160414/k4m_160415_114739_ooi_zd_ls9.fits.fz k4m_160413_115010_ooi_zd_ls9-CCD3 z expnum 82024 exptime 80.102 propid 2016A-0453 seeing 0.80 MJD 57491.493 object MzLS_581458_z mosaic/CP/V4.3/CP20160412/k4m_160413_115010_ooi_zd_ls9.fits.fz ksb_160602_084446_ooi_g_ls9-CCD3 g expnum 75410136 exptime 113.4 propid BASS seeing 1.21 MJD 57541.364 object 08262 90prime/CP/V2.3/CP20160601/ksb_160602_084446_ooi_g_ls9.fits.fz ksb_160510_110205_ooi_r_ls9-CCD3 r expnum 75180255 exptime 58.8 propid BASS seeing 1.05 MJD 57518.460 object 08262 90prime/CP/V2.3/CP20160509/ksb_160510_110205_ooi_r_ls9.fits.fz ksb_160414_114341_ooi_r_ls9-CCD3 r expnum 74920208 exptime 50.7 propid BASS seeing 1.06 MJD 57492.489 object 08261 90prime/CP/V2.3/CP20160413/ksb_160414_114341_ooi_r_ls9.fits.fz ksb_160504_102503_ooi_g_ls9-CCD3 g expnum 75120198 exptime 96.4 propid BASS seeing 1.40 MJD 57512.434 object 08261 90prime/CP/V2.3/CP20160503/ksb_160504_102503_ooi_g_ls9.fits.fz ksb_160628_080419_ooi_r_ls9-CCD4 r expnum 75670116 exptime 157.1 propid BASS seeing 1.12 MJD 57567.336 object 09613 90prime/CP/V2.3/CP20160627/ksb_160628_080419_ooi_r_ls9.fits.fz ksb_160702_081312_ooi_g_ls9-CCD4 g expnum 75710099 exptime 125.7 propid BASS seeing 1.96 MJD 57571.343 object 09613 90prime/CP/V2.3/CP20160701/ksb_160702_081312_ooi_g_ls9.fits.fz mosaic get_fwhm: self.fwhm = 6.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 90prime get_fwhm: self.fwhm = 2.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 885 1042 and amp range 0 2015 and image y 46 203 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2649 2807 and amp range 2016 4031 and image y 293 449 and amp range 0 2047 Range in image: x 0 159 , y 0 157 (with image size 159 x 157) dzp 0.010226944 -> scaling image by 1.0094638657706572 Found overlap: image x 2662 2820 and amp range 2016 4031 and image y 282 439 and amp range 0 2047 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.0047082007 -> scaling image by 1.0043458289369953 mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 0 2039 Range in image: x 0 272 , y 0 64 (with image size 272 x 275) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 2040 4078 Range in image: x 0 272 , y 64 275 (with image size 272 x 275) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3684 3955 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp 0.014419514 -> scaling image by 1.0133694453441033 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 90prime get_fwhm: self.fwhm = 2.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 0 2047 Range in image: x 0 157 , y 0 19 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 2048 4095 Range in image: x 0 157 , y 19 157 (with image size 157 x 157) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 889 1046 and amp range 0 2015 and image y 51 208 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.03470582 -> scaling image by 0.9685402452207784 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3780 4061 and amp range 2048 4095 and image y 1341 1620 and amp range 0 2039 Range in image: x 0 282 , y 0 280 (with image size 282 x 280) dzp 0.0072022504 -> scaling image by 1.0066555682883527 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1030 1301 and amp range 0 2047 and image y 2701 2972 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.008550294 -> scaling image by 1.0079062018164673 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 0 2047 Range in image: x 0 157 , y 0 27 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 2048 4095 Range in image: x 0 157 , y 27 157 (with image size 157 x 157) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Stage tims : Wall: 2.30 s, CPU: 0.77 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179428 MB Stage tims finished: 2020-08-07T12:32:24.496022 Resources for stage tims : 5.670 s worker CPU, 13.516 s worker Wall, Wall: 2.301 s, Cores in use: 2.80, Total efficiency (on 32 cores): 8.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:32:24.518532 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 9 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/reference-custom-273890p35397.fits Stage refs : Wall: 6.60 s, CPU: 6.44 s, VmPeak: 1044 MB, VmSize: 1038 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.27072 MB Stage refs finished: 2020-08-07T12:32:31.122999 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 6.607 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:32:31.147631 Stage outliers : Wall: 0.27 s, CPU: 0.24 s, VmPeak: 1044 MB, VmSize: 1039 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.27176 MB Stage outliers finished: 2020-08-07T12:32:31.418735 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.273 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:32:31.459259 Stage halos : Wall: 0.20 s, CPU: 0.19 s, VmPeak: 1044 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 300 MB, maxrss: 0.27474 MB Stage halos finished: 2020-08-07T12:32:31.657212 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.200 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T12:32:31.683926 PSF sigmas in coadd pixels: ['1.96', '2.27', '3.19'] Using average PSF sigma 2.4754625557881815 Gaussian PSF norm 0.11395639619523949 vs pixelized 0.09035851 average tim pixel scale / coadd scale: 1.7295615305015035 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.70', '1.71', '1.82'] Using average PSF sigma 1.7443592086240056 Gaussian PSF norm 0.1617182919545577 vs pixelized 0.12690596 average tim pixel scale / coadd scale: 1.7296402441437235 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.61', '2.78', '2.17', '1.56', '1.30'] Using average PSF sigma 1.8850144421701458 Gaussian PSF norm 0.1496512628566989 vs pixelized 0.122071534 average tim pixel scale / coadd scale: 0.9909978506105547 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.19 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 279 MB, VmData: 308 MB, maxrss: 0.28614 MB Stage fit_on_coadds finished: 2020-08-07T12:32:31.885524 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.238 s worker CPU, 0.365 s worker Wall, Wall: 0.204 s, Cores in use: 2.11, Total efficiency (on 32 cores): 6.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T12:32:31.897705 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 1.3937895e-05 Median coadd sky for r : 8.1885526e-05 Median coadd sky for z : 0.00011360533 Stage srcs : Wall: 0.45 s, CPU: 0.39 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 280 MB, VmData: 308 MB, maxrss: 0.286896 MB Stage srcs finished: 2020-08-07T12:32:32.348350 Resources for stage srcs : 0.126 s worker CPU, 0.126 s worker Wall, Wall: 0.453 s, Cores in use: 1.16, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:32:32.379032 Blob 1 of 21, id: 9, sources: 5, size: 137x105, npix 6781, brick X: 70,207, Y: 86,191, one pixel: 85 86 Blob 2 of 21, id: 16, sources: 4, size: 94x62, npix 2857, brick X: 117,211, Y: 206,268, one pixel: 185 206 Blob 3 of 21, id: 10, sources: 2, size: 60x38, npix 1435, brick X: 6,66, Y: 114,152, one pixel: 46 114 Blob 4 of 21, id: 19, sources: 3, size: 54x33, npix 1404, brick X: 192,246, Y: 236,269, one pixel: 231 236 Blob 5 of 21, id: 17, sources: 3, size: 33x57, npix 1166, brick X: 0,33, Y: 207,264, one pixel: 17 207 Blob 6 of 21, id: 20, sources: 1, size: 37x27, npix 729, brick X: 59,96, Y: 242,269, one pixel: 74 242 Blob 7 of 21, id: 2, sources: 1, size: 31x31, npix 622, brick X: 211,242, Y: 29,60, one pixel: 223 29 Blob 8 of 21, id: 3, sources: 1, size: 29x29, npix 534, brick X: 26,55, Y: 35,64, one pixel: 39 35 Blob 9 of 21, id: 13, sources: 1, size: 28x27, npix 511, brick X: 51,79, Y: 153,180, one pixel: 61 153 Blob 10 of 21, id: 6, sources: 1, size: 27x28, npix 496, brick X: 161,188, Y: 43,71, one pixel: 174 43 Blob 11 of 21, id: 5, sources: 2, size: 21x38, npix 493, brick X: 248,269, Y: 39,77, one pixel: 257 39 Blob 12 of 21, id: 14, sources: 1, size: 26x26, npix 440, brick X: 96,122, Y: 159,185, one pixel: 108 159 Blob 13 of 21, id: 18, sources: 1, size: 26x25, npix 406, brick X: 62,88, Y: 216,241, one pixel: 73 216 Blob 14 of 21, id: 0, sources: 1, size: 28x22, npix 400, brick X: 91,119, Y: 18,40, one pixel: 103 18 Blob 15 of 21, id: 11, sources: 1, size: 24x24, npix 353, brick X: 192,216, Y: 125,149, one pixel: 203 125 Blob 16 of 21, id: 8, sources: 1, size: 23x24, npix 337, brick X: 0,23, Y: 72,96, one pixel: 9 72 Blob 17 of 21, id: 7, sources: 1, size: 23x21, npix 290, brick X: 108,131, Y: 45,66, one pixel: 117 45 Blob 18 of 21, id: 12, sources: 1, size: 21x21, npix 257, brick X: 214,235, Y: 150,171, one pixel: 224 150 Blob 19 of 21, id: 4, sources: 1, size: 14x22, npix 207, brick X: 0,14, Y: 38,60, one pixel: 4 38 Blob 20 of 21, id: 15, sources: 1, size: 18x19, npix 198, brick X: 36,54, Y: 189,208, one pixel: 44 189 Blob 21 of 21, id: 1, sources: 1, size: 17x17, npix 145, brick X: 56,73, Y: 23,40, one pixel: 64 23 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.88166, 35.40830), pm (1.7, -9.9), parallax 1.097 with NanoMaggies: g=18.9, r=(flux -16.5), z=(flux -131) Reset brightness to NanoMaggies: g=21.7, r=20.5, z=19.7 Blob 17 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093392 MB Blob 14 finished, total: Wall: 0.22 s, CPU: 0.17 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08976 MB Blob 18 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093332 MB Blob 15 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 815 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145252 MB Blob 20 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 789 MB, VmSize: 711 MB, VmRSS: 128 MB, VmData: 169 MB, maxrss: 0.131492 MB Blob 21 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145652 MB Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.38 s, CPU: 0.34 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089792 MB Blob 11 finished, total: Wall: 0.45 s, CPU: 0.45 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092476 MB Blob 12 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093556 MB Blob 19 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146532 MB Blob 13 finished, total: Wall: 0.49 s, CPU: 0.48 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145068 MB Blob 9 finished, total: Wall: 0.49 s, CPU: 0.46 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090016 MB Blob 10 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 797 MB, VmSize: 711 MB, VmRSS: 129 MB, VmData: 169 MB, maxrss: 0.131976 MB Blob 8 finished, total: Wall: 0.63 s, CPU: 0.59 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090184 MB Blob 7 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090256 MB Blob 4 finished, total: Wall: 0.77 s, CPU: 0.75 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091344 MB Blob 6 finished, total: Wall: 0.90 s, CPU: 0.85 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090468 MB Blob 3 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.144984 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.83 s, CPU: 1.82 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 139 MB, maxrss: 0.091388 MB Blob 2 finished, total: Wall: 1.88 s, CPU: 1.86 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.093708 MB Exception in one_blob: brick custom-273890p35397, iblob 9 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2063912; please check the logfile. Finished galaxy PGC2063912 in 0.246 minutes. Started working on galaxy PGC2063912 at Fri Aug 7 13:32:59 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:32:59.819841 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '273.8909280758087', '35.397689877399024', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 273.8909280758087 35.397689877399024 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 273.8909280758087 35.397689877399024 Starting process 23369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 23370 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23371 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23372 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23373 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 23374 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059488 MB Starting process 23375 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059488 MB Starting process 23376 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23377 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23378 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 23379 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 23380 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 23381 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 23382 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23383 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23384 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23385 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 23386 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 23387 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23388 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23389 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23390 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 23391 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 23392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 23393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 23394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 23395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 23396 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 23398 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23397 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:33:00.309202 Keeping 11 CCDs: k4m_180206_124628_ooi_zd_ls9-CCD1 z expnum 160861 exptime 80.105 propid 2016A-0453 seeing 0.99 MJD 58155.532 object MzLS_582478_z mosaic/CP/V4.3/CP20180205/k4m_180206_124628_ooi_zd_ls9.fits.fz k4m_160418_113311_ooi_zd_ls9-CCD1 z expnum 83118 exptime 80.104 propid 2016A-0453 seeing 1.71 MJD 57496.481 object MzLS_582478_z mosaic/CP/V4.3/CP20160417/k4m_160418_113311_ooi_zd_ls9.fits.fz k4m_160429_105249_ooi_zd_ls9-CCD2 z expnum 85804 exptime 80.103 propid 2016A-0453 seeing 1.34 MJD 57507.453 object MzLS_580436_z mosaic/CP/V4.3/CP20160428/k4m_160429_105249_ooi_zd_ls9.fits.fz k4m_160415_114739_ooi_zd_ls9-CCD2 z expnum 82531 exptime 100.103 propid 2016A-0453 seeing 0.96 MJD 57493.491 object MzLS_579412_z mosaic/CP/V4.3/CP20160414/k4m_160415_114739_ooi_zd_ls9.fits.fz k4m_160413_115010_ooi_zd_ls9-CCD3 z expnum 82024 exptime 80.102 propid 2016A-0453 seeing 0.80 MJD 57491.493 object MzLS_581458_z mosaic/CP/V4.3/CP20160412/k4m_160413_115010_ooi_zd_ls9.fits.fz ksb_160602_084446_ooi_g_ls9-CCD3 g expnum 75410136 exptime 113.4 propid BASS seeing 1.21 MJD 57541.364 object 08262 90prime/CP/V2.3/CP20160601/ksb_160602_084446_ooi_g_ls9.fits.fz ksb_160510_110205_ooi_r_ls9-CCD3 r expnum 75180255 exptime 58.8 propid BASS seeing 1.05 MJD 57518.460 object 08262 90prime/CP/V2.3/CP20160509/ksb_160510_110205_ooi_r_ls9.fits.fz ksb_160414_114341_ooi_r_ls9-CCD3 r expnum 74920208 exptime 50.7 propid BASS seeing 1.06 MJD 57492.489 object 08261 90prime/CP/V2.3/CP20160413/ksb_160414_114341_ooi_r_ls9.fits.fz ksb_160504_102503_ooi_g_ls9-CCD3 g expnum 75120198 exptime 96.4 propid BASS seeing 1.40 MJD 57512.434 object 08261 90prime/CP/V2.3/CP20160503/ksb_160504_102503_ooi_g_ls9.fits.fz ksb_160628_080419_ooi_r_ls9-CCD4 r expnum 75670116 exptime 157.1 propid BASS seeing 1.12 MJD 57567.336 object 09613 90prime/CP/V2.3/CP20160627/ksb_160628_080419_ooi_r_ls9.fits.fz ksb_160702_081312_ooi_g_ls9-CCD4 g expnum 75710099 exptime 125.7 propid BASS seeing 1.96 MJD 57571.343 object 09613 90prime/CP/V2.3/CP20160701/ksb_160702_081312_ooi_g_ls9.fits.fz Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 Faked up EXPNUM 74920208 90prime get_fwhm: self.fwhm = 2.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 885 1042 and amp range 0 2015 and image y 46 203 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.024507914 -> scaling image by 0.9776802328037623 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 Faked up EXPNUM 75710099 90prime get_fwhm: self.fwhm = 4.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2649 2807 and amp range 2016 4031 and image y 293 449 and amp range 0 2047 Range in image: x 0 159 , y 0 157 (with image size 159 x 157) dzp 0.010226944 -> scaling image by 1.0094638657706572 mosaic get_fwhm: self.fwhm = 6.59 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3685 3956 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp -0.005990375 -> scaling image by 0.994497853444703 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 Faked up EXPNUM 75120198 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 889 1046 and amp range 0 2015 and image y 51 208 and amp range 0 2047 Range in image: x 0 158 , y 0 158 (with image size 158 x 158) dzp -0.03470582 -> scaling image by 0.9685402452207784 mosaic get_fwhm: self.fwhm = 5.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1030 1301 and amp range 0 2047 and image y 2701 2972 and amp range 2040 4078 Range in image: x 0 272 , y 0 272 (with image size 272 x 272) dzp 0.008550294 -> scaling image by 1.0079062018164673 mosaic get_fwhm: self.fwhm = 3.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 0 179 and amp range 0 2005 and image y 3684 3955 and amp range 2040 4078 Range in image: x 0 180 , y 0 272 (with image size 180 x 272) dzp 0.014419514 -> scaling image by 1.0133694453441033 mosaic get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 0 2039 Range in image: x 0 272 , y 0 64 (with image size 272 x 275) dzp -0.00064781494 -> scaling image by 0.9994035183523652 Found overlap: image x 2663 2934 and amp range 2006 4053 and image y 1976 2250 and amp range 2040 4078 Range in image: x 0 272 , y 64 275 (with image size 272 x 275) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 Faked up EXPNUM 75410136 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 0 2047 Range in image: x 0 157 , y 0 27 (with image size 157 x 157) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Found overlap: image x 2870 3026 and amp range 2016 4031 and image y 2021 2177 and amp range 2048 4095 Range in image: x 0 157 , y 27 157 (with image size 157 x 157) dzp -0.0012536051 -> scaling image by 0.9988460533227724 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 Faked up EXPNUM 75180255 90prime get_fwhm: self.fwhm = 2.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 0 2047 Range in image: x 0 157 , y 0 19 (with image size 157 x 157) dzp 0.004245165 -> scaling image by 1.0039175950705865 Found overlap: image x 2871 3027 and amp range 2016 4031 and image y 2029 2185 and amp range 2048 4095 Range in image: x 0 157 , y 19 157 (with image size 157 x 157) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 3.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3780 4061 and amp range 2048 4095 and image y 1341 1620 and amp range 0 2039 Range in image: x 0 282 , y 0 280 (with image size 282 x 280) dzp 0.0072022504 -> scaling image by 1.0066555682883527 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 Faked up EXPNUM 75670116 90prime get_fwhm: self.fwhm = 2.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2662 2820 and amp range 2016 4031 and image y 282 439 and amp range 0 2047 Range in image: x 0 159 , y 0 158 (with image size 159 x 158) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Stage tims : Wall: 2.53 s, CPU: 0.80 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.178788 MB Stage tims finished: 2020-08-07T13:33:02.842904 Resources for stage tims : 5.621 s worker CPU, 14.061 s worker Wall, Wall: 2.536 s, Cores in use: 2.53, Total efficiency (on 32 cores): 7.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T13:33:06.037167 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02593.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02721.fits Matched 9 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/reference-custom-273890p35397.fits Stage refs : Wall: 6.68 s, CPU: 6.44 s, VmPeak: 1044 MB, VmSize: 1038 MB, VmRSS: 264 MB, VmData: 296 MB, maxrss: 0.270296 MB Stage refs finished: 2020-08-07T13:33:12.721876 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 6.687 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:33:12.746652 Stage outliers : Wall: 0.28 s, CPU: 0.26 s, VmPeak: 1044 MB, VmSize: 1039 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.271336 MB Stage outliers finished: 2020-08-07T13:33:13.028432 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.284 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T13:33:13.055572 Stage halos : Wall: 0.34 s, CPU: 0.32 s, VmPeak: 1044 MB, VmSize: 1039 MB, VmRSS: 268 MB, VmData: 299 MB, maxrss: 0.274464 MB Stage halos finished: 2020-08-07T13:33:13.391988 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.339 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T13:33:13.422960 PSF sigmas in coadd pixels: ['1.96', '2.27', '3.19'] Using average PSF sigma 2.4754625557881815 Gaussian PSF norm 0.11395639619523949 vs pixelized 0.09035851 average tim pixel scale / coadd scale: 1.7295615305015035 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.70', '1.71', '1.82'] Using average PSF sigma 1.7443592086240056 Gaussian PSF norm 0.1617182919545577 vs pixelized 0.12690596 average tim pixel scale / coadd scale: 1.7296402441437235 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.61', '2.78', '2.17', '1.56', '1.30'] Using average PSF sigma 1.8850144421701458 Gaussian PSF norm 0.1496512628566989 vs pixelized 0.12207155 average tim pixel scale / coadd scale: 0.9909978506105547 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 280 MB, VmData: 309 MB, maxrss: 0.287044 MB Stage fit_on_coadds finished: 2020-08-07T13:33:13.621616 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.231 s worker CPU, 0.359 s worker Wall, Wall: 0.201 s, Cores in use: 2.08, Total efficiency (on 32 cores): 6.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T13:33:13.633877 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 8 in veto map, 2 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 25 potential peaks Of 25 potential peaks: 21 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 12 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 36 potential peaks Of 36 potential peaks: 32 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 1.3937895e-05 Median coadd sky for r : 8.1885526e-05 Median coadd sky for z : 0.00011360593 Stage srcs : Wall: 0.54 s, CPU: 0.40 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 281 MB, VmData: 309 MB, maxrss: 0.287816 MB Stage srcs finished: 2020-08-07T13:33:14.174405 Resources for stage srcs : 0.096 s worker CPU, 0.096 s worker Wall, Wall: 0.543 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:33:14.197640 Blob 1 of 21, id: 9, sources: 5, size: 137x105, npix 6781, brick X: 70,207, Y: 86,191, one pixel: 85 86 Blob 2 of 21, id: 16, sources: 4, size: 94x62, npix 2857, brick X: 117,211, Y: 206,268, one pixel: 185 206 Blob 3 of 21, id: 10, sources: 2, size: 60x38, npix 1435, brick X: 6,66, Y: 114,152, one pixel: 46 114 Blob 4 of 21, id: 19, sources: 3, size: 54x33, npix 1404, brick X: 192,246, Y: 236,269, one pixel: 231 236 Blob 5 of 21, id: 17, sources: 3, size: 33x57, npix 1166, brick X: 0,33, Y: 207,264, one pixel: 17 207 Blob 6 of 21, id: 20, sources: 1, size: 37x27, npix 729, brick X: 59,96, Y: 242,269, one pixel: 74 242 Blob 7 of 21, id: 2, sources: 1, size: 31x31, npix 622, brick X: 211,242, Y: 29,60, one pixel: 223 29 Blob 8 of 21, id: 3, sources: 1, size: 29x29, npix 534, brick X: 26,55, Y: 35,64, one pixel: 39 35 Blob 9 of 21, id: 13, sources: 1, size: 28x27, npix 511, brick X: 51,79, Y: 153,180, one pixel: 61 153 Blob 10 of 21, id: 6, sources: 1, size: 27x28, npix 496, brick X: 161,188, Y: 43,71, one pixel: 174 43 Blob 11 of 21, id: 5, sources: 2, size: 21x38, npix 493, brick X: 248,269, Y: 39,77, one pixel: 257 39 Blob 12 of 21, id: 14, sources: 1, size: 26x26, npix 440, brick X: 96,122, Y: 159,185, one pixel: 108 159 Blob 13 of 21, id: 18, sources: 1, size: 26x25, npix 406, brick X: 62,88, Y: 216,241, one pixel: 73 216 Blob 14 of 21, id: 0, sources: 1, size: 28x22, npix 400, brick X: 91,119, Y: 18,40, one pixel: 103 18 Blob 15 of 21, id: 11, sources: 1, size: 24x24, npix 353, brick X: 192,216, Y: 125,149, one pixel: 203 125 Blob 16 of 21, id: 8, sources: 1, size: 23x24, npix 337, brick X: 0,23, Y: 72,96, one pixel: 9 72 Blob 17 of 21, id: 7, sources: 1, size: 23x21, npix 290, brick X: 108,131, Y: 45,66, one pixel: 117 45 Blob 18 of 21, id: 12, sources: 1, size: 21x21, npix 257, brick X: 214,235, Y: 150,171, one pixel: 224 150 Blob 19 of 21, id: 4, sources: 1, size: 14x22, npix 207, brick X: 0,14, Y: 38,60, one pixel: 4 38 Blob 20 of 21, id: 15, sources: 1, size: 18x19, npix 198, brick X: 36,54, Y: 189,208, one pixel: 44 189 Blob 21 of 21, id: 1, sources: 1, size: 17x17, npix 145, brick X: 56,73, Y: 23,40, one pixel: 64 23 Blob 14 finished, total: Wall: 0.20 s, CPU: 0.15 s, VmPeak: 814 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145652 MB Blob 18 finished, total: Wall: 0.24 s, CPU: 0.20 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09338 MB Blob 16 finished, total: Wall: 0.26 s, CPU: 0.21 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092472 MB Blob 15 finished, total: Wall: 0.27 s, CPU: 0.22 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09264 MB Blob 20 finished, total: Wall: 0.28 s, CPU: 0.20 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.08958 MB Blob 17 finished, total: Wall: 0.30 s, CPU: 0.23 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08966 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (273.88166, 35.40830), pm (1.7, -9.9), parallax 1.097 with NanoMaggies: g=18.9, r=(flux -16.5), z=(flux -131) Reset brightness to NanoMaggies: g=21.7, r=20.5, z=19.7 Blob 21 finished, total: Wall: 0.32 s, CPU: 0.27 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.091804 MB Blob 11 finished, total: Wall: 0.39 s, CPU: 0.34 s, VmPeak: 806 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145936 MB Blob 9 finished, total: Wall: 0.45 s, CPU: 0.35 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089888 MB Blob 19 finished, total: Wall: 0.48 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089616 MB Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.60 s, CPU: 0.55 s, VmPeak: 811 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145044 MB Blob 13 finished, total: Wall: 0.63 s, CPU: 0.57 s, VmPeak: 797 MB, VmSize: 711 MB, VmRSS: 129 MB, VmData: 169 MB, maxrss: 0.13186 MB Blob 12 finished, total: Wall: 0.67 s, CPU: 0.56 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089928 MB Blob 8 finished, total: Wall: 0.69 s, CPU: 0.59 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.09016 MB Blob 7 finished, total: Wall: 0.86 s, CPU: 0.75 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090252 MB Blob 4 finished, total: Wall: 0.94 s, CPU: 0.84 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091336 MB Blob 6 finished, total: Wall: 0.95 s, CPU: 0.84 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090492 MB Blob 3 finished, total: Wall: 1.31 s, CPU: 1.21 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091584 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.88 s, CPU: 1.79 s, VmPeak: 668 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091476 MB Blob 2 finished, total: Wall: 1.89 s, CPU: 1.80 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.093652 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.50725, ee1=-0.288985, ee2=-1.06287 Measuring 2 iterative sources Blob 1 finished, total: Wall: 5.76 s, CPU: 5.68 s, VmPeak: 687 MB, VmSize: 677 MB, VmRSS: 101 MB, VmData: 145 MB, maxrss: 0.113128 MB Old catalog: 44 New catalog: 35 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/blobs-custom-273890p35397.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/metrics/cus/all-models-custom-273890p35397.fits Stage fitblobs : Wall: 6.24 s, CPU: 0.50 s, VmPeak: 1044 MB, VmSize: 1044 MB, VmRSS: 281 MB, VmData: 309 MB, maxrss: 0.288172 MB Stage fitblobs finished: 2020-08-07T13:33:20.436229 Resources for stage fitblobs : 18.063 s worker CPU, 19.732 s worker Wall, Wall: 6.241 s, Cores in use: 2.98, Total efficiency (on 32 cores): 9.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:33:20.460250 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/tmp-legacysurvey-custom-273890p35397-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/tmp-legacysurvey-custom-273890p35397-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/tmp-legacysurvey-custom-273890p35397-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/tmp-legacysurvey-custom-273890p35397-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-resid.jpg Stage coadds : Wall: 2.51 s, CPU: 0.59 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 283 MB, VmData: 309 MB, maxrss: 0.289684 MB Stage coadds finished: 2020-08-07T13:33:22.967129 Resources for stage coadds : 24.427 s worker CPU, 25.052 s worker Wall, Wall: 2.509 s, Cores in use: 9.97, Total efficiency (on 32 cores): 31.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:33:22.982228 Cut to 1 unWISE tiles Reading WISE tile 2741p348 band 2 Reading WISE tile 2741p348 band 1 Reading WISE tile 2741p348 band 4 Reading WISE tile 2741p348 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.182884 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 136 MB, VmData: 170 MB, maxrss: 0.19834 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 143 MB, VmData: 176 MB, maxrss: 0.206516 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/274/2741p348/unwise-2741p348-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 805 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 179 MB, maxrss: 0.20306 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/tmp-legacysurvey-custom-273890p35397-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/tmp-legacysurvey-custom-273890p35397-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.87 s, CPU: 0.48 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 284 MB, VmData: 309 MB, maxrss: 0.290336 MB Stage wise_forced finished: 2020-08-07T13:33:24.854085 Resources for stage wise_forced : 3.176 s worker CPU, 4.269 s worker Wall, Wall: 1.874 s, Cores in use: 1.95, Total efficiency (on 32 cores): 6.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:33:24.870431 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/coadd/cus/custom-273890p35397/legacysurvey-custom-273890p35397-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/tractor-i/cus/tractor-custom-273890p35397.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/tractor/cus/tractor-custom-273890p35397.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/tractor/cus/brick-custom-273890p35397.sha256sum Stage writecat : Wall: 0.69 s, CPU: 0.50 s, VmPeak: 1180 MB, VmSize: 1052 MB, VmRSS: 285 MB, VmData: 309 MB, maxrss: 0.42322 MB Stage writecat finished: 2020-08-07T13:33:25.564801 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.697 s, Cores in use: 0.72, Total efficiency (on 32 cores): 2.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/273/PGC2063912/PGC2063912-largegalaxy-writecat.p All done: 51.621 s worker CPU, 63.576 s worker Wall, Wall: 25.278 s, Cores in use: 2.46, Total efficiency (on 32 cores): 7.7 % Finished galaxy PGC2063912 in 0.452 minutes.