Started working on galaxy PGC2180024 at Wed Aug 5 22:48:44 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.3166565 41.3701782 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:48:46.028605 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.3166565', '41.3701782', '--width', '511', '--height', '511', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.3166565 41.3701782 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 106.3166565 41.3701782 Starting process 25467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 25468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 25469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 25470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 25471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05948 MB Starting process 25472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059492 MB Starting process 25473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059492 MB Starting process 25474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 25475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 25476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 25477 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 25478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 25479 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 25480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 25481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 25482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 25483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 25485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 25486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 25487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 25488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 25489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 25490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 25491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 25492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 25493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 25494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 25495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 25496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 25497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 25498 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 25499 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:48:46.863526 Keeping 15 CCDs: k4m_151214_091255_ooi_zd_ls9-CCD1 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.97 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091255_ooi_zd_ls9-CCD2 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD3 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz k4m_170202_043607_ooi_zd_ls9-CCD4 z expnum 3105961 exptime 90.105 propid 2016A-0453 seeing 1.43 MJD 57786.192 object MzLS_609765_z mosaic/CP/V4.3/CP20170201/k4m_170202_043607_ooi_zd_ls9.fits.fz k4m_160126_062059_ooi_zd_ls9-CCD3 z expnum 64229 exptime 91.106 propid 2016A-0453 seeing 0.87 MJD 57413.265 object MzLS_611650_z mosaic/CP/V4.3/CP20160125/k4m_160126_062059_ooi_zd_ls9.fits.fz k4m_180105_075709_ooi_zd_ls9-CCD4 z expnum 154244 exptime 100.104 propid 2016A-0453 seeing 0.89 MJD 58123.331 object MzLS_610709_z mosaic/CP/V4.3/CP20180104/k4m_180105_075709_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD4 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.94 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz ksb_180115_042713_ooi_g_ls9-CCD3 g expnum 81330064 exptime 136.5 propid BASS seeing 1.17 MJD 58133.186 object 14942 90prime/CP/V2.3/CP20180114/ksb_180115_042713_ooi_g_ls9.fits.fz ksb_160130_050655_ooi_r_ls9-CCD3 r expnum 74170076 exptime 132.0 propid 2015A-0801 seeing 1.29 MJD 57417.213 object 14942 90prime/CP/V2.3/CP20160129/ksb_160130_050655_ooi_r_ls9.fits.fz ksb_160203_051429_ooi_r_ls9-CCD3 r expnum 74210067 exptime 99.7 propid 2015A-0801 seeing 2.36 MJD 57421.218 object 14942 90prime/CP/V2.3/CP20160202/ksb_160203_051429_ooi_r_ls9.fits.fz ksb_170119_062538_ooi_g_ls9-CCD2 g expnum 77720055 exptime 250.0 propid BASS seeing 2.04 MJD 57772.268 object 16243 90prime/CP/V2.3/CP20170118/ksb_170119_062538_ooi_g_ls9.fits.fz ksb_161107_114737_ooi_r_ls9-CCD2 r expnum 76990161 exptime 250.0 propid BASS seeing 1.51 MJD 57699.491 object 16243 90prime/CP/V2.3/CP20161106/ksb_161107_114737_ooi_r_ls9.fits.fz ksb_160213_035450_ooi_r_ls9-CCD2 r expnum 74310045 exptime 137.5 propid 2015A-0801 seeing 1.27 MJD 57431.163 object 16243 90prime/CP/V2.3/CP20160212/ksb_160213_035450_ooi_r_ls9.fits.fz ksb_160210_035402_ooi_g_ls9-CCD3 g expnum 74280078 exptime 127.1 propid 2015A-0801 seeing 1.22 MJD 57428.163 object 14941 90prime/CP/V2.3/CP20160209/ksb_160210_035402_ooi_g_ls9.fits.fz ksb_170320_024735_ooi_r_ls9-CCD3 r expnum 78320038 exptime 101.376 propid BASS seeing 1.28 MJD 57832.116 object 14941 90prime/CP/V2.3/CP20170319/ksb_170320_024735_ooi_r_ls9.fits.fz Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3001 3298 and amp range 2016 4031 and image y 2749 3046 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 90prime get_fwhm: self.fwhm = 5.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2980 3277 and amp range 2016 4031 and image y 2758 3055 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2976 3273 and amp range 2016 4031 and image y 2785 3083 and amp range 2048 4095 Range in image: x 0 298 , y 0 299 (with image size 298 x 299) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1036 1333 and amp range 0 2015 and image y 773 1070 and amp range 0 2047 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.043123975 -> scaling image by 0.961059796099719 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2746 3044 and amp range 2016 4031 and image y 2733 3031 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.0002007609 -> scaling image by 1.0001849247187462 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 90prime get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2756 3053 and amp range 2016 4031 and image y 2757 3055 and amp range 2048 4095 Range in image: x 0 298 , y 0 299 (with image size 298 x 299) dzp 0.010008041 -> scaling image by 1.0092603604948323 mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 253 and amp range 0 2047 and image y 3605 4054 and amp range 2022 4060 Range in image: x 0 247 , y 0 450 (with image size 247 x 450) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Found overlap: image x 4010 4046 and amp range 2006 4053 and image y 3632 4072 and amp range 2040 4078 Range in image: x 0 37 , y 0 441 (with image size 37 x 441) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 317 and amp range 0 2047 and image y 3780 4054 and amp range 2022 4060 Range in image: x 0 311 , y 0 275 (with image size 311 x 275) dzp -0.016192675 -> scaling image by 0.9851966584456431 mosaic get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1296 1821 and amp range 0 2005 and image y 3118 3649 and amp range 2040 4078 Range in image: x 0 526 , y 0 532 (with image size 526 x 532) dzp 0.0022078273 -> scaling image by 1.0020355530120029 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4011 4046 and amp range 2006 4053 and image y 7 495 and amp range 0 2039 Range in image: x 0 36 , y 0 489 (with image size 36 x 489) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 253 and amp range 0 2047 and image y 7 495 and amp range 0 2039 Range in image: x 0 247 , y 0 489 (with image size 247 x 489) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 5.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2429 2952 and amp range 2048 4095 and image y 1589 2110 and amp range 0 2021 Range in image: x 0 524 , y 0 433 (with image size 524 x 522) dzp -0.03444113 -> scaling image by 0.9687763957004109 Found overlap: image x 2429 2952 and amp range 2048 4095 and image y 1589 2110 and amp range 2022 4060 Range in image: x 0 524 , y 433 522 (with image size 524 x 522) dzp -0.02499645 -> scaling image by 0.9772404160512723 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1027 1324 and amp range 0 2015 and image y 777 1073 and amp range 0 2047 Range in image: x 0 298 , y 0 297 (with image size 298 x 297) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2769 3066 and amp range 2016 4031 and image y 2759 3057 and amp range 2048 4095 Range in image: x 0 298 , y 0 299 (with image size 298 x 299) dzp 0.021366077 -> scaling image by 1.0198737893800265 Stage tims : Wall: 17.04 s, CPU: 0.90 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 187 MB, VmData: 221 MB, maxrss: 0.191924 MB Stage tims finished: 2020-08-05T22:49:03.898535 Resources for stage tims : 7.774 s worker CPU, 47.614 s worker Wall, Wall: 17.038 s, Cores in use: 0.51, Total efficiency (on 32 cores): 1.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-05T22:49:04.342013 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02022.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01896.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02021.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02150.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/reference-custom-106316p41370.fits Stage refs : Wall: 12.65 s, CPU: 4.07 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 242 MB, VmData: 273 MB, maxrss: 0.247508 MB Stage refs finished: 2020-08-05T22:49:16.994360 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.655 s, Cores in use: 0.32, Total efficiency (on 32 cores): 1.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T22:49:17.321164 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/outlier-mask-custom-106316p41370.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/outliers-pre-custom-106316p41370.jpg Image ksb_160210_035402_ooi_g_ls9-CCD3 g : masking 117 positive outlier pixels and 0 negative outlier pixels Image ksb_170119_062538_ooi_g_ls9-CCD2 g : masking 1009 positive outlier pixels and 0 negative outlier pixels Image ksb_160130_050655_ooi_r_ls9-CCD3 r : masking 786 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_091255_ooi_zd_ls9-CCD1 z : masking 803 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_091255_ooi_zd_ls9-CCD2 z : masking 644 positive outlier pixels and 452 negative outlier pixels Image k4m_180105_075709_ooi_zd_ls9-CCD4 z : masking 358 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_091030_ooi_zd_ls9-CCD4 z : masking 557 positive outlier pixels and 243 negative outlier pixels Image k4m_170202_043607_ooi_zd_ls9-CCD4 z : masking 17140 positive outlier pixels and 0 negative outlier pixels Image k4m_160126_062059_ooi_zd_ls9-CCD3 z : masking 573 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/outlier-mask-custom-106316p41370.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/outliers-post-custom-106316p41370.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/outliers-masked-pos-custom-106316p41370.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/outliers-masked-neg-custom-106316p41370.jpg Stage outliers : Wall: 2.17 s, CPU: 1.43 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 257 MB, VmData: 328 MB, maxrss: 0.30304 MB Stage outliers finished: 2020-08-05T22:49:19.494549 Resources for stage outliers : 3.840 s worker CPU, 4.365 s worker Wall, Wall: 2.176 s, Cores in use: 2.42, Total efficiency (on 32 cores): 7.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:49:19.533602 Stage halos : Wall: 0.49 s, CPU: 0.47 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 257 MB, VmData: 328 MB, maxrss: 0.30304 MB Stage halos finished: 2020-08-05T22:49:20.021887 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.490 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-05T22:49:20.066146 PSF sigmas in coadd pixels: ['1.89', '3.32', '1.98'] Using average PSF sigma 2.3972847483249855 Gaussian PSF norm 0.11767262607038298 vs pixelized 0.09084781 average tim pixel scale / coadd scale: 1.7298221319757459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.10', '3.84', '2.45', '2.07', '2.08'] Using average PSF sigma 2.5068262473636347 Gaussian PSF norm 0.11253065188325281 vs pixelized 0.099685945 average tim pixel scale / coadd scale: 1.7295429351533413 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.56', '1.56', '2.32', '1.41', '1.44', '1.52'] Using average PSF sigma 1.6258256866595453 Gaussian PSF norm 0.17350863262191157 vs pixelized 0.14085364 average tim pixel scale / coadd scale: 0.9909198815439754 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.57 s, CPU: 0.55 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 265 MB, VmData: 332 MB, maxrss: 0.307016 MB Stage fit_on_coadds finished: 2020-08-05T22:49:20.635887 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.913 s worker CPU, 0.913 s worker Wall, Wall: 0.572 s, Cores in use: 2.56, Total efficiency (on 32 cores): 8.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:49:20.817470 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 222 potential peaks Of 222 potential peaks: 146 in veto map, 13 cut by saddle test, 0 cut by aper test, 63 kept SED z : 63 new peaks Found 959 potential peaks Of 959 potential peaks: 938 in veto map, 11 cut by saddle test, 0 cut by aper test, 10 kept SED r : 10 new peaks Found 903 potential peaks Of 903 potential peaks: 894 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 264 potential peaks Of 264 potential peaks: 244 in veto map, 16 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 262 potential peaks Of 262 potential peaks: 238 in veto map, 19 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 83 new sources Median coadd sky for g : 0.00021986378 Median coadd sky for r : 0.0003486524 Median coadd sky for z : -1.1658352e-06 Stage srcs : Wall: 1.10 s, CPU: 0.99 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 266 MB, VmData: 332 MB, maxrss: 0.307016 MB Stage srcs finished: 2020-08-05T22:49:21.913983 Resources for stage srcs : 0.293 s worker CPU, 0.293 s worker Wall, Wall: 1.099 s, Cores in use: 1.17, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:49:21.935264 Blob 1 of 46, id: 11, sources: 16, size: 183x245, npix 25673, brick X: 147,330, Y: 86,331, one pixel: 246 86 Blob 2 of 46, id: 24, sources: 9, size: 181x226, npix 18983, brick X: 330,511, Y: 246,472, one pixel: 439 246 Blob 3 of 46, id: 1, sources: 12, size: 208x95, npix 8544, brick X: 171,379, Y: 0,95, one pixel: 310 0 Blob 4 of 46, id: 22, sources: 7, size: 99x93, npix 5533, brick X: 0,99, Y: 219,312, one pixel: 50 219 Blob 5 of 46, id: 2, sources: 2, size: 62x83, npix 4122, brick X: 449,511, Y: 0,83, one pixel: 472 0 Blob 6 of 46, id: 40, sources: 2, size: 107x55, npix 3933, brick X: 141,248, Y: 456,511, one pixel: 183 456 Blob 7 of 46, id: 37, sources: 3, size: 78x69, npix 3093, brick X: 92,170, Y: 418,487, one pixel: 150 418 Blob 8 of 46, id: 18, sources: 3, size: 48x90, npix 2563, brick X: 111,159, Y: 178,268, one pixel: 130 178 Blob 9 of 46, id: 13, sources: 1, size: 45x43, npix 1450, brick X: 361,406, Y: 139,182, one pixel: 380 139 Blob 10 of 46, id: 39, sources: 1, size: 46x43, npix 1420, brick X: 272,318, Y: 454,497, one pixel: 299 454 Blob 11 of 46, id: 32, sources: 2, size: 56x38, npix 1412, brick X: 26,82, Y: 366,404, one pixel: 37 366 Blob 12 of 46, id: 4, sources: 2, size: 46x39, npix 1345, brick X: 404,450, Y: 34,73, one pixel: 428 34 Blob 13 of 46, id: 29, sources: 2, size: 41x53, npix 1184, brick X: 106,147, Y: 337,390, one pixel: 129 337 Blob 14 of 46, id: 28, sources: 2, size: 47x44, npix 1147, brick X: 292,339, Y: 314,358, one pixel: 308 314 Blob 15 of 46, id: 33, sources: 1, size: 37x47, npix 1105, brick X: 295,332, Y: 396,443, one pixel: 313 396 Blob 16 of 46, id: 7, sources: 1, size: 37x47, npix 1055, brick X: 359,396, Y: 67,114, one pixel: 382 67 Blob 17 of 46, id: 19, sources: 2, size: 32x51, npix 1051, brick X: 154,186, Y: 183,234, one pixel: 169 183 Blob 18 of 46, id: 9, sources: 1, size: 37x38, npix 939, brick X: 12,49, Y: 71,109, one pixel: 30 71 Blob 19 of 46, id: 15, sources: 1, size: 37x35, npix 868, brick X: 471,508, Y: 153,188, one pixel: 485 153 Blob 20 of 46, id: 3, sources: 1, size: 36x35, npix 820, brick X: 20,56, Y: 34,69, one pixel: 39 34 Blob 21 of 46, id: 45, sources: 4, size: 46x25, npix 724, brick X: 14,60, Y: 486,511, one pixel: 23 486 Blob 22 of 46, id: 20, sources: 1, size: 33x32, npix 723, brick X: 315,348, Y: 189,221, one pixel: 333 189 Blob 23 of 46, id: 0, sources: 1, size: 33x32, npix 711, brick X: 54,87, Y: 0,32, one pixel: 71 0 Blob 24 of 46, id: 6, sources: 1, size: 29x32, npix 633, brick X: 326,355, Y: 54,86, one pixel: 337 54 Blob 25 of 46, id: 25, sources: 1, size: 30x31, npix 597, brick X: 316,346, Y: 288,319, one pixel: 328 288 Blob 26 of 46, id: 38, sources: 1, size: 30x27, npix 548, brick X: 326,356, Y: 429,456, one pixel: 339 429 Blob 27 of 46, id: 35, sources: 1, size: 29x29, npix 544, brick X: 184,213, Y: 401,430, one pixel: 195 401 Blob 28 of 46, id: 31, sources: 1, size: 28x28, npix 500, brick X: 82,110, Y: 348,376, one pixel: 94 348 Blob 29 of 46, id: 44, sources: 1, size: 27x26, npix 421, brick X: 438,465, Y: 485,511, one pixel: 449 485 Blob 30 of 46, id: 26, sources: 2, size: 20x38, npix 411, brick X: 0,20, Y: 296,334, one pixel: 8 296 Blob 31 of 46, id: 30, sources: 1, size: 25x23, npix 364, brick X: 253,278, Y: 343,366, one pixel: 263 343 Blob 32 of 46, id: 21, sources: 1, size: 23x25, npix 360, brick X: 421,444, Y: 190,215, one pixel: 430 190 Blob 33 of 46, id: 5, sources: 1, size: 22x24, npix 315, brick X: 92,114, Y: 49,73, one pixel: 102 49 Blob 34 of 46, id: 34, sources: 1, size: 21x23, npix 308, brick X: 0,21, Y: 399,422, one pixel: 8 399 Blob 14 finished, total: Wall: 0.23 s, CPU: 0.22 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 93 MB, VmData: 144 MB, maxrss: 0.095444 MB Blob 35 of 46, id: 36, sources: 1, size: 22x21, npix 300, brick X: 17,39, Y: 412,433, one pixel: 25 412 Blob 30 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB Blob 36 of 46, id: 42, sources: 1, size: 23x21, npix 300, brick X: 75,98, Y: 484,505, one pixel: 86 484 Blob 32 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147308 MB Blob 37 of 46, id: 41, sources: 1, size: 23x22, npix 294, brick X: 484,507, Y: 469,491, one pixel: 495 469 Blob 28 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 673 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100244 MB Blob 38 of 46, id: 14, sources: 1, size: 23x22, npix 293, brick X: 414,437, Y: 146,168, one pixel: 425 146 Blob 27 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 675 MB, VmSize: 675 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.102672 MB Blob 39 of 46, id: 8, sources: 1, size: 22x22, npix 290, brick X: 286,308, Y: 70,92, one pixel: 295 70 Measuring 1 iterative sources Blob 23 finished, total: Wall: 0.75 s, CPU: 0.74 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1481 MB Measuring 1 iterative sources Blob 40 of 46, id: 16, sources: 1, size: 20x21, npix 240, brick X: 82,102, Y: 166,187, one pixel: 91 166 Blob 25 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 679 MB, VmSize: 679 MB, VmRSS: 104 MB, VmData: 150 MB, maxrss: 0.106868 MB Blob 41 of 46, id: 23, sources: 1, size: 21x20, npix 238, brick X: 406,427, Y: 245,265, one pixel: 415 245 Blob 33 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100372 MB Blob 42 of 46, id: 43, sources: 1, size: 21x19, npix 237, brick X: 355,376, Y: 485,504, one pixel: 363 485 Blob 29 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147304 MB Blob 43 of 46, id: 27, sources: 1, size: 20x21, npix 230, brick X: 17,37, Y: 302,323, one pixel: 27 302 Blob 34 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB Blob 44 of 46, id: 17, sources: 1, size: 18x19, npix 189, brick X: 424,442, Y: 170,189, one pixel: 432 170 Blob 31 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 678 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.101964 MB Blob 45 of 46, id: 10, sources: 1, size: 18x17, npix 162, brick X: 426,444, Y: 82,99, one pixel: 434 82 Blob 42 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB Blob 46 of 46, id: 12, sources: 1, size: 13x18, npix 142, brick X: 498,511, Y: 112,130, one pixel: 506 112 Blob 20 finished, total: Wall: 1.07 s, CPU: 1.05 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147552 MB Blob 22 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148088 MB Measuring 1 iterative sources Blob 44 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147716 MB Blob 45 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147552 MB Blob 40 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100376 MB Blob 24 finished, total: Wall: 1.16 s, CPU: 1.15 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 132 MB, VmData: 170 MB, maxrss: 0.135152 MB Blob 41 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147304 MB Measuring 1 iterative sources Blob 35 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147308 MB Blob 43 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 678 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.101964 MB Blob 17 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 791 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.134 MB Blob 37 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 675 MB, VmSize: 675 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.102788 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 39 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 679 MB, VmSize: 679 MB, VmRSS: 105 MB, VmData: 150 MB, maxrss: 0.107128 MB Blob 36 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 673 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100388 MB Blob 26 finished, total: Wall: 1.40 s, CPU: 1.39 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.09968 MB Blob 38 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1481 MB Blob 9 finished, total: Wall: 1.49 s, CPU: 1.49 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148144 MB Blob 46 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148768 MB Blob 16 finished, total: Wall: 1.61 s, CPU: 1.60 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100664 MB Blob 11 finished, total: Wall: 1.62 s, CPU: 1.61 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 103 MB, VmData: 148 MB, maxrss: 0.105084 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.33714, 41.38914), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=19.9, r=19, z=18.5 Reset brightness to NanoMaggies: g=21, r=20.6, z=20.5 Blob 21 finished, total: Wall: 1.59 s, CPU: 1.58 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148208 MB Blob 13 finished, total: Wall: 1.71 s, CPU: 1.70 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.096848 MB Blob 18 finished, total: Wall: 1.72 s, CPU: 1.70 s, VmPeak: 672 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098088 MB Blob 19 finished, total: Wall: 1.81 s, CPU: 1.81 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14828 MB Blob 15 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102544 MB Blob 6 finished, total: Wall: 1.97 s, CPU: 1.97 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 101 MB, VmData: 145 MB, maxrss: 0.103308 MB Blob 12 finished, total: Wall: 2.10 s, CPU: 2.09 s, VmPeak: 676 MB, VmSize: 676 MB, VmRSS: 103 MB, VmData: 147 MB, maxrss: 0.105136 MB Blob 10 finished, total: Wall: 2.32 s, CPU: 2.31 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.101976 MB Measuring 2 iterative sources Measuring 1 iterative sources Blob 5 finished, total: Wall: 3.17 s, CPU: 3.17 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149692 MB Blob 8 finished, total: Wall: 3.24 s, CPU: 3.24 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099256 MB Measuring 3 iterative sources Blob 4 finished, total: Wall: 5.01 s, CPU: 5.00 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148708 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 5.36 s, CPU: 5.35 s, VmPeak: 675 MB, VmSize: 675 MB, VmRSS: 102 MB, VmData: 146 MB, maxrss: 0.10412 MB Blob 3 finished, total: Wall: 5.66 s, CPU: 5.66 s, VmPeak: 677 MB, VmSize: 677 MB, VmRSS: 104 MB, VmData: 148 MB, maxrss: 0.106924 MB Blob 2 finished, total: Wall: 6.58 s, CPU: 6.57 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.1495 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.59555, ee1=0.205699, ee2=-0.182337 Measuring 2 iterative sources Blob 1 finished, total: Wall: 15.08 s, CPU: 15.07 s, VmPeak: 812 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 190 MB, maxrss: 0.161916 MB Old catalog: 104 New catalog: 105 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/blobs-custom-106316p41370.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/metrics/cus/all-models-custom-106316p41370.fits Stage fitblobs : Wall: 15.64 s, CPU: 0.70 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 266 MB, VmData: 332 MB, maxrss: 0.307016 MB Stage fitblobs finished: 2020-08-05T22:49:37.578497 Resources for stage fitblobs : 82.048 s worker CPU, 82.598 s worker Wall, Wall: 15.646 s, Cores in use: 5.29, Total efficiency (on 32 cores): 16.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:49:37.604370 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-resid.jpg Stage coadds : Wall: 4.47 s, CPU: 1.24 s, VmPeak: 1042 MB, VmSize: 1008 MB, VmRSS: 272 MB, VmData: 326 MB, maxrss: 0.312664 MB Stage coadds finished: 2020-08-05T22:49:42.075531 Resources for stage coadds : 22.567 s worker CPU, 82.472 s worker Wall, Wall: 4.474 s, Cores in use: 5.32, Total efficiency (on 32 cores): 16.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T22:49:42.409159 Cut to 1 unWISE tiles Reading WISE tile 1068p408 band 1 Reading WISE tile 1068p408 band 2 Reading WISE tile 1068p408 band 3 Reading WISE tile 1068p408 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.20 s, CPU: 0.51 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 148 MB, VmData: 189 MB, maxrss: 0.210668 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.36 s, CPU: 1.14 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 150 MB, VmData: 191 MB, maxrss: 0.191872 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.44 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 148 MB, VmData: 189 MB, maxrss: 0.210628 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.37 s, VmPeak: 1070 MB, VmSize: 1006 MB, VmRSS: 147 MB, VmData: 188 MB, maxrss: 0.209484 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.71 s, CPU: 0.72 s, VmPeak: 1042 MB, VmSize: 1008 MB, VmRSS: 273 MB, VmData: 326 MB, maxrss: 0.312664 MB Stage wise_forced finished: 2020-08-05T22:49:46.123192 Resources for stage wise_forced : 5.359 s worker CPU, 7.222 s worker Wall, Wall: 3.716 s, Cores in use: 1.64, Total efficiency (on 32 cores): 5.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:49:46.151689 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/tractor-i/cus/tractor-custom-106316p41370.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/tractor/cus/tractor-custom-106316p41370.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/tractor/cus/brick-custom-106316p41370.sha256sum Stage writecat : Wall: 0.90 s, CPU: 0.76 s, VmPeak: 1150 MB, VmSize: 1022 MB, VmRSS: 284 MB, VmData: 336 MB, maxrss: 0.421644 MB Stage writecat finished: 2020-08-05T22:49:47.048867 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.899 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/106/PGC2180024/PGC2180024-largegalaxy-writecat.p All done: 122.800 s worker CPU, 225.486 s worker Wall, Wall: 60.408 s, Cores in use: 2.23, Total efficiency (on 32 cores): 7.0 % Finished galaxy PGC2180024 in 1.062 minutes. Started working on galaxy PGC2180024 at Fri Aug 7 10:11:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T10:11:03.368261 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.31639587803129', '41.37036650068698', '--width', '511', '--height', '511', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 106.31639587803129 41.37036650068698 Starting process 33925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 33926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB Starting process 33930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 33931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05942 MB Starting process 33932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 33937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33947 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T10:11:03.957710 Keeping 15 CCDs: k4m_151214_091255_ooi_zd_ls9-CCD1 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.97 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091255_ooi_zd_ls9-CCD2 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD3 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz k4m_170202_043607_ooi_zd_ls9-CCD4 z expnum 3105961 exptime 90.105 propid 2016A-0453 seeing 1.43 MJD 57786.192 object MzLS_609765_z mosaic/CP/V4.3/CP20170201/k4m_170202_043607_ooi_zd_ls9.fits.fz k4m_160126_062059_ooi_zd_ls9-CCD3 z expnum 64229 exptime 91.106 propid 2016A-0453 seeing 0.87 MJD 57413.265 object MzLS_611650_z mosaic/CP/V4.3/CP20160125/k4m_160126_062059_ooi_zd_ls9.fits.fz k4m_180105_075709_ooi_zd_ls9-CCD4 z expnum 154244 exptime 100.104 propid 2016A-0453 seeing 0.89 MJD 58123.331 object MzLS_610709_z mosaic/CP/V4.3/CP20180104/k4m_180105_075709_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD4 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.94 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz ksb_180115_042713_ooi_g_ls9-CCD3 g expnum 81330064 exptime 136.5 propid BASS seeing 1.17 MJD 58133.186 object 14942 90prime/CP/V2.3/CP20180114/ksb_180115_042713_ooi_g_ls9.fits.fz ksb_160130_050655_ooi_r_ls9-CCD3 r expnum 74170076 exptime 132.0 propid 2015A-0801 seeing 1.29 MJD 57417.213 object 14942 90prime/CP/V2.3/CP20160129/ksb_160130_050655_ooi_r_ls9.fits.fz ksb_160203_051429_ooi_r_ls9-CCD3 r expnum 74210067 exptime 99.7 propid 2015A-0801 seeing 2.36 MJD 57421.218 object 14942 90prime/CP/V2.3/CP20160202/ksb_160203_051429_ooi_r_ls9.fits.fz ksb_170119_062538_ooi_g_ls9-CCD2 g expnum 77720055 exptime 250.0 propid BASS seeing 2.04 MJD 57772.268 object 16243 90prime/CP/V2.3/CP20170118/ksb_170119_062538_ooi_g_ls9.fits.fz ksb_161107_114737_ooi_r_ls9-CCD2 r expnum 76990161 exptime 250.0 propid BASS seeing 1.51 MJD 57699.491 object 16243 90prime/CP/V2.3/CP20161106/ksb_161107_114737_ooi_r_ls9.fits.fz ksb_160213_035450_ooi_r_ls9-CCD2 r expnum 74310045 exptime 137.5 propid 2015A-0801 seeing 1.27 MJD 57431.163 object 16243 90prime/CP/V2.3/CP20160212/ksb_160213_035450_ooi_r_ls9.fits.fz ksb_160210_035402_ooi_g_ls9-CCD3 g expnum 74280078 exptime 127.1 propid 2015A-0801 seeing 1.22 MJD 57428.163 object 14941 90prime/CP/V2.3/CP20160209/ksb_160210_035402_ooi_g_ls9.fits.fz ksb_170320_024735_ooi_r_ls9-CCD3 r expnum 78320038 exptime 101.376 propid BASS seeing 1.28 MJD 57832.116 object 14941 90prime/CP/V2.3/CP20170319/ksb_170320_024735_ooi_r_ls9.fits.fz Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2744 3042 and amp range 2016 4031 and image y 2734 3032 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.0002007609 -> scaling image by 1.0001849247187462 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 90prime get_fwhm: self.fwhm = 5.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2978 3275 and amp range 2016 4031 and image y 2759 3056 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3000 3297 and amp range 2016 4031 and image y 2751 3048 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1034 1331 and amp range 0 2015 and image y 775 1071 and amp range 0 2047 Range in image: x 0 298 , y 0 297 (with image size 298 x 297) dzp -0.043123975 -> scaling image by 0.961059796099719 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 90prime get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2754 3052 and amp range 2016 4031 and image y 2759 3057 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.010008041 -> scaling image by 1.0092603604948323 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2975 3272 and amp range 2016 4031 and image y 2787 3084 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 256 and amp range 0 2047 and image y 3602 4054 and amp range 2022 4060 Range in image: x 0 250 , y 0 453 (with image size 250 x 453) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4013 4046 and amp range 2006 4053 and image y 7 493 and amp range 0 2039 Range in image: x 0 34 , y 0 487 (with image size 34 x 487) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 256 and amp range 0 2047 and image y 7 492 and amp range 0 2039 Range in image: x 0 250 , y 0 486 (with image size 250 x 486) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 319 and amp range 0 2047 and image y 3777 4054 and amp range 2022 4060 Range in image: x 0 313 , y 0 278 (with image size 313 x 278) dzp -0.016192675 -> scaling image by 0.9851966584456431 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4012 4046 and amp range 2006 4053 and image y 3629 4072 and amp range 2040 4078 Range in image: x 0 35 , y 0 444 (with image size 35 x 444) dzp -0.0026360443 -> scaling image by 0.99757505842151 mosaic get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1299 1823 and amp range 0 2005 and image y 3115 3646 and amp range 2040 4078 Range in image: x 0 525 , y 0 532 (with image size 525 x 532) dzp 0.0022078273 -> scaling image by 1.0020355530120029 mosaic get_fwhm: self.fwhm = 5.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 0 2021 Range in image: x 0 523 , y 0 435 (with image size 523 x 521) dzp -0.03444113 -> scaling image by 0.9687763957004109 Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 2022 4060 Range in image: x 0 523 , y 435 521 (with image size 523 x 521) dzp -0.02499645 -> scaling image by 0.9772404160512723 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1025 1322 and amp range 0 2015 and image y 778 1075 and amp range 0 2047 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2767 3065 and amp range 2016 4031 and image y 2761 3058 and amp range 2048 4095 Range in image: x 0 299 , y 0 298 (with image size 299 x 298) dzp 0.021366077 -> scaling image by 1.0198737893800265 Stage tims : Wall: 67.65 s, CPU: 1.03 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 187 MB, VmData: 221 MB, maxrss: 0.191832 MB Stage tims finished: 2020-08-07T10:12:11.609896 Resources for stage tims : 8.904 s worker CPU, 208.329 s worker Wall, Wall: 67.654 s, Cores in use: 0.15, Total efficiency (on 16 cores): 0.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T10:12:11.676756 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02022.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01896.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02021.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02150.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/reference-custom-106316p41370.fits Stage refs : Wall: 38.05 s, CPU: 4.43 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 242 MB, VmData: 273 MB, maxrss: 0.247556 MB Stage refs finished: 2020-08-07T10:12:49.725742 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 38.050 s, Cores in use: 0.12, Total efficiency (on 16 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T10:12:50.075674 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/outlier-mask-custom-106316p41370.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/outliers-pre-custom-106316p41370.jpg Image ksb_170119_062538_ooi_g_ls9-CCD2 g : masking 817 positive outlier pixels and 0 negative outlier pixels Image ksb_160210_035402_ooi_g_ls9-CCD3 g : masking 117 positive outlier pixels and 0 negative outlier pixels Image ksb_160130_050655_ooi_r_ls9-CCD3 r : masking 777 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_091255_ooi_zd_ls9-CCD1 z : masking 729 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_091255_ooi_zd_ls9-CCD2 z : masking 608 positive outlier pixels and 486 negative outlier pixels Image k4m_180105_075709_ooi_zd_ls9-CCD4 z : masking 359 positive outlier pixels and 0 negative outlier pixels Image k4m_151214_091030_ooi_zd_ls9-CCD4 z : masking 552 positive outlier pixels and 197 negative outlier pixels Image k4m_170202_043607_ooi_zd_ls9-CCD4 z : masking 17651 positive outlier pixels and 0 negative outlier pixels Image k4m_160126_062059_ooi_zd_ls9-CCD3 z : masking 424 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/outlier-mask-custom-106316p41370.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/outliers-post-custom-106316p41370.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/outliers-masked-pos-custom-106316p41370.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/outliers-masked-neg-custom-106316p41370.jpg Stage outliers : Wall: 6.64 s, CPU: 1.41 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 258 MB, VmData: 328 MB, maxrss: 0.302996 MB Stage outliers finished: 2020-08-07T10:12:56.717635 Resources for stage outliers : 4.009 s worker CPU, 4.070 s worker Wall, Wall: 6.644 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T10:12:56.757684 Stage halos : Wall: 0.43 s, CPU: 0.39 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 258 MB, VmData: 329 MB, maxrss: 0.302996 MB Stage halos finished: 2020-08-07T10:12:57.185524 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.429 s, Cores in use: 0.91, Total efficiency (on 16 cores): 5.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T10:12:57.490996 PSF sigmas in coadd pixels: ['1.89', '3.32', '1.98'] Using average PSF sigma 2.3972847483249855 Gaussian PSF norm 0.11767262607038298 vs pixelized 0.09085011 average tim pixel scale / coadd scale: 1.7298221319757459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.10', '3.84', '2.45', '2.07', '2.08'] Using average PSF sigma 2.5068262473636347 Gaussian PSF norm 0.11253065188325281 vs pixelized 0.099685535 average tim pixel scale / coadd scale: 1.7295429351533413 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.56', '1.56', '2.32', '1.41', '1.44', '1.52'] Using average PSF sigma 1.6258256866595453 Gaussian PSF norm 0.17350863262191157 vs pixelized 0.14085473 average tim pixel scale / coadd scale: 0.9909198815439754 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.59 s, CPU: 0.55 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 263 MB, VmData: 332 MB, maxrss: 0.307552 MB Stage fit_on_coadds finished: 2020-08-07T10:12:58.081357 Resources for stage fit_on_coadds : 1.065 s worker CPU, 1.065 s worker Wall, Wall: 0.592 s, Cores in use: 2.73, Total efficiency (on 16 cores): 17.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T10:12:58.337090 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 193 potential peaks Of 193 potential peaks: 118 in veto map, 14 cut by saddle test, 0 cut by aper test, 61 kept SED z : 61 new peaks Found 973 potential peaks Of 973 potential peaks: 948 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 860 potential peaks Of 860 potential peaks: 849 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 242 potential peaks Of 242 potential peaks: 222 in veto map, 17 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 247 potential peaks Of 247 potential peaks: 224 in veto map, 18 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 81 new sources Median coadd sky for g : 0.00022305186 Median coadd sky for r : 0.00034918985 Median coadd sky for z : 2.009603e-05 Stage srcs : Wall: 1.16 s, CPU: 1.02 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 267 MB, VmData: 332 MB, maxrss: 0.307552 MB Stage srcs finished: 2020-08-07T10:12:59.500490 Resources for stage srcs : 0.357 s worker CPU, 0.357 s worker Wall, Wall: 1.165 s, Cores in use: 1.18, Total efficiency (on 16 cores): 7.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T10:12:59.524535 Blob 1 of 45, id: 11, sources: 17, size: 183x246, npix 26749, brick X: 145,328, Y: 83,329, one pixel: 244 83 Blob 2 of 45, id: 23, sources: 9, size: 184x226, npix 18975, brick X: 327,511, Y: 244,470, one pixel: 436 244 Blob 3 of 45, id: 1, sources: 13, size: 208x92, npix 8594, brick X: 168,376, Y: 0,92, one pixel: 202 0 Blob 4 of 45, id: 21, sources: 6, size: 96x94, npix 5450, brick X: 0,96, Y: 216,310, one pixel: 48 216 Blob 5 of 45, id: 39, sources: 3, size: 112x57, npix 4279, brick X: 138,250, Y: 454,511, one pixel: 180 454 Blob 6 of 45, id: 2, sources: 2, size: 64x82, npix 4215, brick X: 447,511, Y: 0,82, one pixel: 466 0 Blob 7 of 45, id: 36, sources: 3, size: 78x70, npix 3091, brick X: 89,167, Y: 415,485, one pixel: 149 415 Blob 8 of 45, id: 18, sources: 3, size: 49x90, npix 2580, brick X: 108,157, Y: 176,266, one pixel: 125 176 Blob 9 of 45, id: 13, sources: 1, size: 49x44, npix 1478, brick X: 355,404, Y: 136,180, one pixel: 379 136 Blob 10 of 45, id: 38, sources: 1, size: 47x42, npix 1417, brick X: 269,316, Y: 452,494, one pixel: 294 452 Blob 11 of 45, id: 31, sources: 2, size: 56x38, npix 1398, brick X: 23,79, Y: 364,402, one pixel: 34 364 Blob 12 of 45, id: 4, sources: 2, size: 47x40, npix 1351, brick X: 401,448, Y: 31,71, one pixel: 427 31 Blob 13 of 45, id: 28, sources: 2, size: 40x52, npix 1190, brick X: 104,144, Y: 335,387, one pixel: 125 335 Blob 14 of 45, id: 27, sources: 2, size: 46x44, npix 1137, brick X: 290,336, Y: 311,355, one pixel: 306 311 Blob 15 of 45, id: 32, sources: 1, size: 38x47, npix 1110, brick X: 292,330, Y: 393,440, one pixel: 312 393 Blob 16 of 45, id: 7, sources: 1, size: 37x47, npix 1062, brick X: 356,393, Y: 65,112, one pixel: 378 65 Blob 17 of 45, id: 9, sources: 1, size: 37x37, npix 929, brick X: 9,46, Y: 69,106, one pixel: 25 69 Blob 14 finished, total: Wall: 0.56 s, CPU: 0.55 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147364 MB Blob 18 of 45, id: 15, sources: 1, size: 37x36, npix 871, brick X: 468,505, Y: 150,186, one pixel: 483 150 Measuring 2 iterative sources Measuring 1 iterative sources Measuring 1 iterative sources Measuring 1 iterative sources Blob 11 finished, total: Wall: 1.56 s, CPU: 1.53 s, VmPeak: 790 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.134236 MB Blob 9 finished, total: Wall: 1.56 s, CPU: 1.56 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148196 MB Blob 19 of 45, id: 44, sources: 3, size: 49x28, npix 858, brick X: 11,60, Y: 483,511, one pixel: 21 483 Blob 20 of 45, id: 3, sources: 1, size: 36x35, npix 822, brick X: 17,53, Y: 31,66, one pixel: 38 31 Blob 16 finished, total: Wall: 1.63 s, CPU: 1.56 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147828 MB Blob 21 of 45, id: 19, sources: 1, size: 33x33, npix 718, brick X: 312,345, Y: 186,219, one pixel: 331 186 Blob 13 finished, total: Wall: 1.78 s, CPU: 1.78 s, VmPeak: 791 MB, VmSize: 718 MB, VmRSS: 138 MB, VmData: 176 MB, maxrss: 0.141404 MB Blob 22 of 45, id: 0, sources: 1, size: 33x30, npix 687, brick X: 52,85, Y: 0,30, one pixel: 63 0 Blob 15 finished, total: Wall: 2.24 s, CPU: 2.13 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148648 MB Blob 23 of 45, id: 6, sources: 1, size: 28x31, npix 619, brick X: 324,352, Y: 52,83, one pixel: 334 52 Measuring 1 iterative sources Blob 12 finished, total: Wall: 2.48 s, CPU: 2.48 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148828 MB Blob 24 of 45, id: 24, sources: 1, size: 29x30, npix 600, brick X: 314,343, Y: 286,316, one pixel: 324 286 Blob 17 finished, total: Wall: 2.06 s, CPU: 2.06 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147876 MB Blob 25 of 45, id: 37, sources: 1, size: 30x27, npix 547, brick X: 323,353, Y: 427,454, one pixel: 336 427 Blob 20 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147828 MB Blob 26 of 45, id: 34, sources: 1, size: 28x29, npix 538, brick X: 182,210, Y: 399,428, one pixel: 192 399 Blob 10 finished, total: Wall: 2.71 s, CPU: 2.71 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102624 MB Blob 27 of 45, id: 30, sources: 1, size: 29x27, npix 488, brick X: 79,108, Y: 346,373, one pixel: 90 346 Blob 21 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 791 MB, VmSize: 718 MB, VmRSS: 138 MB, VmData: 176 MB, maxrss: 0.141404 MB Blob 28 of 45, id: 43, sources: 1, size: 27x26, npix 420, brick X: 435,462, Y: 482,508, one pixel: 447 482 Measuring 1 iterative sources Blob 22 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148648 MB Blob 29 of 45, id: 20, sources: 1, size: 23x24, npix 369, brick X: 418,441, Y: 188,212, one pixel: 427 188 Measuring 2 iterative sources Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.33714, 41.38914), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.5, r=19.8, z=19.1 Reset brightness to NanoMaggies: g=21, r=20.6, z=20.5 Measuring 1 iterative sources Blob 24 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147876 MB Blob 30 of 45, id: 29, sources: 1, size: 25x24, npix 366, brick X: 251,276, Y: 340,364, one pixel: 262 340 Blob 26 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102768 MB Blob 31 of 45, id: 5, sources: 1, size: 22x23, npix 315, brick X: 90,112, Y: 47,70, one pixel: 99 47 Blob 27 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 791 MB, VmSize: 718 MB, VmRSS: 138 MB, VmData: 176 MB, maxrss: 0.141404 MB Blob 32 of 45, id: 12, sources: 1, size: 17x26, npix 308, brick X: 494,511, Y: 106,132, one pixel: 505 106 Blob 33 of 45, id: 35, sources: 1, size: 22x22, npix 304, brick X: 14,36, Y: 409,431, one pixel: 23 409 Blob 23 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148828 MB Blob 34 of 45, id: 40, sources: 1, size: 23x22, npix 304, brick X: 481,504, Y: 467,489, one pixel: 491 467 Blob 18 finished, total: Wall: 1.96 s, CPU: 1.96 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 132 MB, VmData: 170 MB, maxrss: 0.135404 MB Blob 35 of 45, id: 41, sources: 1, size: 24x21, npix 292, brick X: 72,96, Y: 482,503, one pixel: 82 482 Blob 25 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147828 MB Blob 36 of 45, id: 14, sources: 1, size: 23x21, npix 291, brick X: 411,434, Y: 144,165, one pixel: 421 144 Blob 28 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148648 MB Blob 37 of 45, id: 8, sources: 1, size: 21x22, npix 280, brick X: 284,305, Y: 68,90, one pixel: 292 68 Blob 29 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147876 MB Blob 38 of 45, id: 33, sources: 1, size: 18x22, npix 272, brick X: 0,18, Y: 397,419, one pixel: 6 397 Blob 31 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 791 MB, VmSize: 718 MB, VmRSS: 138 MB, VmData: 176 MB, maxrss: 0.141404 MB Blob 39 of 45, id: 16, sources: 1, size: 21x20, npix 240, brick X: 79,100, Y: 164,184, one pixel: 88 164 Blob 33 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 132 MB, VmData: 170 MB, maxrss: 0.135404 MB Blob 40 of 45, id: 22, sources: 1, size: 21x20, npix 238, brick X: 403,424, Y: 242,262, one pixel: 413 242 Blob 19 finished, total: Wall: 2.61 s, CPU: 2.60 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148968 MB Blob 41 of 45, id: 26, sources: 1, size: 20x20, npix 238, brick X: 14,34, Y: 300,320, one pixel: 23 300 Measuring 1 iterative sources Blob 30 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102768 MB Blob 42 of 45, id: 42, sources: 1, size: 21x19, npix 237, brick X: 352,373, Y: 482,501, one pixel: 361 482 Blob 34 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147828 MB Blob 43 of 45, id: 25, sources: 1, size: 17x18, npix 185, brick X: 0,17, Y: 294,312, one pixel: 6 294 Blob 39 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148968 MB Blob 44 of 45, id: 17, sources: 1, size: 17x19, npix 179, brick X: 422,439, Y: 167,186, one pixel: 430 167 Blob 40 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102768 MB Blob 45 of 45, id: 10, sources: 1, size: 17x17, npix 145, brick X: 424,441, Y: 79,96, one pixel: 432 79 Blob 42 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148968 MB Blob 35 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148648 MB Blob 43 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102768 MB Blob 32 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148828 MB Blob 45 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148648 MB Blob 41 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147828 MB Blob 8 finished, total: Wall: 4.70 s, CPU: 4.70 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149564 MB Blob 44 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148968 MB Blob 38 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 790 MB, VmSize: 712 MB, VmRSS: 132 MB, VmData: 170 MB, maxrss: 0.135404 MB Blob 36 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147876 MB Blob 37 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 791 MB, VmSize: 718 MB, VmRSS: 138 MB, VmData: 176 MB, maxrss: 0.141404 MB Blob 6 finished, total: Wall: 5.13 s, CPU: 5.12 s, VmPeak: 810 MB, VmSize: 726 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.150328 MB Blob 4 finished, total: Wall: 5.16 s, CPU: 5.16 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149288 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 5.46 s, CPU: 5.46 s, VmPeak: 806 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149664 MB Blob 7 finished, total: Wall: 5.99 s, CPU: 5.99 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149644 MB Blob 3 finished, total: Wall: 7.65 s, CPU: 7.65 s, VmPeak: 807 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149332 MB Blob 2 finished, total: Wall: 8.10 s, CPU: 8.10 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14948 MB Exception in one_blob: brick custom-106316p41370, iblob 11 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2180024; please check the logfile. Finished galaxy PGC2180024 in 2.134 minutes. Started working on galaxy PGC2180024 at Fri Aug 7 12:10:44 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:10:45.100489 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.31639587803129', '41.37036650068698', '--width', '511', '--height', '511', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 106.31639587803129 41.37036650068698 Starting process 17323 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 17324 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 17325 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 17326 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 17327 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059408 MB Starting process 17328 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 17329 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059356 MB Starting process 17330 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 17331 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 17332 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 17333 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 17334 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17335 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17336 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 17337 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 17338 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 17339 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 17340 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 17341 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 17342 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 17343 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 17344 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 17345 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 17346 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 17347 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 17348 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 17349 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 17350 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 17351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 17352 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 17353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 17354 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:10:45.524976 Keeping 15 CCDs: k4m_151214_091255_ooi_zd_ls9-CCD1 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.97 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091255_ooi_zd_ls9-CCD2 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD3 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz k4m_170202_043607_ooi_zd_ls9-CCD4 z expnum 3105961 exptime 90.105 propid 2016A-0453 seeing 1.43 MJD 57786.192 object MzLS_609765_z mosaic/CP/V4.3/CP20170201/k4m_170202_043607_ooi_zd_ls9.fits.fz k4m_160126_062059_ooi_zd_ls9-CCD3 z expnum 64229 exptime 91.106 propid 2016A-0453 seeing 0.87 MJD 57413.265 object MzLS_611650_z mosaic/CP/V4.3/CP20160125/k4m_160126_062059_ooi_zd_ls9.fits.fz k4m_180105_075709_ooi_zd_ls9-CCD4 z expnum 154244 exptime 100.104 propid 2016A-0453 seeing 0.89 MJD 58123.331 object MzLS_610709_z mosaic/CP/V4.3/CP20180104/k4m_180105_075709_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD4 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.94 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz ksb_180115_042713_ooi_g_ls9-CCD3 g expnum 81330064 exptime 136.5 propid BASS seeing 1.17 MJD 58133.186 object 14942 90prime/CP/V2.3/CP20180114/ksb_180115_042713_ooi_g_ls9.fits.fz ksb_160130_050655_ooi_r_ls9-CCD3 r expnum 74170076 exptime 132.0 propid 2015A-0801 seeing 1.29 MJD 57417.213 object 14942 90prime/CP/V2.3/CP20160129/ksb_160130_050655_ooi_r_ls9.fits.fz ksb_160203_051429_ooi_r_ls9-CCD3 r expnum 74210067 exptime 99.7 propid 2015A-0801 seeing 2.36 MJD 57421.218 object 14942 90prime/CP/V2.3/CP20160202/ksb_160203_051429_ooi_r_ls9.fits.fz ksb_170119_062538_ooi_g_ls9-CCD2 g expnum 77720055 exptime 250.0 propid BASS seeing 2.04 MJD 57772.268 object 16243 90prime/CP/V2.3/CP20170118/ksb_170119_062538_ooi_g_ls9.fits.fz ksb_161107_114737_ooi_r_ls9-CCD2 r expnum 76990161 exptime 250.0 propid BASS seeing 1.51 MJD 57699.491 object 16243 90prime/CP/V2.3/CP20161106/ksb_161107_114737_ooi_r_ls9.fits.fz ksb_160213_035450_ooi_r_ls9-CCD2 r expnum 74310045 exptime 137.5 propid 2015A-0801 seeing 1.27 MJD 57431.163 object 16243 90prime/CP/V2.3/CP20160212/ksb_160213_035450_ooi_r_ls9.fits.fz ksb_160210_035402_ooi_g_ls9-CCD3 g expnum 74280078 exptime 127.1 propid 2015A-0801 seeing 1.22 MJD 57428.163 object 14941 90prime/CP/V2.3/CP20160209/ksb_160210_035402_ooi_g_ls9.fits.fz ksb_170320_024735_ooi_r_ls9-CCD3 r expnum 78320038 exptime 101.376 propid BASS seeing 1.28 MJD 57832.116 object 14941 90prime/CP/V2.3/CP20170319/ksb_170320_024735_ooi_r_ls9.fits.fz Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1025 1322 and amp range 0 2015 and image y 778 1075 and amp range 0 2047 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1034 1331 and amp range 0 2015 and image y 775 1071 and amp range 0 2047 Range in image: x 0 298 , y 0 297 (with image size 298 x 297) dzp -0.043123975 -> scaling image by 0.961059796099719 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3000 3297 and amp range 2016 4031 and image y 2751 3048 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.01723723 -> scaling image by 0.9842492857213068 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4012 4046 and amp range 2006 4053 and image y 3629 4072 and amp range 2040 4078 Range in image: x 0 35 , y 0 444 (with image size 35 x 444) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 90prime get_fwhm: self.fwhm = 5.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2978 3275 and amp range 2016 4031 and image y 2759 3056 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 256 and amp range 0 2047 and image y 7 492 and amp range 0 2039 Range in image: x 0 250 , y 0 486 (with image size 250 x 486) dzp -0.006320339 -> scaling image by 0.9941956631368829 Found overlap: image x 7 319 and amp range 0 2047 and image y 3777 4054 and amp range 2022 4060 Range in image: x 0 313 , y 0 278 (with image size 313 x 278) dzp -0.016192675 -> scaling image by 0.9851966584456431 Found overlap: image x 7 256 and amp range 0 2047 and image y 3602 4054 and amp range 2022 4060 Range in image: x 0 250 , y 0 453 (with image size 250 x 453) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4013 4046 and amp range 2006 4053 and image y 7 493 and amp range 0 2039 Range in image: x 0 34 , y 0 487 (with image size 34 x 487) dzp 0.001388291 -> scaling image by 1.0012794811153327 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2767 3065 and amp range 2016 4031 and image y 2761 3058 and amp range 2048 4095 Range in image: x 0 299 , y 0 298 (with image size 299 x 298) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2744 3042 and amp range 2016 4031 and image y 2734 3032 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.0002007609 -> scaling image by 1.0001849247187462 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 90prime get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2754 3052 and amp range 2016 4031 and image y 2759 3057 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.010008041 -> scaling image by 1.0092603604948323 mosaic get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1299 1823 and amp range 0 2005 and image y 3115 3646 and amp range 2040 4078 Range in image: x 0 525 , y 0 532 (with image size 525 x 532) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2975 3272 and amp range 2016 4031 and image y 2787 3084 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 5.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 0 2021 Range in image: x 0 523 , y 0 435 (with image size 523 x 521) dzp -0.03444113 -> scaling image by 0.9687763957004109 Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 2022 4060 Range in image: x 0 523 , y 435 521 (with image size 523 x 521) dzp -0.02499645 -> scaling image by 0.9772404160512723 Stage tims : Wall: 2.68 s, CPU: 0.82 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 189 MB, VmData: 223 MB, maxrss: 0.193836 MB Stage tims finished: 2020-08-07T12:10:48.207038 Resources for stage tims : 8.423 s worker CPU, 20.857 s worker Wall, Wall: 2.684 s, Cores in use: 3.45, Total efficiency (on 32 cores): 10.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:10:48.593991 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02022.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01896.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02021.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02150.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/reference-custom-106316p41370.fits Stage refs : Wall: 5.37 s, CPU: 4.04 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 244 MB, VmData: 275 MB, maxrss: 0.249348 MB Stage refs finished: 2020-08-07T12:10:53.963268 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 5.372 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:10:54.195824 Stage outliers : Wall: 1.08 s, CPU: 0.51 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 245 MB, VmData: 275 MB, maxrss: 0.250516 MB Stage outliers finished: 2020-08-07T12:10:55.280682 Resources for stage outliers : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.087 s, Cores in use: 0.47, Total efficiency (on 32 cores): 1.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:10:58.433605 Stage halos : Wall: 0.33 s, CPU: 0.31 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 251 MB, VmData: 283 MB, maxrss: 0.257008 MB Stage halos finished: 2020-08-07T12:10:58.759756 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.328 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:11:00.335445 PSF sigmas in coadd pixels: ['1.89', '3.32', '1.98'] Using average PSF sigma 2.3972847483249855 Gaussian PSF norm 0.11767262607038298 vs pixelized 0.09085011 average tim pixel scale / coadd scale: 1.7298221319757459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.10', '3.84', '2.45', '2.07', '2.08'] Using average PSF sigma 2.5068262473636347 Gaussian PSF norm 0.11253065188325281 vs pixelized 0.09968555 average tim pixel scale / coadd scale: 1.7295429351533413 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.56', '1.56', '2.32', '1.41', '1.44', '1.52'] Using average PSF sigma 1.6258256866595453 Gaussian PSF norm 0.17350863262191157 vs pixelized 0.14085473 average tim pixel scale / coadd scale: 0.9909198815439754 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.69 s, CPU: 0.56 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 251 MB, VmData: 318 MB, maxrss: 0.294316 MB Stage fit_on_coadds finished: 2020-08-07T12:11:01.021852 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.944 s worker CPU, 1.189 s worker Wall, Wall: 0.689 s, Cores in use: 2.19, Total efficiency (on 32 cores): 6.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T12:11:01.606040 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 193 potential peaks Of 193 potential peaks: 118 in veto map, 14 cut by saddle test, 0 cut by aper test, 61 kept SED z : 61 new peaks Found 973 potential peaks Of 973 potential peaks: 948 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 860 potential peaks Of 860 potential peaks: 849 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 242 potential peaks Of 242 potential peaks: 222 in veto map, 17 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 248 potential peaks Of 248 potential peaks: 225 in veto map, 18 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 81 new sources Median coadd sky for g : 0.00022305186 Median coadd sky for r : 0.00034918985 Median coadd sky for z : 2.009603e-05 Stage srcs : Wall: 1.15 s, CPU: 1.00 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 256 MB, VmData: 318 MB, maxrss: 0.294316 MB Stage srcs finished: 2020-08-07T12:11:02.752618 Resources for stage srcs : 0.302 s worker CPU, 0.330 s worker Wall, Wall: 1.149 s, Cores in use: 1.14, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:11:02.774960 Blob 1 of 45, id: 11, sources: 17, size: 183x246, npix 26749, brick X: 145,328, Y: 83,329, one pixel: 244 83 Blob 2 of 45, id: 23, sources: 9, size: 184x226, npix 18975, brick X: 327,511, Y: 244,470, one pixel: 436 244 Blob 3 of 45, id: 1, sources: 13, size: 208x92, npix 8594, brick X: 168,376, Y: 0,92, one pixel: 202 0 Blob 4 of 45, id: 21, sources: 6, size: 96x94, npix 5450, brick X: 0,96, Y: 216,310, one pixel: 48 216 Blob 5 of 45, id: 39, sources: 3, size: 112x57, npix 4279, brick X: 138,250, Y: 454,511, one pixel: 180 454 Blob 6 of 45, id: 2, sources: 2, size: 64x82, npix 4215, brick X: 447,511, Y: 0,82, one pixel: 466 0 Blob 7 of 45, id: 36, sources: 3, size: 78x70, npix 3091, brick X: 89,167, Y: 415,485, one pixel: 149 415 Blob 8 of 45, id: 18, sources: 3, size: 49x90, npix 2580, brick X: 108,157, Y: 176,266, one pixel: 125 176 Blob 9 of 45, id: 13, sources: 1, size: 49x44, npix 1478, brick X: 355,404, Y: 136,180, one pixel: 379 136 Blob 10 of 45, id: 38, sources: 1, size: 47x42, npix 1417, brick X: 269,316, Y: 452,494, one pixel: 294 452 Blob 11 of 45, id: 31, sources: 2, size: 56x38, npix 1398, brick X: 23,79, Y: 364,402, one pixel: 34 364 Blob 12 of 45, id: 4, sources: 2, size: 47x40, npix 1351, brick X: 401,448, Y: 31,71, one pixel: 427 31 Blob 13 of 45, id: 28, sources: 2, size: 40x52, npix 1190, brick X: 104,144, Y: 335,387, one pixel: 125 335 Blob 14 of 45, id: 27, sources: 2, size: 46x44, npix 1137, brick X: 290,336, Y: 311,355, one pixel: 306 311 Blob 15 of 45, id: 32, sources: 1, size: 38x47, npix 1110, brick X: 292,330, Y: 393,440, one pixel: 312 393 Blob 16 of 45, id: 7, sources: 1, size: 37x47, npix 1062, brick X: 356,393, Y: 65,112, one pixel: 378 65 Blob 17 of 45, id: 9, sources: 1, size: 37x37, npix 929, brick X: 9,46, Y: 69,106, one pixel: 25 69 Blob 18 of 45, id: 15, sources: 1, size: 37x36, npix 871, brick X: 468,505, Y: 150,186, one pixel: 483 150 Blob 19 of 45, id: 44, sources: 3, size: 49x28, npix 858, brick X: 11,60, Y: 483,511, one pixel: 21 483 Blob 20 of 45, id: 3, sources: 1, size: 36x35, npix 822, brick X: 17,53, Y: 31,66, one pixel: 38 31 Blob 21 of 45, id: 19, sources: 1, size: 33x33, npix 718, brick X: 312,345, Y: 186,219, one pixel: 331 186 Blob 22 of 45, id: 0, sources: 1, size: 33x30, npix 687, brick X: 52,85, Y: 0,30, one pixel: 63 0 Blob 23 of 45, id: 6, sources: 1, size: 28x31, npix 619, brick X: 324,352, Y: 52,83, one pixel: 334 52 Blob 24 of 45, id: 24, sources: 1, size: 29x30, npix 600, brick X: 314,343, Y: 286,316, one pixel: 324 286 Blob 25 of 45, id: 37, sources: 1, size: 30x27, npix 547, brick X: 323,353, Y: 427,454, one pixel: 336 427 Blob 26 of 45, id: 34, sources: 1, size: 28x29, npix 538, brick X: 182,210, Y: 399,428, one pixel: 192 399 Blob 27 of 45, id: 30, sources: 1, size: 29x27, npix 488, brick X: 79,108, Y: 346,373, one pixel: 90 346 Blob 28 of 45, id: 43, sources: 1, size: 27x26, npix 420, brick X: 435,462, Y: 482,508, one pixel: 447 482 Blob 29 of 45, id: 20, sources: 1, size: 23x24, npix 369, brick X: 418,441, Y: 188,212, one pixel: 427 188 Blob 30 of 45, id: 29, sources: 1, size: 25x24, npix 366, brick X: 251,276, Y: 340,364, one pixel: 262 340 Blob 31 of 45, id: 5, sources: 1, size: 22x23, npix 315, brick X: 90,112, Y: 47,70, one pixel: 99 47 Blob 32 of 45, id: 12, sources: 1, size: 17x26, npix 308, brick X: 494,511, Y: 106,132, one pixel: 505 106 Blob 33 of 45, id: 35, sources: 1, size: 22x22, npix 304, brick X: 14,36, Y: 409,431, one pixel: 23 409 Blob 34 of 45, id: 40, sources: 1, size: 23x22, npix 304, brick X: 481,504, Y: 467,489, one pixel: 491 467 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.33714, 41.38914), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.3, r=20.9, z=19.6 Reset brightness to NanoMaggies: g=21, r=20.6, z=20.5 Blob 14 finished, total: Wall: 0.52 s, CPU: 0.51 s, VmPeak: 813 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145964 MB Blob 35 of 45, id: 41, sources: 1, size: 24x21, npix 292, brick X: 72,96, Y: 482,503, one pixel: 82 482 Blob 29 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.099584 MB Blob 31 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147684 MB Blob 36 of 45, id: 14, sources: 1, size: 23x21, npix 291, brick X: 411,434, Y: 144,165, one pixel: 421 144 Blob 37 of 45, id: 8, sources: 1, size: 21x22, npix 280, brick X: 284,305, Y: 68,90, one pixel: 292 68 Blob 27 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 675 MB, VmSize: 675 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.102388 MB Blob 38 of 45, id: 33, sources: 1, size: 18x22, npix 272, brick X: 0,18, Y: 397,419, one pixel: 6 397 Blob 24 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093808 MB Blob 39 of 45, id: 16, sources: 1, size: 21x20, npix 240, brick X: 79,100, Y: 164,184, one pixel: 88 164 Blob 26 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090004 MB Blob 40 of 45, id: 22, sources: 1, size: 21x20, npix 238, brick X: 403,424, Y: 242,262, one pixel: 413 242 Blob 19 finished, total: Wall: 0.74 s, CPU: 0.69 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.090336 MB Blob 41 of 45, id: 26, sources: 1, size: 20x20, npix 238, brick X: 14,34, Y: 300,320, one pixel: 23 300 Blob 22 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146784 MB Blob 42 of 45, id: 42, sources: 1, size: 21x19, npix 237, brick X: 352,373, Y: 482,501, one pixel: 361 482 Measuring 1 iterative sources Measuring 1 iterative sources Blob 28 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147308 MB Blob 43 of 45, id: 25, sources: 1, size: 17x18, npix 185, brick X: 0,17, Y: 294,312, one pixel: 6 294 Blob 23 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147576 MB Blob 44 of 45, id: 17, sources: 1, size: 17x19, npix 179, brick X: 422,439, Y: 167,186, one pixel: 430 167 Blob 40 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147196 MB Blob 45 of 45, id: 10, sources: 1, size: 17x17, npix 145, brick X: 424,441, Y: 79,96, one pixel: 432 79 Blob 39 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.0905 MB Blob 30 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.1009 MB Blob 42 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148332 MB Blob 21 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.099968 MB Blob 43 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147196 MB Blob 45 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101044 MB Blob 44 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 138 MB, maxrss: 0.0905 MB Blob 33 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146452 MB Measuring 2 iterative sources Blob 41 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14746 MB Blob 20 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14706 MB Blob 32 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 790 MB, VmSize: 716 MB, VmRSS: 134 MB, VmData: 174 MB, maxrss: 0.136824 MB Blob 34 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.099724 MB Measuring 1 iterative sources Blob 38 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090236 MB Blob 35 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148032 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 9 finished, total: Wall: 1.48 s, CPU: 1.48 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147796 MB Blob 36 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 675 MB, VmSize: 675 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.10254 MB Blob 11 finished, total: Wall: 1.49 s, CPU: 1.47 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.091716 MB Blob 18 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147112 MB Blob 16 finished, total: Wall: 1.52 s, CPU: 1.46 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091028 MB Blob 37 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094032 MB Blob 25 finished, total: Wall: 1.62 s, CPU: 1.61 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092356 MB Blob 17 finished, total: Wall: 1.66 s, CPU: 1.59 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091556 MB Blob 13 finished, total: Wall: 1.72 s, CPU: 1.71 s, VmPeak: 791 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.134044 MB Blob 15 finished, total: Wall: 2.08 s, CPU: 2.08 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.10022 MB Blob 12 finished, total: Wall: 2.16 s, CPU: 2.15 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148172 MB Measuring 2 iterative sources Blob 10 finished, total: Wall: 2.33 s, CPU: 2.33 s, VmPeak: 806 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149124 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 3.09 s, CPU: 3.08 s, VmPeak: 673 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.098136 MB Blob 8 finished, total: Wall: 3.28 s, CPU: 3.27 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148544 MB Blob 6 finished, total: Wall: 3.43 s, CPU: 3.41 s, VmPeak: 672 MB, VmSize: 671 MB, VmRSS: 94 MB, VmData: 142 MB, maxrss: 0.097476 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 4.72 s, CPU: 4.70 s, VmPeak: 673 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.099648 MB Blob 7 finished, total: Wall: 4.73 s, CPU: 4.73 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147952 MB Blob 3 finished, total: Wall: 6.27 s, CPU: 6.27 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148816 MB Blob 2 finished, total: Wall: 6.74 s, CPU: 6.68 s, VmPeak: 676 MB, VmSize: 676 MB, VmRSS: 107 MB, VmData: 147 MB, maxrss: 0.109616 MB Exception in one_blob: brick custom-106316p41370, iblob 11 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2180024; please check the logfile. Finished galaxy PGC2180024 in 0.496 minutes. Started working on galaxy PGC2180024 at Fri Aug 7 12:35:19 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:35:20.149695 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.31639587803129', '41.37036650068698', '--width', '511', '--height', '511', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 106.31639587803129 41.37036650068698 Starting process 16851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 16852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 16856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 16858 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16860 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16861 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16870 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 16873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 16875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16878 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16879 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16880 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16881 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16882 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:35:20.771034 Keeping 15 CCDs: k4m_151214_091255_ooi_zd_ls9-CCD1 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.97 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091255_ooi_zd_ls9-CCD2 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD3 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz k4m_170202_043607_ooi_zd_ls9-CCD4 z expnum 3105961 exptime 90.105 propid 2016A-0453 seeing 1.43 MJD 57786.192 object MzLS_609765_z mosaic/CP/V4.3/CP20170201/k4m_170202_043607_ooi_zd_ls9.fits.fz k4m_160126_062059_ooi_zd_ls9-CCD3 z expnum 64229 exptime 91.106 propid 2016A-0453 seeing 0.87 MJD 57413.265 object MzLS_611650_z mosaic/CP/V4.3/CP20160125/k4m_160126_062059_ooi_zd_ls9.fits.fz k4m_180105_075709_ooi_zd_ls9-CCD4 z expnum 154244 exptime 100.104 propid 2016A-0453 seeing 0.89 MJD 58123.331 object MzLS_610709_z mosaic/CP/V4.3/CP20180104/k4m_180105_075709_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD4 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.94 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz ksb_180115_042713_ooi_g_ls9-CCD3 g expnum 81330064 exptime 136.5 propid BASS seeing 1.17 MJD 58133.186 object 14942 90prime/CP/V2.3/CP20180114/ksb_180115_042713_ooi_g_ls9.fits.fz ksb_160130_050655_ooi_r_ls9-CCD3 r expnum 74170076 exptime 132.0 propid 2015A-0801 seeing 1.29 MJD 57417.213 object 14942 90prime/CP/V2.3/CP20160129/ksb_160130_050655_ooi_r_ls9.fits.fz ksb_160203_051429_ooi_r_ls9-CCD3 r expnum 74210067 exptime 99.7 propid 2015A-0801 seeing 2.36 MJD 57421.218 object 14942 90prime/CP/V2.3/CP20160202/ksb_160203_051429_ooi_r_ls9.fits.fz ksb_170119_062538_ooi_g_ls9-CCD2 g expnum 77720055 exptime 250.0 propid BASS seeing 2.04 MJD 57772.268 object 16243 90prime/CP/V2.3/CP20170118/ksb_170119_062538_ooi_g_ls9.fits.fz ksb_161107_114737_ooi_r_ls9-CCD2 r expnum 76990161 exptime 250.0 propid BASS seeing 1.51 MJD 57699.491 object 16243 90prime/CP/V2.3/CP20161106/ksb_161107_114737_ooi_r_ls9.fits.fz ksb_160213_035450_ooi_r_ls9-CCD2 r expnum 74310045 exptime 137.5 propid 2015A-0801 seeing 1.27 MJD 57431.163 object 16243 90prime/CP/V2.3/CP20160212/ksb_160213_035450_ooi_r_ls9.fits.fz ksb_160210_035402_ooi_g_ls9-CCD3 g expnum 74280078 exptime 127.1 propid 2015A-0801 seeing 1.22 MJD 57428.163 object 14941 90prime/CP/V2.3/CP20160209/ksb_160210_035402_ooi_g_ls9.fits.fz ksb_170320_024735_ooi_r_ls9-CCD3 r expnum 78320038 exptime 101.376 propid BASS seeing 1.28 MJD 57832.116 object 14941 90prime/CP/V2.3/CP20170319/ksb_170320_024735_ooi_r_ls9.fits.fz Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1025 1322 and amp range 0 2015 and image y 778 1075 and amp range 0 2047 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.03470582 -> scaling image by 0.9685402452207784 mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 256 and amp range 0 2047 and image y 3602 4054 and amp range 2022 4060 Range in image: x 0 250 , y 0 453 (with image size 250 x 453) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3000 3297 and amp range 2016 4031 and image y 2751 3048 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.01723723 -> scaling image by 0.9842492857213068 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4012 4046 and amp range 2006 4053 and image y 3629 4072 and amp range 2040 4078 Range in image: x 0 35 , y 0 444 (with image size 35 x 444) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 90prime get_fwhm: self.fwhm = 5.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2978 3275 and amp range 2016 4031 and image y 2759 3056 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4013 4046 and amp range 2006 4053 and image y 7 493 and amp range 0 2039 Range in image: x 0 34 , y 0 487 (with image size 34 x 487) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 256 and amp range 0 2047 and image y 7 492 and amp range 0 2039 Range in image: x 0 250 , y 0 486 (with image size 250 x 486) dzp -0.006320339 -> scaling image by 0.9941956631368829 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2767 3065 and amp range 2016 4031 and image y 2761 3058 and amp range 2048 4095 Range in image: x 0 299 , y 0 298 (with image size 299 x 298) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1034 1331 and amp range 0 2015 and image y 775 1071 and amp range 0 2047 Range in image: x 0 298 , y 0 297 (with image size 298 x 297) dzp -0.043123975 -> scaling image by 0.961059796099719 mosaic get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1299 1823 and amp range 0 2005 and image y 3115 3646 and amp range 2040 4078 Range in image: x 0 525 , y 0 532 (with image size 525 x 532) dzp 0.0022078273 -> scaling image by 1.0020355530120029 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 319 and amp range 0 2047 and image y 3777 4054 and amp range 2022 4060 Range in image: x 0 313 , y 0 278 (with image size 313 x 278) dzp -0.016192675 -> scaling image by 0.9851966584456431 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2975 3272 and amp range 2016 4031 and image y 2787 3084 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 90prime get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2754 3052 and amp range 2016 4031 and image y 2759 3057 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.010008041 -> scaling image by 1.0092603604948323 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2744 3042 and amp range 2016 4031 and image y 2734 3032 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.0002007609 -> scaling image by 1.0001849247187462 mosaic get_fwhm: self.fwhm = 5.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 0 2021 Range in image: x 0 523 , y 0 435 (with image size 523 x 521) dzp -0.03444113 -> scaling image by 0.9687763957004109 Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 2022 4060 Range in image: x 0 523 , y 435 521 (with image size 523 x 521) dzp -0.02499645 -> scaling image by 0.9772404160512723 Stage tims : Wall: 2.72 s, CPU: 0.88 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 189 MB, VmData: 223 MB, maxrss: 0.193688 MB Stage tims finished: 2020-08-07T12:35:23.494391 Resources for stage tims : 8.323 s worker CPU, 22.783 s worker Wall, Wall: 2.726 s, Cores in use: 3.38, Total efficiency (on 32 cores): 10.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:35:23.532310 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02022.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01896.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02021.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02150.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/reference-custom-106316p41370.fits Stage refs : Wall: 4.63 s, CPU: 4.06 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 243 MB, VmData: 275 MB, maxrss: 0.24934 MB Stage refs finished: 2020-08-07T12:35:28.160679 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.631 s, Cores in use: 0.88, Total efficiency (on 32 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:35:28.540497 Stage outliers : Wall: 0.35 s, CPU: 0.32 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 245 MB, VmData: 275 MB, maxrss: 0.250508 MB Stage outliers finished: 2020-08-07T12:35:28.886846 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.349 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:35:28.930135 Stage halos : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 251 MB, VmData: 283 MB, maxrss: 0.257004 MB Stage halos finished: 2020-08-07T12:35:29.167332 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.240 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:35:29.211692 PSF sigmas in coadd pixels: ['1.89', '3.32', '1.98'] Using average PSF sigma 2.3972847483249855 Gaussian PSF norm 0.11767262607038298 vs pixelized 0.09085011 average tim pixel scale / coadd scale: 1.7298221319757459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.10', '3.84', '2.45', '2.07', '2.08'] Using average PSF sigma 2.5068262473636347 Gaussian PSF norm 0.11253065188325281 vs pixelized 0.09968554 average tim pixel scale / coadd scale: 1.7295429351533413 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.56', '1.56', '2.32', '1.41', '1.44', '1.52'] Using average PSF sigma 1.6258256866595453 Gaussian PSF norm 0.17350863262191157 vs pixelized 0.14085475 average tim pixel scale / coadd scale: 0.9909198815439754 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.58 s, CPU: 0.56 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 251 MB, VmData: 319 MB, maxrss: 0.295888 MB Stage fit_on_coadds finished: 2020-08-07T12:35:29.795954 Resources for stage fit_on_coadds : 1.006 s worker CPU, 1.146 s worker Wall, Wall: 0.586 s, Cores in use: 2.68, Total efficiency (on 32 cores): 8.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T12:35:30.456856 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 193 potential peaks Of 193 potential peaks: 118 in veto map, 14 cut by saddle test, 0 cut by aper test, 61 kept SED z : 61 new peaks Found 973 potential peaks Of 973 potential peaks: 948 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 860 potential peaks Of 860 potential peaks: 849 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 242 potential peaks Of 242 potential peaks: 222 in veto map, 17 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 248 potential peaks Of 248 potential peaks: 225 in veto map, 18 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 81 new sources Median coadd sky for g : 0.00022305186 Median coadd sky for r : 0.00034918985 Median coadd sky for z : 2.009603e-05 Stage srcs : Wall: 1.14 s, CPU: 0.99 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 258 MB, VmData: 319 MB, maxrss: 0.295888 MB Stage srcs finished: 2020-08-07T12:35:31.592288 Warning: Stellar halo subtraction is only implemented for DECam Resources for stage srcs : 0.327 s worker CPU, 0.394 s worker Wall, Wall: 1.138 s, Cores in use: 1.16, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:35:31.632141 Blob 1 of 45, id: 11, sources: 17, size: 183x246, npix 26749, brick X: 145,328, Y: 83,329, one pixel: 244 83 Blob 2 of 45, id: 23, sources: 9, size: 184x226, npix 18975, brick X: 327,511, Y: 244,470, one pixel: 436 244 Blob 3 of 45, id: 1, sources: 13, size: 208x92, npix 8594, brick X: 168,376, Y: 0,92, one pixel: 202 0 Blob 4 of 45, id: 21, sources: 6, size: 96x94, npix 5450, brick X: 0,96, Y: 216,310, one pixel: 48 216 Blob 5 of 45, id: 39, sources: 3, size: 112x57, npix 4279, brick X: 138,250, Y: 454,511, one pixel: 180 454 Blob 6 of 45, id: 2, sources: 2, size: 64x82, npix 4215, brick X: 447,511, Y: 0,82, one pixel: 466 0 Blob 7 of 45, id: 36, sources: 3, size: 78x70, npix 3091, brick X: 89,167, Y: 415,485, one pixel: 149 415 Blob 8 of 45, id: 18, sources: 3, size: 49x90, npix 2580, brick X: 108,157, Y: 176,266, one pixel: 125 176 Blob 9 of 45, id: 13, sources: 1, size: 49x44, npix 1478, brick X: 355,404, Y: 136,180, one pixel: 379 136 Blob 10 of 45, id: 38, sources: 1, size: 47x42, npix 1417, brick X: 269,316, Y: 452,494, one pixel: 294 452 Blob 11 of 45, id: 31, sources: 2, size: 56x38, npix 1398, brick X: 23,79, Y: 364,402, one pixel: 34 364 Blob 12 of 45, id: 4, sources: 2, size: 47x40, npix 1351, brick X: 401,448, Y: 31,71, one pixel: 427 31 Blob 13 of 45, id: 28, sources: 2, size: 40x52, npix 1190, brick X: 104,144, Y: 335,387, one pixel: 125 335 Blob 14 of 45, id: 27, sources: 2, size: 46x44, npix 1137, brick X: 290,336, Y: 311,355, one pixel: 306 311 Blob 15 of 45, id: 32, sources: 1, size: 38x47, npix 1110, brick X: 292,330, Y: 393,440, one pixel: 312 393 Blob 16 of 45, id: 7, sources: 1, size: 37x47, npix 1062, brick X: 356,393, Y: 65,112, one pixel: 378 65 Blob 17 of 45, id: 9, sources: 1, size: 37x37, npix 929, brick X: 9,46, Y: 69,106, one pixel: 25 69 Blob 18 of 45, id: 15, sources: 1, size: 37x36, npix 871, brick X: 468,505, Y: 150,186, one pixel: 483 150 Blob 19 of 45, id: 44, sources: 3, size: 49x28, npix 858, brick X: 11,60, Y: 483,511, one pixel: 21 483 Blob 20 of 45, id: 3, sources: 1, size: 36x35, npix 822, brick X: 17,53, Y: 31,66, one pixel: 38 31 Blob 21 of 45, id: 19, sources: 1, size: 33x33, npix 718, brick X: 312,345, Y: 186,219, one pixel: 331 186 Blob 22 of 45, id: 0, sources: 1, size: 33x30, npix 687, brick X: 52,85, Y: 0,30, one pixel: 63 0 Blob 23 of 45, id: 6, sources: 1, size: 28x31, npix 619, brick X: 324,352, Y: 52,83, one pixel: 334 52 Blob 24 of 45, id: 24, sources: 1, size: 29x30, npix 600, brick X: 314,343, Y: 286,316, one pixel: 324 286 Blob 25 of 45, id: 37, sources: 1, size: 30x27, npix 547, brick X: 323,353, Y: 427,454, one pixel: 336 427 Blob 26 of 45, id: 34, sources: 1, size: 28x29, npix 538, brick X: 182,210, Y: 399,428, one pixel: 192 399 Blob 27 of 45, id: 30, sources: 1, size: 29x27, npix 488, brick X: 79,108, Y: 346,373, one pixel: 90 346 Blob 28 of 45, id: 43, sources: 1, size: 27x26, npix 420, brick X: 435,462, Y: 482,508, one pixel: 447 482 Blob 29 of 45, id: 20, sources: 1, size: 23x24, npix 369, brick X: 418,441, Y: 188,212, one pixel: 427 188 Blob 30 of 45, id: 29, sources: 1, size: 25x24, npix 366, brick X: 251,276, Y: 340,364, one pixel: 262 340 Blob 31 of 45, id: 5, sources: 1, size: 22x23, npix 315, brick X: 90,112, Y: 47,70, one pixel: 99 47 Blob 32 of 45, id: 12, sources: 1, size: 17x26, npix 308, brick X: 494,511, Y: 106,132, one pixel: 505 106 Blob 33 of 45, id: 35, sources: 1, size: 22x22, npix 304, brick X: 14,36, Y: 409,431, one pixel: 23 409 Blob 34 of 45, id: 40, sources: 1, size: 23x22, npix 304, brick X: 481,504, Y: 467,489, one pixel: 491 467 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.33714, 41.38914), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.3, r=20.9, z=19.6 Reset brightness to NanoMaggies: g=21, r=20.6, z=20.5 Blob 14 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 96 MB, VmData: 143 MB, maxrss: 0.098756 MB Blob 35 of 45, id: 41, sources: 1, size: 24x21, npix 292, brick X: 72,96, Y: 482,503, one pixel: 82 482 Blob 29 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 675 MB, VmSize: 675 MB, VmRSS: 100 MB, VmData: 147 MB, maxrss: 0.102424 MB Blob 36 of 45, id: 14, sources: 1, size: 23x21, npix 291, brick X: 411,434, Y: 144,165, one pixel: 421 144 Blob 31 finished, total: Wall: 0.65 s, CPU: 0.60 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089796 MB Blob 19 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091456 MB Blob 37 of 45, id: 8, sources: 1, size: 21x22, npix 280, brick X: 284,305, Y: 68,90, one pixel: 292 68 Blob 27 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.098848 MB Blob 38 of 45, id: 33, sources: 1, size: 18x22, npix 272, brick X: 0,18, Y: 397,419, one pixel: 6 397 Blob 39 of 45, id: 16, sources: 1, size: 21x20, npix 240, brick X: 79,100, Y: 164,184, one pixel: 88 164 Blob 26 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 810 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146776 MB Blob 40 of 45, id: 22, sources: 1, size: 21x20, npix 238, brick X: 403,424, Y: 242,262, one pixel: 413 242 Blob 24 finished, total: Wall: 0.75 s, CPU: 0.70 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089996 MB Blob 41 of 45, id: 26, sources: 1, size: 20x20, npix 238, brick X: 14,34, Y: 300,320, one pixel: 23 300 Measuring 1 iterative sources Blob 22 finished, total: Wall: 0.81 s, CPU: 0.79 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147132 MB Measuring 1 iterative sources Blob 42 of 45, id: 42, sources: 1, size: 21x19, npix 237, brick X: 352,373, Y: 482,501, one pixel: 361 482 Blob 28 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146764 MB Blob 43 of 45, id: 25, sources: 1, size: 17x18, npix 185, brick X: 0,17, Y: 294,312, one pixel: 6 294 Blob 30 finished, total: Wall: 1.02 s, CPU: 1.01 s, VmPeak: 790 MB, VmSize: 716 MB, VmRSS: 133 MB, VmData: 174 MB, maxrss: 0.136288 MB Blob 44 of 45, id: 17, sources: 1, size: 17x19, npix 179, brick X: 422,439, Y: 167,186, one pixel: 430 167 Blob 39 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090228 MB Blob 45 of 45, id: 10, sources: 1, size: 17x17, npix 145, brick X: 424,441, Y: 79,96, one pixel: 432 79 Blob 40 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147132 MB Blob 23 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.099924 MB Measuring 2 iterative sources Blob 21 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.09998 MB Blob 42 finished, total: Wall: 0.10 s, CPU: 0.08 s, VmPeak: 790 MB, VmSize: 716 MB, VmRSS: 133 MB, VmData: 174 MB, maxrss: 0.13664 MB Blob 33 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.098896 MB Blob 43 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090228 MB Blob 20 finished, total: Wall: 1.18 s, CPU: 1.16 s, VmPeak: 791 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.13414 MB Blob 45 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 98 MB, VmData: 143 MB, maxrss: 0.100112 MB Blob 44 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147132 MB Blob 34 finished, total: Wall: 0.59 s, CPU: 0.58 s, VmPeak: 675 MB, VmSize: 675 MB, VmRSS: 100 MB, VmData: 147 MB, maxrss: 0.102544 MB Blob 32 finished, total: Wall: 1.18 s, CPU: 1.16 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147252 MB Blob 41 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146868 MB Measuring 1 iterative sources Blob 38 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147124 MB Blob 35 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090024 MB Measuring 1 iterative sources Blob 37 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099256 MB Measuring 1 iterative sources Blob 36 finished, total: Wall: 0.78 s, CPU: 0.77 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091544 MB Blob 9 finished, total: Wall: 1.51 s, CPU: 1.44 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092172 MB Blob 11 finished, total: Wall: 1.53 s, CPU: 1.52 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147132 MB Blob 25 finished, total: Wall: 1.51 s, CPU: 1.49 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100396 MB Blob 16 finished, total: Wall: 1.61 s, CPU: 1.60 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148336 MB Blob 18 finished, total: Wall: 1.61 s, CPU: 1.60 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146676 MB Blob 17 finished, total: Wall: 1.71 s, CPU: 1.70 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148 MB Blob 13 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148328 MB Blob 15 finished, total: Wall: 1.96 s, CPU: 1.89 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092816 MB Blob 12 finished, total: Wall: 2.25 s, CPU: 2.25 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095136 MB Blob 10 finished, total: Wall: 2.38 s, CPU: 2.37 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147536 MB Measuring 2 iterative sources Measuring 1 iterative sources Blob 5 finished, total: Wall: 3.10 s, CPU: 3.04 s, VmPeak: 673 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.098152 MB Blob 8 finished, total: Wall: 3.20 s, CPU: 3.20 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097136 MB Blob 6 finished, total: Wall: 3.49 s, CPU: 3.49 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14878 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 4.52 s, CPU: 4.47 s, VmPeak: 673 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.099784 MB Blob 7 finished, total: Wall: 4.52 s, CPU: 4.52 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148084 MB Blob 3 finished, total: Wall: 6.56 s, CPU: 6.49 s, VmPeak: 672 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.098872 MB Blob 2 finished, total: Wall: 6.65 s, CPU: 6.65 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 150 MB, VmData: 183 MB, maxrss: 0.153812 MB Exception in one_blob: brick custom-106316p41370, iblob 11 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2180024; please check the logfile. Finished galaxy PGC2180024 in 0.401 minutes. Started working on galaxy PGC2180024 at Fri Aug 7 13:38:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:38:01.797256 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '106.31639587803129', '41.37036650068698', '--width', '511', '--height', '511', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 106.31639587803129 41.37036650068698 --width 511 --height 511 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 106.31639587803129 41.37036650068698 Starting process 20815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 20816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 20817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 20818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 20819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 20820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 20821 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 20822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20823 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 20828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20829 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20830 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 20831 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 20832 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 20833 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20834 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 20836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 20837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 20838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 20839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20840 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 20841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 20843 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 20842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 20844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 20845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 20846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:38:02.283658 Keeping 15 CCDs: k4m_151214_091255_ooi_zd_ls9-CCD1 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.97 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091255_ooi_zd_ls9-CCD2 z expnum 62922 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.384 object MzLS_610710_z mosaic/CP/V4.3/CP20151213/k4m_151214_091255_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD3 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.96 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz k4m_170202_043607_ooi_zd_ls9-CCD4 z expnum 3105961 exptime 90.105 propid 2016A-0453 seeing 1.43 MJD 57786.192 object MzLS_609765_z mosaic/CP/V4.3/CP20170201/k4m_170202_043607_ooi_zd_ls9.fits.fz k4m_160126_062059_ooi_zd_ls9-CCD3 z expnum 64229 exptime 91.106 propid 2016A-0453 seeing 0.87 MJD 57413.265 object MzLS_611650_z mosaic/CP/V4.3/CP20160125/k4m_160126_062059_ooi_zd_ls9.fits.fz k4m_180105_075709_ooi_zd_ls9-CCD4 z expnum 154244 exptime 100.104 propid 2016A-0453 seeing 0.89 MJD 58123.331 object MzLS_610709_z mosaic/CP/V4.3/CP20180104/k4m_180105_075709_ooi_zd_ls9.fits.fz k4m_151214_091030_ooi_zd_ls9-CCD4 z expnum 62921 exptime 109.103 propid 2015B-2001 seeing 0.94 MJD 57370.382 object MzLS_610709_z mosaic/CP/V4.3/CP20151213/k4m_151214_091030_ooi_zd_ls9.fits.fz ksb_180115_042713_ooi_g_ls9-CCD3 g expnum 81330064 exptime 136.5 propid BASS seeing 1.17 MJD 58133.186 object 14942 90prime/CP/V2.3/CP20180114/ksb_180115_042713_ooi_g_ls9.fits.fz ksb_160130_050655_ooi_r_ls9-CCD3 r expnum 74170076 exptime 132.0 propid 2015A-0801 seeing 1.29 MJD 57417.213 object 14942 90prime/CP/V2.3/CP20160129/ksb_160130_050655_ooi_r_ls9.fits.fz ksb_160203_051429_ooi_r_ls9-CCD3 r expnum 74210067 exptime 99.7 propid 2015A-0801 seeing 2.36 MJD 57421.218 object 14942 90prime/CP/V2.3/CP20160202/ksb_160203_051429_ooi_r_ls9.fits.fz ksb_170119_062538_ooi_g_ls9-CCD2 g expnum 77720055 exptime 250.0 propid BASS seeing 2.04 MJD 57772.268 object 16243 90prime/CP/V2.3/CP20170118/ksb_170119_062538_ooi_g_ls9.fits.fz ksb_161107_114737_ooi_r_ls9-CCD2 r expnum 76990161 exptime 250.0 propid BASS seeing 1.51 MJD 57699.491 object 16243 90prime/CP/V2.3/CP20161106/ksb_161107_114737_ooi_r_ls9.fits.fz ksb_160213_035450_ooi_r_ls9-CCD2 r expnum 74310045 exptime 137.5 propid 2015A-0801 seeing 1.27 MJD 57431.163 object 16243 90prime/CP/V2.3/CP20160212/ksb_160213_035450_ooi_r_ls9.fits.fz ksb_160210_035402_ooi_g_ls9-CCD3 g expnum 74280078 exptime 127.1 propid 2015A-0801 seeing 1.22 MJD 57428.163 object 14941 90prime/CP/V2.3/CP20160209/ksb_160210_035402_ooi_g_ls9.fits.fz ksb_170320_024735_ooi_r_ls9-CCD3 r expnum 78320038 exptime 101.376 propid BASS seeing 1.28 MJD 57832.116 object 14941 90prime/CP/V2.3/CP20170319/ksb_170320_024735_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 319 and amp range 0 2047 and image y 3777 4054 and amp range 2022 4060 Range in image: x 0 313 , y 0 278 (with image size 313 x 278) dzp -0.016192675 -> scaling image by 0.9851966584456431 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4013 4046 and amp range 2006 4053 and image y 7 493 and amp range 0 2039 Range in image: x 0 34 , y 0 487 (with image size 34 x 487) dzp 0.001388291 -> scaling image by 1.0012794811153327 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 256 and amp range 0 2047 and image y 7 492 and amp range 0 2039 Range in image: x 0 250 , y 0 486 (with image size 250 x 486) dzp -0.006320339 -> scaling image by 0.9941956631368829 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 Faked up EXPNUM 81330064 90prime get_fwhm: self.fwhm = 2.57 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3000 3297 and amp range 2016 4031 and image y 2751 3048 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 Faked up EXPNUM 74280078 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1025 1322 and amp range 0 2015 and image y 778 1075 and amp range 0 2047 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.03470582 -> scaling image by 0.9685402452207784 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 Faked up EXPNUM 74210067 90prime get_fwhm: self.fwhm = 5.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2978 3275 and amp range 2016 4031 and image y 2759 3056 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 Faked up EXPNUM 78320038 90prime get_fwhm: self.fwhm = 2.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1034 1331 and amp range 0 2015 and image y 775 1071 and amp range 0 2047 Range in image: x 0 298 , y 0 297 (with image size 298 x 297) dzp -0.043123975 -> scaling image by 0.961059796099719 mosaic get_fwhm: self.fwhm = 3.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 256 and amp range 0 2047 and image y 3602 4054 and amp range 2022 4060 Range in image: x 0 250 , y 0 453 (with image size 250 x 453) dzp 0.0033053984 -> scaling image by 1.0030490232713904 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4012 4046 and amp range 2006 4053 and image y 3629 4072 and amp range 2040 4078 Range in image: x 0 35 , y 0 444 (with image size 35 x 444) dzp -0.0026360443 -> scaling image by 0.99757505842151 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 Faked up EXPNUM 74170076 90prime get_fwhm: self.fwhm = 2.85 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2975 3272 and amp range 2016 4031 and image y 2787 3084 and amp range 2048 4095 Range in image: x 0 298 , y 0 298 (with image size 298 x 298) dzp -0.0005558773 -> scaling image by 0.99948814914245 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 Faked up EXPNUM 76990161 90prime get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2767 3065 and amp range 2016 4031 and image y 2761 3058 and amp range 2048 4095 Range in image: x 0 299 , y 0 298 (with image size 299 x 298) dzp 0.021366077 -> scaling image by 1.0198737893800265 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 Faked up EXPNUM 74310045 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2744 3042 and amp range 2016 4031 and image y 2734 3032 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.0002007609 -> scaling image by 1.0001849247187462 mosaic get_fwhm: self.fwhm = 3.35 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1299 1823 and amp range 0 2005 and image y 3115 3646 and amp range 2040 4078 Range in image: x 0 525 , y 0 532 (with image size 525 x 532) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 Faked up EXPNUM 77720055 90prime get_fwhm: self.fwhm = 4.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2754 3052 and amp range 2016 4031 and image y 2759 3057 and amp range 2048 4095 Range in image: x 0 299 , y 0 299 (with image size 299 x 299) dzp 0.010008041 -> scaling image by 1.0092603604948323 mosaic get_fwhm: self.fwhm = 5.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 0 2021 Range in image: x 0 523 , y 0 435 (with image size 523 x 521) dzp -0.03444113 -> scaling image by 0.9687763957004109 Found overlap: image x 2432 2954 and amp range 2048 4095 and image y 1587 2107 and amp range 2022 4060 Range in image: x 0 523 , y 435 521 (with image size 523 x 521) dzp -0.02499645 -> scaling image by 0.9772404160512723 Stage tims : Wall: 2.98 s, CPU: 1.04 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 188 MB, VmData: 222 MB, maxrss: 0.192948 MB Stage tims finished: 2020-08-07T13:38:05.265225 Resources for stage tims : 8.499 s worker CPU, 21.969 s worker Wall, Wall: 2.984 s, Cores in use: 3.20, Total efficiency (on 32 cores): 10.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T13:38:05.341663 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02022.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01896.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02021.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02150.fits Matched 7 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/reference-custom-106316p41370.fits Stage refs : Wall: 4.35 s, CPU: 4.01 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 243 MB, VmData: 274 MB, maxrss: 0.24886 MB Stage refs finished: 2020-08-07T13:38:09.694180 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 4.355 s, Cores in use: 0.92, Total efficiency (on 32 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:38:09.744375 Stage outliers : Wall: 0.30 s, CPU: 0.27 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 244 MB, VmData: 274 MB, maxrss: 0.24962 MB Stage outliers finished: 2020-08-07T13:38:10.045457 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.303 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T13:38:10.090521 Stage halos : Wall: 0.23 s, CPU: 0.21 s, VmPeak: 1009 MB, VmSize: 1004 MB, VmRSS: 250 MB, VmData: 282 MB, maxrss: 0.256008 MB Stage halos finished: 2020-08-07T13:38:10.316698 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.229 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T13:38:10.359782 PSF sigmas in coadd pixels: ['1.89', '3.32', '1.98'] Using average PSF sigma 2.3972847483249855 Gaussian PSF norm 0.11767262607038298 vs pixelized 0.09085011 average tim pixel scale / coadd scale: 1.7298221319757459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.10', '3.84', '2.45', '2.07', '2.08'] Using average PSF sigma 2.5068262473636347 Gaussian PSF norm 0.11253065188325281 vs pixelized 0.099685535 average tim pixel scale / coadd scale: 1.7295429351533413 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.56', '1.56', '2.32', '1.41', '1.44', '1.52'] Using average PSF sigma 1.6258256866595453 Gaussian PSF norm 0.17350863262191157 vs pixelized 0.14085473 average tim pixel scale / coadd scale: 0.9909198815439754 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.59 s, CPU: 0.56 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 251 MB, VmData: 323 MB, maxrss: 0.299404 MB Stage fit_on_coadds finished: 2020-08-07T13:38:10.954528 Resources for stage fit_on_coadds : 0.997 s worker CPU, 1.122 s worker Wall, Wall: 0.597 s, Cores in use: 2.61, Total efficiency (on 32 cores): 8.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T13:38:10.987898 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 193 potential peaks Of 193 potential peaks: 118 in veto map, 14 cut by saddle test, 0 cut by aper test, 61 kept SED z : 61 new peaks Found 973 potential peaks Of 973 potential peaks: 948 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 860 potential peaks Of 860 potential peaks: 849 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 242 potential peaks Of 242 potential peaks: 222 in veto map, 17 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 248 potential peaks Of 248 potential peaks: 225 in veto map, 18 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 81 new sources Median coadd sky for g : 0.00022305186 Median coadd sky for r : 0.0003491898 Median coadd sky for z : 2.009575e-05 Stage srcs : Wall: 1.09 s, CPU: 0.92 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 259 MB, VmData: 323 MB, maxrss: 0.299404 MB Stage srcs finished: 2020-08-07T13:38:12.081489 Resources for stage srcs : 0.338 s worker CPU, 0.397 s worker Wall, Wall: 1.096 s, Cores in use: 1.15, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:38:12.112441 Blob 1 of 45, id: 11, sources: 17, size: 183x246, npix 26749, brick X: 145,328, Y: 83,329, one pixel: 244 83 Blob 2 of 45, id: 23, sources: 9, size: 184x226, npix 18975, brick X: 327,511, Y: 244,470, one pixel: 436 244 Blob 3 of 45, id: 1, sources: 13, size: 208x92, npix 8594, brick X: 168,376, Y: 0,92, one pixel: 202 0 Blob 4 of 45, id: 21, sources: 6, size: 96x94, npix 5450, brick X: 0,96, Y: 216,310, one pixel: 48 216 Blob 5 of 45, id: 39, sources: 3, size: 112x57, npix 4279, brick X: 138,250, Y: 454,511, one pixel: 180 454 Blob 6 of 45, id: 2, sources: 2, size: 64x82, npix 4215, brick X: 447,511, Y: 0,82, one pixel: 466 0 Blob 7 of 45, id: 36, sources: 3, size: 78x70, npix 3091, brick X: 89,167, Y: 415,485, one pixel: 149 415 Blob 8 of 45, id: 18, sources: 3, size: 49x90, npix 2580, brick X: 108,157, Y: 176,266, one pixel: 125 176 Blob 9 of 45, id: 13, sources: 1, size: 49x44, npix 1478, brick X: 355,404, Y: 136,180, one pixel: 379 136 Blob 10 of 45, id: 38, sources: 1, size: 47x42, npix 1417, brick X: 269,316, Y: 452,494, one pixel: 294 452 Blob 11 of 45, id: 31, sources: 2, size: 56x38, npix 1398, brick X: 23,79, Y: 364,402, one pixel: 34 364 Blob 12 of 45, id: 4, sources: 2, size: 47x40, npix 1351, brick X: 401,448, Y: 31,71, one pixel: 427 31 Blob 13 of 45, id: 28, sources: 2, size: 40x52, npix 1190, brick X: 104,144, Y: 335,387, one pixel: 125 335 Blob 14 of 45, id: 27, sources: 2, size: 46x44, npix 1137, brick X: 290,336, Y: 311,355, one pixel: 306 311 Blob 15 of 45, id: 32, sources: 1, size: 38x47, npix 1110, brick X: 292,330, Y: 393,440, one pixel: 312 393 Blob 16 of 45, id: 7, sources: 1, size: 37x47, npix 1062, brick X: 356,393, Y: 65,112, one pixel: 378 65 Blob 17 of 45, id: 9, sources: 1, size: 37x37, npix 929, brick X: 9,46, Y: 69,106, one pixel: 25 69 Blob 18 of 45, id: 15, sources: 1, size: 37x36, npix 871, brick X: 468,505, Y: 150,186, one pixel: 483 150 Blob 19 of 45, id: 44, sources: 3, size: 49x28, npix 858, brick X: 11,60, Y: 483,511, one pixel: 21 483 Blob 20 of 45, id: 3, sources: 1, size: 36x35, npix 822, brick X: 17,53, Y: 31,66, one pixel: 38 31 Blob 21 of 45, id: 19, sources: 1, size: 33x33, npix 718, brick X: 312,345, Y: 186,219, one pixel: 331 186 Blob 22 of 45, id: 0, sources: 1, size: 33x30, npix 687, brick X: 52,85, Y: 0,30, one pixel: 63 0 Blob 23 of 45, id: 6, sources: 1, size: 28x31, npix 619, brick X: 324,352, Y: 52,83, one pixel: 334 52 Blob 24 of 45, id: 24, sources: 1, size: 29x30, npix 600, brick X: 314,343, Y: 286,316, one pixel: 324 286 Blob 25 of 45, id: 37, sources: 1, size: 30x27, npix 547, brick X: 323,353, Y: 427,454, one pixel: 336 427 Blob 26 of 45, id: 34, sources: 1, size: 28x29, npix 538, brick X: 182,210, Y: 399,428, one pixel: 192 399 Blob 27 of 45, id: 30, sources: 1, size: 29x27, npix 488, brick X: 79,108, Y: 346,373, one pixel: 90 346 Blob 28 of 45, id: 43, sources: 1, size: 27x26, npix 420, brick X: 435,462, Y: 482,508, one pixel: 447 482 Blob 29 of 45, id: 20, sources: 1, size: 23x24, npix 369, brick X: 418,441, Y: 188,212, one pixel: 427 188 Blob 30 of 45, id: 29, sources: 1, size: 25x24, npix 366, brick X: 251,276, Y: 340,364, one pixel: 262 340 Blob 31 of 45, id: 5, sources: 1, size: 22x23, npix 315, brick X: 90,112, Y: 47,70, one pixel: 99 47 Blob 32 of 45, id: 12, sources: 1, size: 17x26, npix 308, brick X: 494,511, Y: 106,132, one pixel: 505 106 Blob 33 of 45, id: 35, sources: 1, size: 22x22, npix 304, brick X: 14,36, Y: 409,431, one pixel: 23 409 Blob 34 of 45, id: 40, sources: 1, size: 23x22, npix 304, brick X: 481,504, Y: 467,489, one pixel: 491 467 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (106.33714, 41.38914), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.3, r=20.9, z=19.6 Reset brightness to NanoMaggies: g=21, r=20.6, z=20.5 Blob 14 finished, total: Wall: 0.52 s, CPU: 0.48 s, VmPeak: 813 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14668 MB Blob 35 of 45, id: 41, sources: 1, size: 24x21, npix 292, brick X: 72,96, Y: 482,503, one pixel: 82 482 Blob 29 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09858 MB Blob 36 of 45, id: 14, sources: 1, size: 23x21, npix 291, brick X: 411,434, Y: 144,165, one pixel: 421 144 Blob 31 finished, total: Wall: 0.63 s, CPU: 0.58 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 96 MB, VmData: 143 MB, maxrss: 0.098588 MB Blob 19 finished, total: Wall: 0.67 s, CPU: 0.65 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.100992 MB Blob 37 of 45, id: 8, sources: 1, size: 21x22, npix 280, brick X: 284,305, Y: 68,90, one pixel: 292 68 Blob 38 of 45, id: 33, sources: 1, size: 18x22, npix 272, brick X: 0,18, Y: 397,419, one pixel: 6 397 Blob 27 finished, total: Wall: 0.68 s, CPU: 0.64 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 97 MB, VmData: 144 MB, maxrss: 0.099732 MB Blob 26 finished, total: Wall: 0.67 s, CPU: 0.66 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147304 MB Blob 39 of 45, id: 16, sources: 1, size: 21x20, npix 240, brick X: 79,100, Y: 164,184, one pixel: 88 164 Blob 24 finished, total: Wall: 0.71 s, CPU: 0.67 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146772 MB Blob 40 of 45, id: 22, sources: 1, size: 21x20, npix 238, brick X: 403,424, Y: 242,262, one pixel: 413 242 Blob 41 of 45, id: 26, sources: 1, size: 20x20, npix 238, brick X: 14,34, Y: 300,320, one pixel: 23 300 Blob 22 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.099884 MB Blob 42 of 45, id: 42, sources: 1, size: 21x19, npix 237, brick X: 352,373, Y: 482,501, one pixel: 361 482 Measuring 1 iterative sources Measuring 1 iterative sources Blob 40 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10004 MB Blob 43 of 45, id: 25, sources: 1, size: 17x18, npix 185, brick X: 0,17, Y: 294,312, one pixel: 6 294 Blob 23 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100608 MB Blob 28 finished, total: Wall: 1.01 s, CPU: 0.93 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.09166 MB Blob 39 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147132 MB Blob 44 of 45, id: 17, sources: 1, size: 17x19, npix 179, brick X: 422,439, Y: 167,186, one pixel: 430 167 Blob 45 of 45, id: 10, sources: 1, size: 17x17, npix 145, brick X: 424,441, Y: 79,96, one pixel: 432 79 Blob 30 finished, total: Wall: 1.05 s, CPU: 1.01 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146508 MB Blob 43 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147132 MB Blob 42 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 99 MB, VmData: 144 MB, maxrss: 0.100876 MB Blob 33 finished, total: Wall: 0.63 s, CPU: 0.60 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147044 MB Blob 44 finished, total: Wall: 0.10 s, CPU: 0.09 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.091788 MB Blob 20 finished, total: Wall: 1.18 s, CPU: 1.15 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147708 MB Blob 45 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 812 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14688 MB Measuring 2 iterative sources Blob 34 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.09874 MB Measuring 1 iterative sources Blob 21 finished, total: Wall: 1.21 s, CPU: 1.11 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09224 MB Blob 38 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147652 MB Blob 41 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10004 MB Measuring 1 iterative sources Blob 32 finished, total: Wall: 1.29 s, CPU: 1.24 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091152 MB Blob 9 finished, total: Wall: 1.41 s, CPU: 1.38 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147804 MB Blob 35 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 96 MB, VmData: 143 MB, maxrss: 0.098748 MB Blob 36 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 674 MB, VmSize: 674 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.10114 MB Measuring 1 iterative sources Blob 18 finished, total: Wall: 1.48 s, CPU: 1.46 s, VmPeak: 791 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.1341 MB Blob 16 finished, total: Wall: 1.49 s, CPU: 1.41 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.0912 MB Blob 11 finished, total: Wall: 1.55 s, CPU: 1.46 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.091716 MB Blob 37 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 673 MB, VmSize: 673 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.09996 MB Blob 25 finished, total: Wall: 1.59 s, CPU: 1.56 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.09968 MB Blob 17 finished, total: Wall: 1.66 s, CPU: 1.62 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.09582 MB Blob 13 finished, total: Wall: 1.78 s, CPU: 1.69 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09284 MB Blob 15 finished, total: Wall: 1.98 s, CPU: 1.96 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148144 MB Measuring 2 iterative sources Blob 12 finished, total: Wall: 2.30 s, CPU: 2.21 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.092968 MB Blob 10 finished, total: Wall: 2.38 s, CPU: 2.34 s, VmPeak: 790 MB, VmSize: 711 MB, VmRSS: 130 MB, VmData: 169 MB, maxrss: 0.132836 MB Blob 5 finished, total: Wall: 3.12 s, CPU: 3.08 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148376 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 3.31 s, CPU: 3.28 s, VmPeak: 810 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148012 MB Blob 8 finished, total: Wall: 3.40 s, CPU: 3.32 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096584 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 4.65 s, CPU: 4.64 s, VmPeak: 810 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149648 MB Blob 4 finished, total: Wall: 4.69 s, CPU: 4.60 s, VmPeak: 673 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.099724 MB Blob 3 finished, total: Wall: 6.37 s, CPU: 6.33 s, VmPeak: 812 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148904 MB Blob 2 finished, total: Wall: 6.78 s, CPU: 6.75 s, VmPeak: 806 MB, VmSize: 726 MB, VmRSS: 151 MB, VmData: 184 MB, maxrss: 0.15486 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.67026, ee1=0.21839, ee2=-0.170186 Measuring 2 iterative sources Blob 1 finished, total: Wall: 18.75 s, CPU: 18.74 s, VmPeak: 809 MB, VmSize: 730 MB, VmRSS: 154 MB, VmData: 185 MB, maxrss: 0.157596 MB Old catalog: 102 New catalog: 98 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/blobs-custom-106316p41370.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/metrics/cus/all-models-custom-106316p41370.fits Stage fitblobs : Wall: 19.79 s, CPU: 0.62 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 259 MB, VmData: 323 MB, maxrss: 0.299404 MB Stage fitblobs finished: 2020-08-07T13:38:31.906589 Resources for stage fitblobs : 85.010 s worker CPU, 86.570 s worker Wall, Wall: 19.797 s, Cores in use: 4.33, Total efficiency (on 32 cores): 13.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:38:31.933096 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-resid.jpg Stage coadds : Wall: 3.16 s, CPU: 1.01 s, VmPeak: 1041 MB, VmSize: 1008 MB, VmRSS: 272 MB, VmData: 324 MB, maxrss: 0.312164 MB Stage coadds finished: 2020-08-07T13:38:35.089803 Resources for stage coadds : 22.629 s worker CPU, 23.447 s worker Wall, Wall: 3.159 s, Cores in use: 7.48, Total efficiency (on 32 cores): 23.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:38:35.135714 Cut to 1 unWISE tiles Reading WISE tile 1068p408 band 1 Reading WISE tile 1068p408 band 2 Reading WISE tile 1068p408 band 3 Reading WISE tile 1068p408 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.41 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.209028 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.34 s, CPU: 1.06 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.189968 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.38 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 143 MB, VmData: 184 MB, maxrss: 0.205264 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/106/1068p408/unwise-1068p408-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.38 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 145 MB, VmData: 189 MB, maxrss: 0.208596 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/tmp-legacysurvey-custom-106316p41370-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.11 s, CPU: 0.64 s, VmPeak: 1041 MB, VmSize: 1008 MB, VmRSS: 272 MB, VmData: 324 MB, maxrss: 0.312164 MB Stage wise_forced finished: 2020-08-07T13:38:37.246229 Resources for stage wise_forced : 5.367 s worker CPU, 4.854 s worker Wall, Wall: 2.113 s, Cores in use: 2.85, Total efficiency (on 32 cores): 8.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:38:37.274756 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/coadd/cus/custom-106316p41370/legacysurvey-custom-106316p41370-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/tractor-i/cus/tractor-custom-106316p41370.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/tractor/cus/tractor-custom-106316p41370.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/tractor/cus/brick-custom-106316p41370.sha256sum Stage writecat : Wall: 0.89 s, CPU: 0.76 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 285 MB, VmData: 336 MB, maxrss: 0.423356 MB Stage writecat finished: 2020-08-07T13:38:38.164705 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.893 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/106/PGC2180024/PGC2180024-largegalaxy-writecat.p All done: 122.847 s worker CPU, 138.368 s worker Wall, Wall: 35.914 s, Cores in use: 3.71, Total efficiency (on 32 cores): 11.6 % Finished galaxy PGC2180024 in 0.627 minutes.