Started working on galaxy PGC2032985 at Sat Jun 6 20:14:34 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.227551 33.4821179 --width 279 --height 279 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-06T20:14:35.700196 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.227551', '33.4821179', '--width', '279', '--height', '279', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.227551 33.4821179 --width 279 --height 279 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 233.227551 33.4821179 Starting process 58102 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057468 MB Starting process 58103 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB Starting process 58104 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057468 MB Starting process 58105 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057384 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-06T20:14:40.662982 Keeping 10 CCDs: k4m_170301_121613_ooi_zd_ls9.fits.fz k4m_170301_121613_ooi_zd_ls9-CCD4 z exptime 80.105 propid 2016A-0453 seeing 0.81 MJD 57813.511 object MzLS_570024_z k4m_170304_121148_ooi_zd_ls9.fits.fz k4m_170304_121148_ooi_zd_ls9-CCD1 z exptime 80.107 propid 2016A-0453 seeing 0.89 MJD 57816.508 object MzLS_572114_z k4m_170205_132301_ooi_zd_ls9.fits.fz k4m_170205_132301_ooi_zd_ls9-CCD3 z exptime 80.106 propid 2016A-0453 seeing 0.87 MJD 57789.558 object MzLS_571070_z ksb_180421_074654_ooi_r_ls9.fits.fz ksb_180421_074654_ooi_r_ls9-CCD3 r exptime 106.193 propid BASS seeing 1.53 MJD 58229.324 object 05201 ksb_170522_085552_ooi_g_ls9.fits.fz ksb_170522_085552_ooi_g_ls9-CCD3 g exptime 95.828 propid 2015A-0801 seeing 1.40 MJD 57895.372 object 05201 ksb_160601_083327_ooi_g_ls9.fits.fz ksb_160601_083327_ooi_g_ls9-CCD2 g exptime 99.3 propid BASS seeing 1.20 MJD 57540.357 object 06573 ksb_170518_092329_ooi_r_ls9.fits.fz ksb_170518_092329_ooi_r_ls9-CCD3 r exptime 112.4 propid 2015A-0801 seeing 1.40 MJD 57891.391 object 05202 ksb_170326_105441_ooi_g_ls9.fits.fz ksb_170326_105441_ooi_g_ls9-CCD3 g exptime 72.968 propid BASS seeing 1.35 MJD 57838.455 object 05202 ksb_170522_085341_ooi_g_ls9.fits.fz ksb_170522_085341_ooi_g_ls9-CCD4 g exptime 94.21 propid 2015A-0801 seeing 1.31 MJD 57895.371 object 06571 ksb_160212_122506_ooi_r_ls9.fits.fz ksb_160212_122506_ooi_r_ls9-CCD4 r exptime 67.1 propid 2015A-0801 seeing 1.22 MJD 57430.517 object 06571 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3177 3458 and amp range 2006 4053 and image y 2215 2499 and amp range 2040 4078 Range in image: x 0 282 , y 0 285 (with image size 282 x 285) dzp -0.0021409686 -> scaling image by 0.9980300379995196 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 455 741 and amp range 0 2005 and image y 3645 3927 and amp range 2040 4078 Range in image: x 0 287 , y 0 283 (with image size 287 x 283) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 187 351 and amp range 0 2015 and image y 1152 1315 and amp range 0 2047 Range in image: x 0 165 , y 0 164 (with image size 165 x 164) dzp -0.039144866 -> scaling image by 0.9645884414840357 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1954 2117 and amp range 0 2015 and image y 2347 2510 and amp range 2048 4095 Range in image: x 0 62 , y 0 164 (with image size 164 x 164) dzp 0.01693853 -> scaling image by 1.015723292931903 Found overlap: image x 1954 2117 and amp range 2016 4031 and image y 2347 2510 and amp range 2048 4095 Range in image: x 62 164 , y 0 164 (with image size 164 x 164) dzp 0.0026774607 -> scaling image by 1.002469075566243 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 210 373 and amp range 0 2015 and image y 969 1132 and amp range 0 2047 Range in image: x 0 164 , y 0 164 (with image size 164 x 164) dzp -0.036130503 -> scaling image by 0.9672701794860779 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2117 2279 and amp range 2016 4031 and image y 2983 3145 and amp range 2048 4095 Range in image: x 0 163 , y 0 163 (with image size 163 x 163) dzp -0.035697103 -> scaling image by 0.9676563679910417 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2204 2366 and amp range 2016 4031 and image y 2972 3135 and amp range 2048 4095 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.02530836 -> scaling image by 0.9769597156943128 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3980 4009 and amp range 2016 4031 and image y 15 36 and amp range 0 2047 Range in image: x 0 30 , y 0 22 (with image size 30 x 22) dzp 0.016679538 -> scaling image by 1.0154810312115594 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3989 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 21 , y 0 23 (with image size 21 x 23) dzp 0.0047082007 -> scaling image by 1.0043458289369953 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1609 1894 and amp range 0 2047 and image y 2873 3157 and amp range 2022 4060 Range in image: x 0 286 , y 0 285 (with image size 286 x 285) dzp -0.017482605 -> scaling image by 0.9840268712629925 Stage tims : Wall: 37.44 s, CPU: 4.22 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.456192 MB Stage tims finished: 2020-06-06T20:15:18.105735 Resources for stage tims : 2.970 s worker CPU, 75.800 s worker Wall, Wall: 37.444 s, Cores in use: 0.19, Total efficiency (on 4 cores): 4.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-06T20:15:18.331590 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02835.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02707.fits Matched 15 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/reference-custom-233227p33482.fits Stage refs : Wall: 7.37 s, CPU: 6.23 s, VmPeak: 972 MB, VmSize: 960 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.456192 MB Stage refs finished: 2020-06-06T20:15:25.701933 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.371 s, Cores in use: 0.84, Total efficiency (on 4 cores): 21.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-06T20:15:25.703432 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outlier-mask-custom-233227p33482.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-pre-custom-233227p33482.jpg Image ksb_170326_105441_ooi_g_ls9-CCD3 g : masking 43 positive outlier pixels and 0 negative outlier pixels Image ksb_160212_122506_ooi_r_ls9-CCD4 r : masking 52 positive outlier pixels and 0 negative outlier pixels Image ksb_180421_074654_ooi_r_ls9-CCD3 r : masking 114 positive outlier pixels and 0 negative outlier pixels Image k4m_170304_121148_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 4167 negative outlier pixels Image k4m_170301_121613_ooi_zd_ls9-CCD4 z : masking 4072 positive outlier pixels and 0 negative outlier pixels Image k4m_170205_132301_ooi_zd_ls9-CCD3 z : masking 3747 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outlier-mask-custom-233227p33482.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-post-custom-233227p33482.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-masked-pos-custom-233227p33482.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-masked-neg-custom-233227p33482.jpg Stage outliers : Wall: 9.46 s, CPU: 8.61 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.456192 MB Stage outliers finished: 2020-06-06T20:15:35.159888 Resources for stage outliers : 0.988 s worker CPU, 1.071 s worker Wall, Wall: 9.458 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.4 % Stage outliers finished Running stage halos Running stage halos at 2020-06-06T20:15:35.161658 Stage halos : Wall: 11.40 s, CPU: 11.40 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.456192 MB Stage halos finished: 2020-06-06T20:15:46.559021 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 11.398 s, Cores in use: 1.00, Total efficiency (on 4 cores): 25.0 % Stage halos finished Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-06-06T20:15:46.560751 PSF sigmas in coadd pixels: ['2.27', '1.95', '2.19', '2.13'] Using average PSF sigma 2.1344782995353815 Gaussian PSF norm 0.1321610024497708 vs pixelized 0.111941546 average tim pixel scale / coadd scale: 1.7296680538534748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.48', '2.27', '1.98'] Using average PSF sigma 2.245587313463789 Gaussian PSF norm 0.12562183179542044 vs pixelized 0.10527297 average tim pixel scale / coadd scale: 1.7301923060391582 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.31', '1.44', '1.42'] Using average PSF sigma 1.390138074993901 Gaussian PSF norm 0.20292573583031728 vs pixelized 0.16610247 average tim pixel scale / coadd scale: 0.9909481363804683 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.20 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.456192 MB Stage fit_on_coadds finished: 2020-06-06T20:15:46.779919 Resources for stage fit_on_coadds : 0.243 s worker CPU, 0.250 s worker Wall, Wall: 0.220 s, Cores in use: 2.02, Total efficiency (on 4 cores): 50.4 % Stage fit_on_coadds finished Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-06-06T20:15:46.782724 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 15 potential peaks Of 15 potential peaks: 13 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 15 potential peaks Of 15 potential peaks: 14 in veto map, 0 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 27 potential peaks Of 27 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 27 potential peaks Of 27 potential peaks: 25 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 28 new sources Median coadd sky for g : 7.324249e-05 Median coadd sky for r : 7.6759796e-05 Median coadd sky for z : 0.00023564964 Stage srcs : Wall: 7.27 s, CPU: 7.21 s, VmPeak: 972 MB, VmSize: 969 MB, VmRSS: 207 MB, VmData: 235 MB, maxrss: 0.456192 MB Stage srcs finished: 2020-06-06T20:15:54.049300 Resources for stage srcs : 0.146 s worker CPU, 0.161 s worker Wall, Wall: 7.267 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-06T20:15:54.062115 Blob 1 of 17, id: 7, sources: 6, size: 86x142, npix 5637, brick X: 93,179, Y: 74,216, one pixel: 133 74 Blob 2 of 17, id: 1, sources: 5, size: 52x67, npix 2058, brick X: 0,52, Y: 4,71, one pixel: 6 4 Blob 3 of 17, id: 4, sources: 4, size: 54x62, npix 1722, brick X: 187,241, Y: 59,121, one pixel: 224 59 Blob 4 of 17, id: 13, sources: 2, size: 39x60, npix 1484, brick X: 2,41, Y: 219,279, one pixel: 16 219 Blob 5 of 17, id: 8, sources: 2, size: 29x50, npix 856, brick X: 10,39, Y: 144,194, one pixel: 23 144 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.24021, 33.47462), pm (-7.9, 6.3), parallax 2.445 with NanoMaggies: g=15.1, r=14.3, z=14.3 Reset brightness to NanoMaggies: g=14.9, r=14.1, z=13.7 Blob 2 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.142984 MB Blob 6 of 17, id: 9, sources: 1, size: 28x28, npix 498, brick X: 189,217, Y: 149,177, one pixel: 202 149 Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.32 s, CPU: 2.32 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14308 MB Blob 7 of 17, id: 15, sources: 1, size: 28x27, npix 486, brick X: 243,271, Y: 248,275, one pixel: 254 248 Blob 5 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143684 MB Blob 8 of 17, id: 11, sources: 1, size: 23x22, npix 305, brick X: 71,94, Y: 196,218, one pixel: 80 196 Blob 9 of 17, id: 3, sources: 1, size: 21x20, npix 239, brick X: 97,118, Y: 55,75, one pixel: 106 55 Blob 7 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143684 MB Blob 10 of 17, id: 10, sources: 1, size: 19x20, npix 218, brick X: 88,107, Y: 185,205, one pixel: 97 185 Blob 6 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 11 of 17, id: 0, sources: 1, size: 22x14, npix 212, brick X: 205,227, Y: 0,14, one pixel: 207 0 Blob 9 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 12 of 17, id: 2, sources: 1, size: 18x20, npix 207, brick X: 180,198, Y: 38,58, one pixel: 188 38 Blob 8 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143684 MB Blob 13 of 17, id: 12, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 199,218, one pixel: 192 199 Blob 10 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 14 of 17, id: 5, sources: 1, size: 18x18, npix 171, brick X: 250,268, Y: 72,90, one pixel: 258 72 Blob 12 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 15 of 17, id: 6, sources: 1, size: 18x18, npix 171, brick X: 55,73, Y: 74,92, one pixel: 63 74 Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 16 of 17, id: 16, sources: 2, size: 22x12, npix 168, brick X: 70,92, Y: 267,279, one pixel: 79 267 Blob 14 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 17 of 17, id: 14, sources: 1, size: 17x17, npix 145, brick X: 129,146, Y: 231,248, one pixel: 137 231 Blob 15 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 11 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143684 MB Blob 17 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143684 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.23267, 33.49247), pm (-5.6, -6.6), parallax -0.162 with NanoMaggies: g=21, r=20.2, z=20.4 Reset brightness to NanoMaggies: g=20.9, r=20.4, z=20.2 Blob 16 finished, total: Wall: 0.11 s, CPU: 0.11 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143228 MB Blob 3 finished, total: Wall: 4.84 s, CPU: 4.84 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14312 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.08093, ee1=1.60203, ee2=-0.395232 Blob 1 finished, total: Wall: 7.83 s, CPU: 7.83 s, VmPeak: 790 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.1456 MB Old catalog: 34 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/blobs-custom-233227p33482.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/all-models-custom-233227p33482.fits Stage fitblobs : Wall: 14.13 s, CPU: 6.33 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 201 MB, VmData: 229 MB, maxrss: 0.456192 MB Stage fitblobs finished: 2020-06-06T20:16:08.190628 Resources for stage fitblobs : 21.927 s worker CPU, 21.944 s worker Wall, Wall: 14.130 s, Cores in use: 2.00, Total efficiency (on 4 cores): 50.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-06T20:16:08.192579 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-resid.jpg Stage coadds : Wall: 8.55 s, CPU: 7.98 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 202 MB, VmData: 229 MB, maxrss: 0.456192 MB Stage coadds finished: 2020-06-06T20:16:16.741270 Resources for stage coadds : 1.788 s worker CPU, 1.836 s worker Wall, Wall: 8.550 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.6 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-06T20:16:16.742825 Cut to 1 unWISE tiles Reading WISE tile 2339p333 band 2 Reading WISE tile 2339p333 band 1 Reading WISE tile 2339p333 band 4 Reading WISE tile 2339p333 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 805 MB, VmSize: 795 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.188036 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 794 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209268 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208584 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206912 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.87 s, CPU: 5.64 s, VmPeak: 972 MB, VmSize: 963 MB, VmRSS: 203 MB, VmData: 229 MB, maxrss: 0.456192 MB Stage wise_forced finished: 2020-06-06T20:16:24.616103 Resources for stage wise_forced : 3.866 s worker CPU, 7.579 s worker Wall, Wall: 7.874 s, Cores in use: 1.21, Total efficiency (on 4 cores): 30.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-06T20:16:24.617665 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/tractor-i/cus/tractor-custom-233227p33482.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/tractor/cus/tractor-custom-233227p33482.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/tractor/cus/brick-custom-233227p33482.sha256sum Stage writecat : Wall: 9.20 s, CPU: 9.05 s, VmPeak: 1095 MB, VmSize: 967 MB, VmRSS: 204 MB, VmData: 229 MB, maxrss: 0.456192 MB Stage writecat finished: 2020-06-06T20:16:33.815897 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.199 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.6 % Stage writecat finished All done: 31.930 s worker CPU, 108.643 s worker Wall, Wall: 113.157 s, Cores in use: 0.87, Total efficiency (on 4 cores): 21.8 % Finished galaxy PGC2032985 in 1.995 minutes. Started working on galaxy PGC2032985 at Fri Aug 7 09:21:31 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:21:32.205702 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.22753282782745', '33.48208983073203', '--width', '279', '--height', '279', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 233.22753282782745 33.48208983073203 Starting process 22411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 22412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 22413 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 22414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 22415 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 22416 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 22417 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 22418 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 22419 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 22420 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 22421 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 22422 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 22423 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 22424 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 22425 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 22426 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:21:32.651236 Keeping 10 CCDs: k4m_170301_121613_ooi_zd_ls9-CCD4 z expnum 111090 exptime 80.105 propid 2016A-0453 seeing 0.81 MJD 57813.511 object MzLS_570024_z mosaic/CP/V4.3/CP20170228/k4m_170301_121613_ooi_zd_ls9.fits.fz k4m_170304_121148_ooi_zd_ls9-CCD1 z expnum 111691 exptime 80.107 propid 2016A-0453 seeing 0.89 MJD 57816.508 object MzLS_572114_z mosaic/CP/V4.3/CP20170303/k4m_170304_121148_ooi_zd_ls9.fits.fz k4m_170205_132301_ooi_zd_ls9-CCD3 z expnum 3107126 exptime 80.106 propid 2016A-0453 seeing 0.87 MJD 57789.558 object MzLS_571070_z mosaic/CP/V4.3/CP20170204/k4m_170205_132301_ooi_zd_ls9.fits.fz ksb_180421_074654_ooi_r_ls9-CCD3 r expnum 82290111 exptime 106.193 propid BASS seeing 1.53 MJD 58229.324 object 05201 90prime/CP/V2.3/CP20180420/ksb_180421_074654_ooi_r_ls9.fits.fz ksb_170522_085552_ooi_g_ls9-CCD3 g expnum 78950140 exptime 95.828 propid 2015A-0801 seeing 1.40 MJD 57895.372 object 05201 90prime/CP/V2.3/CP20170521/ksb_170522_085552_ooi_g_ls9.fits.fz ksb_160601_083327_ooi_g_ls9-CCD2 g expnum 75400096 exptime 99.3 propid BASS seeing 1.20 MJD 57540.357 object 06573 90prime/CP/V2.3/CP20160531/ksb_160601_083327_ooi_g_ls9.fits.fz ksb_170518_092329_ooi_r_ls9-CCD3 r expnum 78910117 exptime 112.4 propid 2015A-0801 seeing 1.40 MJD 57891.391 object 05202 90prime/CP/V2.3/CP20170517/ksb_170518_092329_ooi_r_ls9.fits.fz ksb_170326_105441_ooi_g_ls9-CCD3 g expnum 78380165 exptime 72.968 propid BASS seeing 1.35 MJD 57838.455 object 05202 90prime/CP/V2.3/CP20170325/ksb_170326_105441_ooi_g_ls9.fits.fz ksb_170522_085341_ooi_g_ls9-CCD4 g expnum 78950139 exptime 94.21 propid 2015A-0801 seeing 1.31 MJD 57895.371 object 06571 90prime/CP/V2.3/CP20170521/ksb_170522_085341_ooi_g_ls9.fits.fz ksb_160212_122506_ooi_r_ls9-CCD4 r expnum 74300303 exptime 67.1 propid 2015A-0801 seeing 1.22 MJD 57430.517 object 06571 90prime/CP/V2.3/CP20160211/ksb_160212_122506_ooi_r_ls9.fits.fz mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3176 3457 and amp range 2006 4053 and image y 2214 2498 and amp range 2040 4078 Range in image: x 0 282 , y 0 285 (with image size 282 x 285) dzp -0.0021409686 -> scaling image by 0.9980300379995196 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 454 741 and amp range 0 2005 and image y 3645 3927 and amp range 2040 4078 Range in image: x 0 288 , y 0 283 (with image size 288 x 283) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2117 2279 and amp range 2016 4031 and image y 2983 3145 and amp range 2048 4095 Range in image: x 0 163 , y 0 163 (with image size 163 x 163) dzp -0.035697103 -> scaling image by 0.9676563679910417 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 188 351 and amp range 0 2015 and image y 1152 1315 and amp range 0 2047 Range in image: x 0 164 , y 0 164 (with image size 164 x 164) dzp -0.039144866 -> scaling image by 0.9645884414840357 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1954 2117 and amp range 0 2015 and image y 2347 2510 and amp range 2048 4095 Range in image: x 0 62 , y 0 164 (with image size 164 x 164) dzp 0.01693853 -> scaling image by 1.015723292931903 Found overlap: image x 1954 2117 and amp range 2016 4031 and image y 2347 2510 and amp range 2048 4095 Range in image: x 62 164 , y 0 164 (with image size 164 x 164) dzp 0.0026774607 -> scaling image by 1.002469075566243 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2205 2367 and amp range 2016 4031 and image y 2972 3135 and amp range 2048 4095 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.02530836 -> scaling image by 0.9769597156943128 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1609 1894 and amp range 0 2047 and image y 2872 3157 and amp range 2022 4060 Range in image: x 0 286 , y 0 286 (with image size 286 x 286) dzp -0.017482605 -> scaling image by 0.9840268712629925 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3980 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 30 , y 0 23 (with image size 30 x 23) dzp 0.016679538 -> scaling image by 1.0154810312115594 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 210 373 and amp range 0 2015 and image y 970 1132 and amp range 0 2047 Range in image: x 0 164 , y 0 163 (with image size 164 x 163) dzp -0.036130503 -> scaling image by 0.9672701794860779 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3989 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 21 , y 0 23 (with image size 21 x 23) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Stage tims : Wall: 68.90 s, CPU: 1.06 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.177304 MB Stage tims finished: 2020-08-07T09:22:41.549981 Resources for stage tims : 4.863 s worker CPU, 410.786 s worker Wall, Wall: 68.900 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:22:41.573662 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02835.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02707.fits Matched 15 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/reference-custom-233227p33482.fits Stage refs : Wall: 11.93 s, CPU: 1.96 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 194 MB, VmData: 226 MB, maxrss: 0.198184 MB Stage refs finished: 2020-08-07T09:22:53.501572 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.930 s, Cores in use: 0.16, Total efficiency (on 16 cores): 1.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:22:53.642888 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outlier-mask-custom-233227p33482.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-pre-custom-233227p33482.jpg Image ksb_170326_105441_ooi_g_ls9-CCD3 g : masking 41 positive outlier pixels and 0 negative outlier pixels Image ksb_160212_122506_ooi_r_ls9-CCD4 r : masking 51 positive outlier pixels and 0 negative outlier pixels Image ksb_180421_074654_ooi_r_ls9-CCD3 r : masking 116 positive outlier pixels and 0 negative outlier pixels Image k4m_170301_121613_ooi_zd_ls9-CCD4 z : masking 4104 positive outlier pixels and 0 negative outlier pixels Image k4m_170304_121148_ooi_zd_ls9-CCD1 z : masking 0 positive outlier pixels and 4123 negative outlier pixels Image k4m_170205_132301_ooi_zd_ls9-CCD3 z : masking 3712 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outlier-mask-custom-233227p33482.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-post-custom-233227p33482.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-masked-pos-custom-233227p33482.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/outliers-masked-neg-custom-233227p33482.jpg Stage outliers : Wall: 8.52 s, CPU: 0.60 s, VmPeak: 982 MB, VmSize: 980 MB, VmRSS: 209 MB, VmData: 239 MB, maxrss: 0.214084 MB Stage outliers finished: 2020-08-07T09:23:02.163294 Resources for stage outliers : 0.805 s worker CPU, 0.890 s worker Wall, Wall: 8.522 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:23:02.959561 Stage halos : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 982 MB, VmSize: 981 MB, VmRSS: 209 MB, VmData: 239 MB, maxrss: 0.214352 MB Stage halos finished: 2020-08-07T09:23:03.288790 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.330 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:23:03.454237 PSF sigmas in coadd pixels: ['2.27', '1.95', '2.19', '2.13'] Using average PSF sigma 2.1344782995353815 Gaussian PSF norm 0.1321610024497708 vs pixelized 0.111941166 average tim pixel scale / coadd scale: 1.7296680538534748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.48', '2.27', '1.98'] Using average PSF sigma 2.245587313463789 Gaussian PSF norm 0.12562183179542044 vs pixelized 0.10527304 average tim pixel scale / coadd scale: 1.7301923060391582 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.31', '1.44', '1.42'] Using average PSF sigma 1.390138074993901 Gaussian PSF norm 0.20292573583031728 vs pixelized 0.1661027 average tim pixel scale / coadd scale: 0.9909481363804683 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-z.fits.fz Stage fit_on_coadds : Wall: 3.31 s, CPU: 0.16 s, VmPeak: 982 MB, VmSize: 981 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.217008 MB Stage fit_on_coadds finished: 2020-08-07T09:23:06.762492 Resources for stage fit_on_coadds : 0.192 s worker CPU, 0.192 s worker Wall, Wall: 3.310 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:23:06.821505 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 13 potential peaks Of 13 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 28 potential peaks Of 28 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 7.7723744e-05 Median coadd sky for r : 8.057286e-05 Median coadd sky for z : 0.00031815487 Stage srcs : Wall: 0.56 s, CPU: 0.52 s, VmPeak: 982 MB, VmSize: 981 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.217516 MB Stage srcs finished: 2020-08-07T09:23:07.379358 Resources for stage srcs : 0.093 s worker CPU, 0.093 s worker Wall, Wall: 0.559 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:23:07.391470 Blob 1 of 16, id: 7, sources: 6, size: 86x143, npix 5652, brick X: 93,179, Y: 74,217, one pixel: 134 74 Blob 2 of 16, id: 1, sources: 4, size: 52x66, npix 2050, brick X: 0,52, Y: 5,71, one pixel: 5 5 Blob 3 of 16, id: 4, sources: 4, size: 54x62, npix 1721, brick X: 187,241, Y: 59,121, one pixel: 225 59 Blob 4 of 16, id: 13, sources: 2, size: 38x60, npix 1483, brick X: 2,40, Y: 219,279, one pixel: 18 219 Blob 5 of 16, id: 8, sources: 2, size: 28x50, npix 836, brick X: 10,38, Y: 144,194, one pixel: 24 144 Blob 6 of 16, id: 9, sources: 1, size: 27x27, npix 504, brick X: 189,216, Y: 150,177, one pixel: 199 150 Blob 7 of 16, id: 14, sources: 1, size: 28x27, npix 495, brick X: 243,271, Y: 248,275, one pixel: 254 248 Blob 8 of 16, id: 11, sources: 1, size: 23x22, npix 319, brick X: 71,94, Y: 196,218, one pixel: 81 196 Blob 9 of 16, id: 0, sources: 1, size: 23x21, npix 306, brick X: 205,228, Y: 0,21, one pixel: 207 0 Blob 10 of 16, id: 3, sources: 1, size: 20x20, npix 238, brick X: 97,117, Y: 56,76, one pixel: 105 56 Blob 11 of 16, id: 10, sources: 1, size: 19x20, npix 218, brick X: 88,107, Y: 186,206, one pixel: 96 186 Blob 12 of 16, id: 2, sources: 1, size: 19x20, npix 209, brick X: 179,198, Y: 38,58, one pixel: 188 38 Blob 13 of 16, id: 12, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 200,219, one pixel: 191 200 Blob 14 of 16, id: 6, sources: 1, size: 18x18, npix 180, brick X: 55,73, Y: 74,92, one pixel: 63 74 Blob 15 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 250,267, Y: 72,90, one pixel: 258 72 Blob 16 of 16, id: 15, sources: 2, size: 19x11, npix 133, brick X: 71,90, Y: 268,279, one pixel: 79 268 Blob 14 finished, total: Wall: 0.10 s, CPU: 0.09 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 90 MB, VmData: 142 MB, maxrss: 0.092208 MB Blob 15 finished, total: Wall: 0.09 s, CPU: 0.07 s, VmPeak: 801 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146932 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.23267, 33.49247), pm (-5.6, -6.6), parallax -0.162 with NanoMaggies: g=20.9, r=20.1, z=20.6 Reset brightness to NanoMaggies: g=20.9, r=20.4, z=20.2 Blob 16 finished, total: Wall: 0.14 s, CPU: 0.10 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14648 MB Blob 11 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1472 MB Blob 13 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094496 MB Blob 10 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092492 MB Blob 8 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146876 MB Blob 7 finished, total: Wall: 0.50 s, CPU: 0.49 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 90 MB, VmData: 137 MB, maxrss: 0.091876 MB Blob 12 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147044 MB Blob 9 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145568 MB Blob 6 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147828 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.24021, 33.47462), pm (-7.9, 6.3), parallax 2.445 with NanoMaggies: g=15.1, r=14.3, z=14.2 Reset brightness to NanoMaggies: g=14.9, r=14.1, z=13.7 Blob 2 finished, total: Wall: 1.18 s, CPU: 1.18 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097484 MB Blob 5 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148664 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147892 MB Measuring 1 iterative sources Exception in one_blob: brick custom-233227p33482, iblob 7 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1637, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 376, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1989, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3771, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3739, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3295, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3284, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1131, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2032985; please check the logfile. Finished galaxy PGC2032985 in 1.655 minutes. Started working on galaxy PGC2032985 at Fri Aug 7 12:06:50 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:06:51.410404 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.22753282782745', '33.48208983073203', '--width', '279', '--height', '279', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 233.22753282782745 33.48208983073203 Starting process 16695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 16696 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16697 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 16699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 16700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 16701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 16702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 16703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 16704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 16706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 16711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 16712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 16713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 16716 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 16717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16718 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 16719 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16721 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 16722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 16723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 16726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 16725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p and forcing stage srcs Runstage fit_on_coadds Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p and forcing stage fit_on_coadds Runstage halos Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p and forcing stage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-08-07T12:06:51.970544 Keeping 10 CCDs: k4m_170301_121613_ooi_zd_ls9-CCD4 z expnum 111090 exptime 80.105 propid 2016A-0453 seeing 0.81 MJD 57813.511 object MzLS_570024_z mosaic/CP/V4.3/CP20170228/k4m_170301_121613_ooi_zd_ls9.fits.fz k4m_170304_121148_ooi_zd_ls9-CCD1 z expnum 111691 exptime 80.107 propid 2016A-0453 seeing 0.89 MJD 57816.508 object MzLS_572114_z mosaic/CP/V4.3/CP20170303/k4m_170304_121148_ooi_zd_ls9.fits.fz k4m_170205_132301_ooi_zd_ls9-CCD3 z expnum 3107126 exptime 80.106 propid 2016A-0453 seeing 0.87 MJD 57789.558 object MzLS_571070_z mosaic/CP/V4.3/CP20170204/k4m_170205_132301_ooi_zd_ls9.fits.fz ksb_180421_074654_ooi_r_ls9-CCD3 r expnum 82290111 exptime 106.193 propid BASS seeing 1.53 MJD 58229.324 object 05201 90prime/CP/V2.3/CP20180420/ksb_180421_074654_ooi_r_ls9.fits.fz ksb_170522_085552_ooi_g_ls9-CCD3 g expnum 78950140 exptime 95.828 propid 2015A-0801 seeing 1.40 MJD 57895.372 object 05201 90prime/CP/V2.3/CP20170521/ksb_170522_085552_ooi_g_ls9.fits.fz ksb_160601_083327_ooi_g_ls9-CCD2 g expnum 75400096 exptime 99.3 propid BASS seeing 1.20 MJD 57540.357 object 06573 90prime/CP/V2.3/CP20160531/ksb_160601_083327_ooi_g_ls9.fits.fz ksb_170518_092329_ooi_r_ls9-CCD3 r expnum 78910117 exptime 112.4 propid 2015A-0801 seeing 1.40 MJD 57891.391 object 05202 90prime/CP/V2.3/CP20170517/ksb_170518_092329_ooi_r_ls9.fits.fz ksb_170326_105441_ooi_g_ls9-CCD3 g expnum 78380165 exptime 72.968 propid BASS seeing 1.35 MJD 57838.455 object 05202 90prime/CP/V2.3/CP20170325/ksb_170326_105441_ooi_g_ls9.fits.fz ksb_170522_085341_ooi_g_ls9-CCD4 g expnum 78950139 exptime 94.21 propid 2015A-0801 seeing 1.31 MJD 57895.371 object 06571 90prime/CP/V2.3/CP20170521/ksb_170522_085341_ooi_g_ls9.fits.fz ksb_160212_122506_ooi_r_ls9-CCD4 r expnum 74300303 exptime 67.1 propid 2015A-0801 seeing 1.22 MJD 57430.517 object 06571 90prime/CP/V2.3/CP20160211/ksb_160212_122506_ooi_r_ls9.fits.fz Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3989 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 21 , y 0 23 (with image size 21 x 23) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2205 2367 and amp range 2016 4031 and image y 2972 3135 and amp range 2048 4095 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.02530836 -> scaling image by 0.9769597156943128 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3980 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 30 , y 0 23 (with image size 30 x 23) dzp 0.016679538 -> scaling image by 1.0154810312115594 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3176 3457 and amp range 2006 4053 and image y 2214 2498 and amp range 2040 4078 Range in image: x 0 282 , y 0 285 (with image size 282 x 285) dzp -0.0021409686 -> scaling image by 0.9980300379995196 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 454 741 and amp range 0 2005 and image y 3645 3927 and amp range 2040 4078 Range in image: x 0 288 , y 0 283 (with image size 288 x 283) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 188 351 and amp range 0 2015 and image y 1152 1315 and amp range 0 2047 Range in image: x 0 164 , y 0 164 (with image size 164 x 164) dzp -0.039144866 -> scaling image by 0.9645884414840357 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2117 2279 and amp range 2016 4031 and image y 2983 3145 and amp range 2048 4095 Range in image: x 0 163 , y 0 163 (with image size 163 x 163) dzp -0.035697103 -> scaling image by 0.9676563679910417 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1954 2117 and amp range 0 2015 and image y 2347 2510 and amp range 2048 4095 Range in image: x 0 62 , y 0 164 (with image size 164 x 164) dzp 0.01693853 -> scaling image by 1.015723292931903 Found overlap: image x 1954 2117 and amp range 2016 4031 and image y 2347 2510 and amp range 2048 4095 Range in image: x 62 164 , y 0 164 (with image size 164 x 164) dzp 0.0026774607 -> scaling image by 1.002469075566243 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 210 373 and amp range 0 2015 and image y 970 1132 and amp range 0 2047 Range in image: x 0 164 , y 0 163 (with image size 164 x 163) dzp -0.036130503 -> scaling image by 0.9672701794860779 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1609 1894 and amp range 0 2047 and image y 2872 3157 and amp range 2022 4060 Range in image: x 0 286 , y 0 286 (with image size 286 x 286) dzp -0.017482605 -> scaling image by 0.9840268712629925 Stage tims : Wall: 2.26 s, CPU: 0.81 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.177892 MB Stage tims finished: 2020-08-07T12:06:54.228715 Resources for stage tims : 5.311 s worker CPU, 10.995 s worker Wall, Wall: 2.261 s, Cores in use: 2.71, Total efficiency (on 32 cores): 8.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:06:54.260990 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02835.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02707.fits Matched 15 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/reference-custom-233227p33482.fits Stage refs : Wall: 3.90 s, CPU: 1.89 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.1989 MB Stage refs finished: 2020-08-07T12:06:58.164588 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 3.906 s, Cores in use: 0.49, Total efficiency (on 32 cores): 1.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:06:58.211923 Stage outliers : Wall: 0.29 s, CPU: 0.26 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 195 MB, VmData: 227 MB, maxrss: 0.199852 MB Stage outliers finished: 2020-08-07T12:06:58.505979 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.297 s, Cores in use: 0.90, Total efficiency (on 32 cores): 2.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:06:58.530285 Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.20292 MB Stage halos finished: 2020-08-07T12:06:58.744882 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.217 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:06:58.768744 PSF sigmas in coadd pixels: ['2.27', '1.95', '2.19', '2.13'] Using average PSF sigma 2.1344782995353815 Gaussian PSF norm 0.1321610024497708 vs pixelized 0.111941166 average tim pixel scale / coadd scale: 1.7296680538534748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.48', '2.27', '1.98'] Using average PSF sigma 2.245587313463789 Gaussian PSF norm 0.12562183179542044 vs pixelized 0.10527304 average tim pixel scale / coadd scale: 1.7301923060391582 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.31', '1.44', '1.42'] Using average PSF sigma 1.390138074993901 Gaussian PSF norm 0.20292573583031728 vs pixelized 0.1661027 average tim pixel scale / coadd scale: 0.9909481363804683 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.17 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.213796 MB Stage fit_on_coadds finished: 2020-08-07T12:06:58.956835 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.194 s worker CPU, 0.252 s worker Wall, Wall: 0.190 s, Cores in use: 1.92, Total efficiency (on 32 cores): 6.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:06:58.968875 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 13 potential peaks Of 13 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 28 potential peaks Of 28 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 7.7723686e-05 Median coadd sky for r : 8.057286e-05 Median coadd sky for z : 0.00031815487 Stage srcs : Wall: 0.49 s, CPU: 0.43 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.21452 MB Stage srcs finished: 2020-08-07T12:06:59.457216 Resources for stage srcs : 0.134 s worker CPU, 0.152 s worker Wall, Wall: 0.490 s, Cores in use: 1.15, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Running stage fitblobs Warning: Stellar halo subtraction is only implemented for DECam Running stage fitblobs at 2020-08-07T12:06:59.469985 Blob 1 of 16, id: 7, sources: 6, size: 86x143, npix 5652, brick X: 93,179, Y: 74,217, one pixel: 134 74 Blob 2 of 16, id: 1, sources: 4, size: 52x66, npix 2050, brick X: 0,52, Y: 5,71, one pixel: 5 5 Blob 3 of 16, id: 4, sources: 4, size: 54x62, npix 1721, brick X: 187,241, Y: 59,121, one pixel: 225 59 Blob 4 of 16, id: 13, sources: 2, size: 38x60, npix 1483, brick X: 2,40, Y: 219,279, one pixel: 18 219 Blob 5 of 16, id: 8, sources: 2, size: 28x50, npix 836, brick X: 10,38, Y: 144,194, one pixel: 24 144 Blob 6 of 16, id: 9, sources: 1, size: 27x27, npix 504, brick X: 189,216, Y: 150,177, one pixel: 199 150 Blob 7 of 16, id: 14, sources: 1, size: 28x27, npix 495, brick X: 243,271, Y: 248,275, one pixel: 254 248 Blob 8 of 16, id: 11, sources: 1, size: 23x22, npix 319, brick X: 71,94, Y: 196,218, one pixel: 81 196 Blob 9 of 16, id: 0, sources: 1, size: 23x21, npix 306, brick X: 205,228, Y: 0,21, one pixel: 207 0 Blob 10 of 16, id: 3, sources: 1, size: 20x20, npix 238, brick X: 97,117, Y: 56,76, one pixel: 105 56 Blob 11 of 16, id: 10, sources: 1, size: 19x20, npix 218, brick X: 88,107, Y: 186,206, one pixel: 96 186 Blob 12 of 16, id: 2, sources: 1, size: 19x20, npix 209, brick X: 179,198, Y: 38,58, one pixel: 188 38 Blob 13 of 16, id: 12, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 200,219, one pixel: 191 200 Blob 14 of 16, id: 6, sources: 1, size: 18x18, npix 180, brick X: 55,73, Y: 74,92, one pixel: 63 74 Blob 15 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 250,267, Y: 72,90, one pixel: 258 72 Blob 16 of 16, id: 15, sources: 2, size: 19x11, npix 133, brick X: 71,90, Y: 268,279, one pixel: 79 268 Blob 15 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144408 MB Blob 14 finished, total: Wall: 0.14 s, CPU: 0.07 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.084472 MB Blob 13 finished, total: Wall: 0.15 s, CPU: 0.14 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145108 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.23267, 33.49247), pm (-5.6, -6.6), parallax -0.162 with NanoMaggies: g=21.8, r=21.1, z=20.9 Reset brightness to NanoMaggies: g=20.9, r=20.4, z=20.2 Blob 11 finished, total: Wall: 0.19 s, CPU: 0.17 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.08966 MB Blob 10 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145208 MB Blob 16 finished, total: Wall: 0.20 s, CPU: 0.13 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 83 MB, VmData: 137 MB, maxrss: 0.084876 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.24021, 33.47462), pm (-7.9, 6.3), parallax 2.445 with NanoMaggies: g=15.5, r=14.7, z=14.4 Reset brightness to NanoMaggies: g=14.9, r=14.1, z=13.7 Blob 7 finished, total: Wall: 0.40 s, CPU: 0.39 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146376 MB Blob 8 finished, total: Wall: 0.42 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089756 MB Blob 12 finished, total: Wall: 0.47 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089724 MB Blob 9 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 801 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146464 MB Blob 2 finished, total: Wall: 0.84 s, CPU: 0.81 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.093352 MB Blob 6 finished, total: Wall: 0.84 s, CPU: 0.81 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090004 MB Blob 5 finished, total: Wall: 1.08 s, CPU: 1.07 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092536 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.72 s, CPU: 1.69 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.092028 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.74 s, CPU: 2.71 s, VmPeak: 669 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.094628 MB Exception in one_blob: brick custom-233227p33482, iblob 7 multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2032985; please check the logfile. Finished galaxy PGC2032985 in 0.201 minutes. Started working on galaxy PGC2032985 at Fri Aug 7 12:33:00 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T12:33:01.658457 legacypipe git version: DR9.5.11-watershed-4-gcc619972 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.22753282782745', '33.48208983073203', '--width', '279', '--height', '279', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 233.22753282782745 33.48208983073203 Starting process 19722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 19723 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 19726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 19727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19728 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 19729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19730 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 19731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19732 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 19733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 19738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 19739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 19740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 19744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 19745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 19746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 19749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 19751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 19752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 19750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 19753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T12:33:02.114799 Keeping 10 CCDs: k4m_170301_121613_ooi_zd_ls9-CCD4 z expnum 111090 exptime 80.105 propid 2016A-0453 seeing 0.81 MJD 57813.511 object MzLS_570024_z mosaic/CP/V4.3/CP20170228/k4m_170301_121613_ooi_zd_ls9.fits.fz k4m_170304_121148_ooi_zd_ls9-CCD1 z expnum 111691 exptime 80.107 propid 2016A-0453 seeing 0.89 MJD 57816.508 object MzLS_572114_z mosaic/CP/V4.3/CP20170303/k4m_170304_121148_ooi_zd_ls9.fits.fz k4m_170205_132301_ooi_zd_ls9-CCD3 z expnum 3107126 exptime 80.106 propid 2016A-0453 seeing 0.87 MJD 57789.558 object MzLS_571070_z mosaic/CP/V4.3/CP20170204/k4m_170205_132301_ooi_zd_ls9.fits.fz ksb_180421_074654_ooi_r_ls9-CCD3 r expnum 82290111 exptime 106.193 propid BASS seeing 1.53 MJD 58229.324 object 05201 90prime/CP/V2.3/CP20180420/ksb_180421_074654_ooi_r_ls9.fits.fz ksb_170522_085552_ooi_g_ls9-CCD3 g expnum 78950140 exptime 95.828 propid 2015A-0801 seeing 1.40 MJD 57895.372 object 05201 90prime/CP/V2.3/CP20170521/ksb_170522_085552_ooi_g_ls9.fits.fz ksb_160601_083327_ooi_g_ls9-CCD2 g expnum 75400096 exptime 99.3 propid BASS seeing 1.20 MJD 57540.357 object 06573 90prime/CP/V2.3/CP20160531/ksb_160601_083327_ooi_g_ls9.fits.fz ksb_170518_092329_ooi_r_ls9-CCD3 r expnum 78910117 exptime 112.4 propid 2015A-0801 seeing 1.40 MJD 57891.391 object 05202 90prime/CP/V2.3/CP20170517/ksb_170518_092329_ooi_r_ls9.fits.fz ksb_170326_105441_ooi_g_ls9-CCD3 g expnum 78380165 exptime 72.968 propid BASS seeing 1.35 MJD 57838.455 object 05202 90prime/CP/V2.3/CP20170325/ksb_170326_105441_ooi_g_ls9.fits.fz ksb_170522_085341_ooi_g_ls9-CCD4 g expnum 78950139 exptime 94.21 propid 2015A-0801 seeing 1.31 MJD 57895.371 object 06571 90prime/CP/V2.3/CP20170521/ksb_170522_085341_ooi_g_ls9.fits.fz ksb_160212_122506_ooi_r_ls9-CCD4 r expnum 74300303 exptime 67.1 propid 2015A-0801 seeing 1.22 MJD 57430.517 object 06571 90prime/CP/V2.3/CP20160211/ksb_160212_122506_ooi_r_ls9.fits.fz Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3989 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 21 , y 0 23 (with image size 21 x 23) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3980 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 30 , y 0 23 (with image size 30 x 23) dzp 0.016679538 -> scaling image by 1.0154810312115594 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2117 2279 and amp range 2016 4031 and image y 2983 3145 and amp range 2048 4095 Range in image: x 0 163 , y 0 163 (with image size 163 x 163) dzp -0.035697103 -> scaling image by 0.9676563679910417 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1609 1894 and amp range 0 2047 and image y 2872 3157 and amp range 2022 4060 Range in image: x 0 286 , y 0 286 (with image size 286 x 286) dzp -0.017482605 -> scaling image by 0.9840268712629925 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1954 2117 and amp range 0 2015 and image y 2347 2510 and amp range 2048 4095 Range in image: x 0 62 , y 0 164 (with image size 164 x 164) dzp 0.01693853 -> scaling image by 1.015723292931903 Found overlap: image x 1954 2117 and amp range 2016 4031 and image y 2347 2510 and amp range 2048 4095 Range in image: x 62 164 , y 0 164 (with image size 164 x 164) dzp 0.0026774607 -> scaling image by 1.002469075566243 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 454 741 and amp range 0 2005 and image y 3645 3927 and amp range 2040 4078 Range in image: x 0 288 , y 0 283 (with image size 288 x 283) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 210 373 and amp range 0 2015 and image y 970 1132 and amp range 0 2047 Range in image: x 0 164 , y 0 163 (with image size 164 x 163) dzp -0.036130503 -> scaling image by 0.9672701794860779 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2205 2367 and amp range 2016 4031 and image y 2972 3135 and amp range 2048 4095 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.02530836 -> scaling image by 0.9769597156943128 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3176 3457 and amp range 2006 4053 and image y 2214 2498 and amp range 2040 4078 Range in image: x 0 282 , y 0 285 (with image size 282 x 285) dzp -0.0021409686 -> scaling image by 0.9980300379995196 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 188 351 and amp range 0 2015 and image y 1152 1315 and amp range 0 2047 Range in image: x 0 164 , y 0 164 (with image size 164 x 164) dzp -0.039144866 -> scaling image by 0.9645884414840357 Stage tims : Wall: 2.42 s, CPU: 0.88 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.177528 MB Stage tims finished: 2020-08-07T12:33:04.537957 Resources for stage tims : 5.066 s worker CPU, 11.973 s worker Wall, Wall: 2.426 s, Cores in use: 2.45, Total efficiency (on 32 cores): 7.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T12:33:04.575076 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02835.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02707.fits Matched 15 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/reference-custom-233227p33482.fits Stage refs : Wall: 2.33 s, CPU: 1.90 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.198552 MB Stage refs finished: 2020-08-07T12:33:06.900181 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.327 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T12:33:06.922821 Stage outliers : Wall: 0.30 s, CPU: 0.27 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 195 MB, VmData: 227 MB, maxrss: 0.199492 MB Stage outliers finished: 2020-08-07T12:33:07.227611 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.307 s, Cores in use: 0.90, Total efficiency (on 32 cores): 2.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T12:33:07.252647 Stage halos : Wall: 0.21 s, CPU: 0.20 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202568 MB Stage halos finished: 2020-08-07T12:33:07.463309 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.213 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T12:33:07.499180 PSF sigmas in coadd pixels: ['2.27', '1.95', '2.19', '2.13'] Using average PSF sigma 2.1344782995353815 Gaussian PSF norm 0.1321610024497708 vs pixelized 0.111941166 average tim pixel scale / coadd scale: 1.7296680538534748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.48', '2.27', '1.98'] Using average PSF sigma 2.245587313463789 Gaussian PSF norm 0.12562183179542044 vs pixelized 0.10527304 average tim pixel scale / coadd scale: 1.7301923060391582 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.31', '1.44', '1.42'] Using average PSF sigma 1.390138074993901 Gaussian PSF norm 0.20292573583031728 vs pixelized 0.1661027 average tim pixel scale / coadd scale: 0.9909481363804683 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 210 MB, VmData: 239 MB, maxrss: 0.214896 MB Stage fit_on_coadds finished: 2020-08-07T12:33:07.692728 Resources for stage fit_on_coadds : 0.225 s worker CPU, 0.312 s worker Wall, Wall: 0.196 s, Cores in use: 1.97, Total efficiency (on 32 cores): 6.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T12:33:07.705093 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 13 potential peaks Of 13 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 28 potential peaks Of 28 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 7.7723744e-05 Median coadd sky for r : 8.057286e-05 Median coadd sky for z : 0.00031815466 Stage srcs : Wall: 0.45 s, CPU: 0.39 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.215584 MB Stage srcs finished: 2020-08-07T12:33:08.155034 Resources for stage srcs : 0.124 s worker CPU, 0.134 s worker Wall, Wall: 0.452 s, Cores in use: 1.14, Total efficiency (on 32 cores): 3.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T12:33:08.168673 Blob 1 of 16, id: 7, sources: 6, size: 86x143, npix 5652, brick X: 93,179, Y: 74,217, one pixel: 134 74 Blob 2 of 16, id: 1, sources: 4, size: 52x66, npix 2050, brick X: 0,52, Y: 5,71, one pixel: 5 5 Blob 3 of 16, id: 4, sources: 4, size: 54x62, npix 1721, brick X: 187,241, Y: 59,121, one pixel: 225 59 Blob 4 of 16, id: 13, sources: 2, size: 38x60, npix 1483, brick X: 2,40, Y: 219,279, one pixel: 18 219 Blob 5 of 16, id: 8, sources: 2, size: 28x50, npix 836, brick X: 10,38, Y: 144,194, one pixel: 24 144 Blob 6 of 16, id: 9, sources: 1, size: 27x27, npix 504, brick X: 189,216, Y: 150,177, one pixel: 199 150 Blob 7 of 16, id: 14, sources: 1, size: 28x27, npix 495, brick X: 243,271, Y: 248,275, one pixel: 254 248 Blob 8 of 16, id: 11, sources: 1, size: 23x22, npix 319, brick X: 71,94, Y: 196,218, one pixel: 81 196 Blob 9 of 16, id: 0, sources: 1, size: 23x21, npix 306, brick X: 205,228, Y: 0,21, one pixel: 207 0 Blob 10 of 16, id: 3, sources: 1, size: 20x20, npix 238, brick X: 97,117, Y: 56,76, one pixel: 105 56 Blob 11 of 16, id: 10, sources: 1, size: 19x20, npix 218, brick X: 88,107, Y: 186,206, one pixel: 96 186 Blob 12 of 16, id: 2, sources: 1, size: 19x20, npix 209, brick X: 179,198, Y: 38,58, one pixel: 188 38 Blob 13 of 16, id: 12, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 200,219, one pixel: 191 200 Blob 14 of 16, id: 6, sources: 1, size: 18x18, npix 180, brick X: 55,73, Y: 74,92, one pixel: 63 74 Blob 15 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 250,267, Y: 72,90, one pixel: 258 72 Blob 16 of 16, id: 15, sources: 2, size: 19x11, npix 133, brick X: 71,90, Y: 268,279, one pixel: 79 268 Blob 15 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 803 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1464 MB Blob 14 finished, total: Wall: 0.09 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.08408 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.23267, 33.49247), pm (-5.6, -6.6), parallax -0.162 with NanoMaggies: g=21.8, r=21.1, z=20.9 Reset brightness to NanoMaggies: g=20.9, r=20.4, z=20.2 Blob 16 finished, total: Wall: 0.12 s, CPU: 0.12 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144396 MB Blob 13 finished, total: Wall: 0.15 s, CPU: 0.15 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14564 MB Blob 11 finished, total: Wall: 0.20 s, CPU: 0.17 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089968 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.24021, 33.47462), pm (-7.9, 6.3), parallax 2.445 with NanoMaggies: g=15.5, r=14.7, z=14.4 Reset brightness to NanoMaggies: g=14.9, r=14.1, z=13.7 Blob 10 finished, total: Wall: 0.23 s, CPU: 0.21 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089736 MB Blob 8 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145132 MB Blob 12 finished, total: Wall: 0.42 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089736 MB Blob 7 finished, total: Wall: 0.44 s, CPU: 0.43 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145132 MB Blob 9 finished, total: Wall: 0.54 s, CPU: 0.52 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089736 MB Blob 6 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 803 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.145956 MB Blob 2 finished, total: Wall: 0.83 s, CPU: 0.79 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.0934 MB Blob 5 finished, total: Wall: 1.10 s, CPU: 1.08 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092524 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.72 s, CPU: 1.68 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093432 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.66 s, CPU: 2.63 s, VmPeak: 669 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.094764 MB Exception in one_blob: brick custom-233227p33482, iblob 7 Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' multiprocessing.pool.RemoteTraceback: """ Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 121, in worker result = (True, func(*args, **kwds)) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 269, in __call__ R = self.func(*args, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1641, in _bounce_one_blob result = one_blob(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 124, in one_blob B = ob.run(B, reoptimize=reoptimize, iterative_detection=iterative) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 380, in run Ibright = _argsort_by_brightness(cat, self.bands, ref_first=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/oneblob.py", line 1994, in _argsort_by_brightness br = src.getBrightness() AttributeError: 'NoneType' object has no attribute 'getBrightness' """ The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3775, in sys.exit(main()) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3743, in main run_brick(opt.brick, survey, **kwargs) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3299, in run_brick initial_args=initargs, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 113, in runstage write=write, initial_args=initial_args, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 124, in runstage R = stagefunc(stage, **Px) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 3288, in mystagefunc R = stagefunc(stage, mp=mp, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 40, in __call__ rtn = super(CallGlobalTime, self).__call__(stage, **kwargs) File "/usr/local/lib/python/astrometry/util/stages.py", line 32, in __call__ return func(*self.args, **kwa) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py", line 1135, in stage_fitblobs r = Riter.next(timeout) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 748, in next raise value AttributeError: 'NoneType' object has no attribute 'getBrightness' Something went wrong; please check the logfile. ERROR: galaxy PGC2032985; please check the logfile. Finished galaxy PGC2032985 in 0.176 minutes. Started working on galaxy PGC2032985 at Fri Aug 7 13:33:30 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T13:33:31.189037 legacypipe git version: DR9.5.11-watershed-5-g77ea3463 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '233.22753282782745', '33.48208983073203', '--width', '279', '--height', '279', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 233.22753282782745 33.48208983073203 --width 279 --height 279 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 233.22753282782745 33.48208983073203 Starting process 23455 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 23456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 23459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059476 MB Starting process 23460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 23461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059424 MB Starting process 23462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 23464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 23465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 23466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 23467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 23471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 23472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 23473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 23474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 23475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 23476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 23477 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 23478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 23479 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 23481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 23482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 23483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 23484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 23485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 23486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 23487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T13:33:31.866675 Keeping 10 CCDs: k4m_170301_121613_ooi_zd_ls9-CCD4 z expnum 111090 exptime 80.105 propid 2016A-0453 seeing 0.81 MJD 57813.511 object MzLS_570024_z mosaic/CP/V4.3/CP20170228/k4m_170301_121613_ooi_zd_ls9.fits.fz k4m_170304_121148_ooi_zd_ls9-CCD1 z expnum 111691 exptime 80.107 propid 2016A-0453 seeing 0.89 MJD 57816.508 object MzLS_572114_z mosaic/CP/V4.3/CP20170303/k4m_170304_121148_ooi_zd_ls9.fits.fz k4m_170205_132301_ooi_zd_ls9-CCD3 z expnum 3107126 exptime 80.106 propid 2016A-0453 seeing 0.87 MJD 57789.558 object MzLS_571070_z mosaic/CP/V4.3/CP20170204/k4m_170205_132301_ooi_zd_ls9.fits.fz ksb_180421_074654_ooi_r_ls9-CCD3 r expnum 82290111 exptime 106.193 propid BASS seeing 1.53 MJD 58229.324 object 05201 90prime/CP/V2.3/CP20180420/ksb_180421_074654_ooi_r_ls9.fits.fz ksb_170522_085552_ooi_g_ls9-CCD3 g expnum 78950140 exptime 95.828 propid 2015A-0801 seeing 1.40 MJD 57895.372 object 05201 90prime/CP/V2.3/CP20170521/ksb_170522_085552_ooi_g_ls9.fits.fz ksb_160601_083327_ooi_g_ls9-CCD2 g expnum 75400096 exptime 99.3 propid BASS seeing 1.20 MJD 57540.357 object 06573 90prime/CP/V2.3/CP20160531/ksb_160601_083327_ooi_g_ls9.fits.fz ksb_170518_092329_ooi_r_ls9-CCD3 r expnum 78910117 exptime 112.4 propid 2015A-0801 seeing 1.40 MJD 57891.391 object 05202 90prime/CP/V2.3/CP20170517/ksb_170518_092329_ooi_r_ls9.fits.fz ksb_170326_105441_ooi_g_ls9-CCD3 g expnum 78380165 exptime 72.968 propid BASS seeing 1.35 MJD 57838.455 object 05202 90prime/CP/V2.3/CP20170325/ksb_170326_105441_ooi_g_ls9.fits.fz ksb_170522_085341_ooi_g_ls9-CCD4 g expnum 78950139 exptime 94.21 propid 2015A-0801 seeing 1.31 MJD 57895.371 object 06571 90prime/CP/V2.3/CP20170521/ksb_170522_085341_ooi_g_ls9.fits.fz ksb_160212_122506_ooi_r_ls9-CCD4 r expnum 74300303 exptime 67.1 propid 2015A-0801 seeing 1.22 MJD 57430.517 object 06571 90prime/CP/V2.3/CP20160211/ksb_160212_122506_ooi_r_ls9.fits.fz Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 Faked up EXPNUM 78950139 90prime get_fwhm: self.fwhm = 2.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3980 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 30 , y 0 23 (with image size 30 x 23) dzp 0.016679538 -> scaling image by 1.0154810312115594 mosaic get_fwhm: self.fwhm = 3.11 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1609 1894 and amp range 0 2047 and image y 2872 3157 and amp range 2022 4060 Range in image: x 0 286 , y 0 286 (with image size 286 x 286) dzp -0.017482605 -> scaling image by 0.9840268712629925 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 Faked up EXPNUM 75400096 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1954 2117 and amp range 0 2015 and image y 2347 2510 and amp range 2048 4095 Range in image: x 0 62 , y 0 164 (with image size 164 x 164) dzp 0.01693853 -> scaling image by 1.015723292931903 Found overlap: image x 1954 2117 and amp range 2016 4031 and image y 2347 2510 and amp range 2048 4095 Range in image: x 62 164 , y 0 164 (with image size 164 x 164) dzp 0.0026774607 -> scaling image by 1.002469075566243 mosaic get_fwhm: self.fwhm = 3.41 Found 4 relevant rows in amp-corrections file. Found overlap: image x 454 741 and amp range 0 2005 and image y 3645 3927 and amp range 2040 4078 Range in image: x 0 288 , y 0 283 (with image size 288 x 283) dzp 0.032569118 -> scaling image by 1.0304517167935139 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 Faked up EXPNUM 82290111 90prime get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 188 351 and amp range 0 2015 and image y 1152 1315 and amp range 0 2047 Range in image: x 0 164 , y 0 164 (with image size 164 x 164) dzp -0.039144866 -> scaling image by 0.9645884414840357 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 Faked up EXPNUM 78910117 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2117 2279 and amp range 2016 4031 and image y 2983 3145 and amp range 2048 4095 Range in image: x 0 163 , y 0 163 (with image size 163 x 163) dzp -0.035697103 -> scaling image by 0.9676563679910417 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 Faked up EXPNUM 78380165 90prime get_fwhm: self.fwhm = 2.97 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2205 2367 and amp range 2016 4031 and image y 2972 3135 and amp range 2048 4095 Range in image: x 0 163 , y 0 164 (with image size 163 x 164) dzp -0.02530836 -> scaling image by 0.9769597156943128 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 Faked up EXPNUM 78950140 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 210 373 and amp range 0 2015 and image y 970 1132 and amp range 0 2047 Range in image: x 0 164 , y 0 163 (with image size 164 x 163) dzp -0.036130503 -> scaling image by 0.9672701794860779 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3176 3457 and amp range 2006 4053 and image y 2214 2498 and amp range 2040 4078 Range in image: x 0 282 , y 0 285 (with image size 282 x 285) dzp -0.0021409686 -> scaling image by 0.9980300379995196 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 Faked up EXPNUM 74300303 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3989 4009 and amp range 2016 4031 and image y 15 37 and amp range 0 2047 Range in image: x 0 21 , y 0 23 (with image size 21 x 23) dzp 0.0047082007 -> scaling image by 1.0043458289369953 Stage tims : Wall: 3.61 s, CPU: 0.80 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 207 MB, maxrss: 0.177708 MB Stage tims finished: 2020-08-07T13:33:35.481525 Resources for stage tims : 4.972 s worker CPU, 13.287 s worker Wall, Wall: 3.617 s, Cores in use: 1.60, Total efficiency (on 32 cores): 5.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T13:33:35.514572 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02834.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02835.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02707.fits Matched 15 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/reference-custom-233227p33482.fits Stage refs : Wall: 2.20 s, CPU: 1.88 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 194 MB, VmData: 227 MB, maxrss: 0.198732 MB Stage refs finished: 2020-08-07T13:33:37.714009 Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 2.201 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T13:33:37.735837 Stage outliers : Wall: 0.34 s, CPU: 0.31 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 195 MB, VmData: 227 MB, maxrss: 0.199676 MB Stage outliers finished: 2020-08-07T13:33:38.079470 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.346 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T13:33:38.103340 Stage halos : Wall: 0.30 s, CPU: 0.28 s, VmPeak: 982 MB, VmSize: 971 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202824 MB Stage halos finished: 2020-08-07T13:33:38.399021 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.298 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T13:33:38.430685 PSF sigmas in coadd pixels: ['2.27', '1.95', '2.19', '2.13'] Using average PSF sigma 2.1344782995353815 Gaussian PSF norm 0.1321610024497708 vs pixelized 0.111941166 average tim pixel scale / coadd scale: 1.7296680538534748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.48', '2.27', '1.98'] Using average PSF sigma 2.245587313463789 Gaussian PSF norm 0.12562183179542044 vs pixelized 0.10527304 average tim pixel scale / coadd scale: 1.7301923060391582 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.31', '1.44', '1.42'] Using average PSF sigma 1.390138074993901 Gaussian PSF norm 0.20292573583031728 vs pixelized 0.1661027 average tim pixel scale / coadd scale: 0.9909481363804683 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.15 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 210 MB, VmData: 239 MB, maxrss: 0.214936 MB Stage fit_on_coadds finished: 2020-08-07T13:33:38.628834 Resources for stage fit_on_coadds : 0.222 s worker CPU, 0.349 s worker Wall, Wall: 0.200 s, Cores in use: 1.89, Total efficiency (on 32 cores): 5.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fit_on_coadds.p Running stage srcs Warning: Stellar halo subtraction is only implemented for DECam Running stage srcs at 2020-08-07T13:33:38.641591 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 13 potential peaks Of 13 potential peaks: 12 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 28 potential peaks Of 28 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 7.7723686e-05 Median coadd sky for r : 8.057286e-05 Median coadd sky for z : 0.00031815466 Stage srcs : Wall: 0.69 s, CPU: 0.56 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.21558 MB Stage srcs finished: 2020-08-07T13:33:39.330901 Resources for stage srcs : 0.116 s worker CPU, 0.130 s worker Wall, Wall: 0.691 s, Cores in use: 0.98, Total efficiency (on 32 cores): 3.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T13:33:39.353504 Blob 1 of 16, id: 7, sources: 6, size: 86x143, npix 5652, brick X: 93,179, Y: 74,217, one pixel: 134 74 Blob 2 of 16, id: 1, sources: 4, size: 52x66, npix 2050, brick X: 0,52, Y: 5,71, one pixel: 5 5 Blob 3 of 16, id: 4, sources: 4, size: 54x62, npix 1721, brick X: 187,241, Y: 59,121, one pixel: 225 59 Blob 4 of 16, id: 13, sources: 2, size: 38x60, npix 1483, brick X: 2,40, Y: 219,279, one pixel: 18 219 Blob 5 of 16, id: 8, sources: 2, size: 28x50, npix 836, brick X: 10,38, Y: 144,194, one pixel: 24 144 Blob 6 of 16, id: 9, sources: 1, size: 27x27, npix 504, brick X: 189,216, Y: 150,177, one pixel: 199 150 Blob 7 of 16, id: 14, sources: 1, size: 28x27, npix 495, brick X: 243,271, Y: 248,275, one pixel: 254 248 Blob 8 of 16, id: 11, sources: 1, size: 23x22, npix 319, brick X: 71,94, Y: 196,218, one pixel: 81 196 Blob 9 of 16, id: 0, sources: 1, size: 23x21, npix 306, brick X: 205,228, Y: 0,21, one pixel: 207 0 Blob 10 of 16, id: 3, sources: 1, size: 20x20, npix 238, brick X: 97,117, Y: 56,76, one pixel: 105 56 Blob 11 of 16, id: 10, sources: 1, size: 19x20, npix 218, brick X: 88,107, Y: 186,206, one pixel: 96 186 Blob 12 of 16, id: 2, sources: 1, size: 19x20, npix 209, brick X: 179,198, Y: 38,58, one pixel: 188 38 Blob 13 of 16, id: 12, sources: 1, size: 19x19, npix 199, brick X: 183,202, Y: 200,219, one pixel: 191 200 Blob 14 of 16, id: 6, sources: 1, size: 18x18, npix 180, brick X: 55,73, Y: 74,92, one pixel: 63 74 Blob 15 of 16, id: 5, sources: 1, size: 17x18, npix 162, brick X: 250,267, Y: 72,90, one pixel: 258 72 Blob 16 of 16, id: 15, sources: 2, size: 19x11, npix 133, brick X: 71,90, Y: 268,279, one pixel: 79 268 Blob 15 finished, total: Wall: 0.10 s, CPU: 0.06 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 86 MB, VmData: 138 MB, maxrss: 0.087668 MB Blob 14 finished, total: Wall: 0.14 s, CPU: 0.07 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 82 MB, VmData: 137 MB, maxrss: 0.08384 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.23267, 33.49247), pm (-5.6, -6.6), parallax -0.162 with NanoMaggies: g=21.8, r=21.1, z=20.9 Reset brightness to NanoMaggies: g=20.9, r=20.4, z=20.2 Blob 16 finished, total: Wall: 0.19 s, CPU: 0.13 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 88 MB, VmData: 141 MB, maxrss: 0.090328 MB Blob 11 finished, total: Wall: 0.25 s, CPU: 0.20 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145132 MB Blob 13 finished, total: Wall: 0.26 s, CPU: 0.17 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 87 MB, VmData: 137 MB, maxrss: 0.08936 MB Blob 10 finished, total: Wall: 0.32 s, CPU: 0.22 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.0896 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (233.24021, 33.47462), pm (-7.9, 6.3), parallax 2.445 with NanoMaggies: g=15.5, r=14.7, z=14.4 Reset brightness to NanoMaggies: g=14.9, r=14.1, z=13.7 Blob 7 finished, total: Wall: 0.44 s, CPU: 0.40 s, VmPeak: 803 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146292 MB Blob 8 finished, total: Wall: 0.47 s, CPU: 0.41 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089752 MB Blob 12 finished, total: Wall: 0.48 s, CPU: 0.39 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.089724 MB Blob 9 finished, total: Wall: 0.49 s, CPU: 0.47 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145108 MB Blob 6 finished, total: Wall: 0.84 s, CPU: 0.82 s, VmPeak: 806 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145112 MB Blob 2 finished, total: Wall: 0.96 s, CPU: 0.80 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.093372 MB Blob 5 finished, total: Wall: 1.17 s, CPU: 1.11 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092492 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.76 s, CPU: 1.66 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 90 MB, VmData: 139 MB, maxrss: 0.0918 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.80 s, CPU: 2.70 s, VmPeak: 669 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.094732 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.89025, ee1=1.45809, ee2=-0.372132 Blob 1 finished, total: Wall: 6.43 s, CPU: 6.31 s, VmPeak: 684 MB, VmSize: 677 MB, VmRSS: 101 MB, VmData: 145 MB, maxrss: 0.111352 MB Old catalog: 32 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/blobs-custom-233227p33482.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/metrics/cus/all-models-custom-233227p33482.fits Stage fitblobs : Wall: 6.77 s, CPU: 0.32 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.21594 MB Stage fitblobs finished: 2020-08-07T13:33:46.125081 Resources for stage fitblobs : 16.142 s worker CPU, 17.401 s worker Wall, Wall: 6.774 s, Cores in use: 2.43, Total efficiency (on 32 cores): 7.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T13:33:46.138373 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-resid.jpg Stage coadds : Wall: 1.94 s, CPU: 0.60 s, VmPeak: 982 MB, VmSize: 980 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.217676 MB Stage coadds finished: 2020-08-07T13:33:48.080898 Resources for stage coadds : 25.617 s worker CPU, 26.484 s worker Wall, Wall: 1.944 s, Cores in use: 13.49, Total efficiency (on 32 cores): 42.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T13:33:48.117823 Cut to 1 unWISE tiles Reading WISE tile 2339p333 band 3 Reading WISE tile 2339p333 band 2 Reading WISE tile 2339p333 band 1 Reading WISE tile 2339p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 807 MB, VmSize: 796 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.182412 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 803 MB, VmSize: 797 MB, VmRSS: 140 MB, VmData: 171 MB, maxrss: 0.203432 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 856 MB, VmSize: 856 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.205608 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/233/2339p333/unwise-2339p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 806 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 180 MB, maxrss: 0.204376 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/tmp-legacysurvey-custom-233227p33482-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.87 s, CPU: 0.41 s, VmPeak: 982 MB, VmSize: 980 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.21854 MB Stage wise_forced finished: 2020-08-07T13:33:49.988769 Resources for stage wise_forced : 3.149 s worker CPU, 4.552 s worker Wall, Wall: 1.873 s, Cores in use: 1.90, Total efficiency (on 32 cores): 5.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T13:33:50.003509 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/coadd/cus/custom-233227p33482/legacysurvey-custom-233227p33482-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/tractor-i/cus/tractor-custom-233227p33482.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/tractor/cus/tractor-custom-233227p33482.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/tractor/cus/brick-custom-233227p33482.sha256sum Stage writecat : Wall: 0.78 s, CPU: 0.55 s, VmPeak: 1112 MB, VmSize: 984 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.351552 MB Stage writecat finished: 2020-08-07T13:33:50.782983 Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.782 s, Cores in use: 0.71, Total efficiency (on 32 cores): 2.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/233/PGC2032985/PGC2032985-largegalaxy-writecat.p All done: 50.224 s worker CPU, 62.210 s worker Wall, Wall: 18.966 s, Cores in use: 2.97, Total efficiency (on 32 cores): 9.3 % Finished galaxy PGC2032985 in 0.353 minutes.