Started working on galaxy PGC2502170 at Sun Jun 7 19:03:14 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.68667649999998 55.4409676 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T19:03:16.548191 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.68667649999998', '55.4409676', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.68667649999998 55.4409676 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 253.68667649999998 55.4409676 Starting process 6725 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 6727 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 6729 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 6734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T19:03:17.239303 Keeping 12 CCDs: k4m_170527_094939_ooi_zd_ls9.fits.fz k4m_170527_094939_ooi_zd_ls9-CCD2 z exptime 80.103 propid 2016A-0453 seeing 0.84 MJD 57900.409 object MzLS_670117_z k4m_160606_071337_ooi_zd_ls9.fits.fz k4m_160606_071337_ooi_zd_ls9-CCD1 z exptime 80.103 propid 2016A-0453 seeing 1.04 MJD 57545.301 object MzLS_671545_z k4m_160616_064622_ooi_zd_ls9.fits.fz k4m_160616_064622_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 0.86 MJD 57555.282 object MzLS_670832_z ksb_170602_101717_ooi_g_ls9.fits.fz ksb_170602_101717_ooi_g_ls9-CCD1 g exptime 107.329 propid 2015A-0801 seeing 1.54 MJD 57906.429 object 32621 ksb_160604_072218_ooi_r_ls9.fits.fz ksb_160604_072218_ooi_r_ls9-CCD1 r exptime 50.7 propid BASS seeing 1.20 MJD 57543.307 object 32621 ksb_170521_095635_ooi_g_ls9.fits.fz ksb_170521_095635_ooi_g_ls9-CCD4 g exptime 110.678 propid 2015A-0801 seeing 1.32 MJD 57894.414 object 33693 ksb_170519_094635_ooi_r_ls9.fits.fz ksb_170519_094635_ooi_r_ls9-CCD4 r exptime 92.738 propid 2015A-0801 seeing 1.27 MJD 57892.407 object 33693 ksb_170521_095141_ooi_g_ls9.fits.fz ksb_170521_095141_ooi_g_ls9-CCD2 g exptime 109.934 propid 2015A-0801 seeing 1.37 MJD 57894.411 object 33683 ksb_170519_093751_ooi_r_ls9.fits.fz ksb_170519_093751_ooi_r_ls9-CCD2 r exptime 92.317 propid 2015A-0801 seeing 1.40 MJD 57892.401 object 33683 ksb_180223_100145_ooi_r_ls9.fits.fz ksb_180223_100145_ooi_r_ls9-CCD3 r exptime 220.0 propid BASS seeing 2.22 MJD 58172.418 object 32622 ksb_160713_072204_ooi_r_ls9.fits.fz ksb_160713_072204_ooi_r_ls9-CCD3 r exptime 250.0 propid BASS seeing 2.48 MJD 57582.307 object 32622 ksb_170327_114155_ooi_g_ls9.fits.fz ksb_170327_114155_ooi_g_ls9-CCD3 g exptime 90.454 propid BASS seeing 1.65 MJD 57839.487 object 32622 Faked up EXPNUM 79060157 Faked up EXPNUM 79060157 Faked up EXPNUM 79060157 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 511 673 and amp range 0 2015 and image y 3512 3672 and amp range 2048 4095 Range in image: x 0 163 , y 0 161 (with image size 163 x 161) dzp -0.034377232 -> scaling image by 0.9688334104074875 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1354 1636 and amp range 0 2005 and image y 1253 1536 and amp range 0 2039 Range in image: x 0 283 , y 0 284 (with image size 283 x 284) dzp -0.011066288 -> scaling image by 0.989859339076806 mosaic get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 80 and amp range 0 2047 and image y 1198 1474 and amp range 0 2021 Range in image: x 0 74 , y 0 277 (with image size 74 x 277) dzp 0.005139143 -> scaling image by 1.0047445456970268 mosaic get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2484 2764 and amp range 2048 4095 and image y 3748 4026 and amp range 2040 4078 Range in image: x 0 281 , y 0 279 (with image size 281 x 279) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 75430115 Faked up EXPNUM 75430115 Faked up EXPNUM 75430115 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 491 653 and amp range 0 2015 and image y 3524 3684 and amp range 2048 4095 Range in image: x 0 163 , y 0 161 (with image size 163 x 161) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Faked up EXPNUM 78940171 Faked up EXPNUM 78940171 Faked up EXPNUM 78940171 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2245 2408 and amp range 2016 4031 and image y 250 414 and amp range 0 2047 Range in image: x 0 164 , y 0 165 (with image size 164 x 165) dzp 0.01918938 -> scaling image by 1.017831182878158 Faked up EXPNUM 78940173 Faked up EXPNUM 78940173 Faked up EXPNUM 78940173 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2322 2482 and amp range 2016 4031 and image y 3898 4060 and amp range 2048 4095 Range in image: x 0 161 , y 0 163 (with image size 161 x 163) dzp -0.0030897402 -> scaling image by 0.9971582894587289 Faked up EXPNUM 78920201 Faked up EXPNUM 78920201 Faked up EXPNUM 78920201 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2336 2496 and amp range 2016 4031 and image y 3898 4060 and amp range 2048 4095 Range in image: x 0 161 , y 0 163 (with image size 161 x 163) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 78920197 Faked up EXPNUM 78920197 Faked up EXPNUM 78920197 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2256 2418 and amp range 2016 4031 and image y 251 416 and amp range 0 2047 Range in image: x 0 163 , y 0 166 (with image size 163 x 166) dzp 0.032776505 -> scaling image by 1.0306485625912574 Faked up EXPNUM 75820072 Faked up EXPNUM 75820072 Faked up EXPNUM 75820072 90prime get_fwhm: self.fwhm = 5.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2527 2687 and amp range 2016 4031 and image y 1010 1170 and amp range 0 2047 Range in image: x 0 161 , y 0 161 (with image size 161 x 161) dzp 0.004245165 -> scaling image by 1.0039175950705865 Faked up EXPNUM 78390280 Faked up EXPNUM 78390280 Faked up EXPNUM 78390280 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2541 2701 and amp range 2016 4031 and image y 1015 1174 and amp range 0 2047 Range in image: x 0 161 , y 0 160 (with image size 161 x 160) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 Faked up EXPNUM 81720203 Faked up EXPNUM 81720203 Faked up EXPNUM 81720203 90prime get_fwhm: self.fwhm = 4.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2535 2695 and amp range 2016 4031 and image y 994 1154 and amp range 0 2047 Range in image: x 0 161 , y 0 161 (with image size 161 x 161) dzp 0.0057031885 -> scaling image by 1.00526665101287 Stage tims : Wall: 10.73 s, CPU: 1.23 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566544 MB Stage tims finished: 2020-06-07T19:03:27.967675 Resources for stage tims : 3.600 s worker CPU, 21.564 s worker Wall, Wall: 10.730 s, Cores in use: 0.45, Total efficiency (on 4 cores): 11.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T19:03:28.030886 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00986.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01171.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01076.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01077.fits Matched 5 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/reference-custom-253686p55440.fits Stage refs : Wall: 3.87 s, CPU: 2.27 s, VmPeak: 973 MB, VmSize: 965 MB, VmRSS: 196 MB, VmData: 229 MB, maxrss: 0.566544 MB Stage refs finished: 2020-06-07T19:03:31.897527 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.868 s, Cores in use: 0.59, Total efficiency (on 4 cores): 14.7 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T19:03:31.899108 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outlier-mask-custom-253686p55440.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-pre-custom-253686p55440.jpg Image ksb_180223_100145_ooi_r_ls9-CCD3 r : masking 418 positive outlier pixels and 0 negative outlier pixels Image ksb_160713_072204_ooi_r_ls9-CCD3 r : masking 3095 positive outlier pixels and 0 negative outlier pixels Image k4m_160606_071337_ooi_zd_ls9-CCD1 z : masking 1234 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outlier-mask-custom-253686p55440.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-post-custom-253686p55440.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-masked-pos-custom-253686p55440.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-masked-neg-custom-253686p55440.jpg Stage outliers : Wall: 1.09 s, CPU: 0.72 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 214 MB, VmData: 244 MB, maxrss: 0.566544 MB Stage outliers finished: 2020-06-07T19:03:32.989896 Resources for stage outliers : 1.342 s worker CPU, 1.367 s worker Wall, Wall: 1.092 s, Cores in use: 1.89, Total efficiency (on 4 cores): 47.2 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T19:03:32.991657 Stage halos : Wall: 0.51 s, CPU: 0.50 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 214 MB, VmData: 244 MB, maxrss: 0.566544 MB Stage halos finished: 2020-06-07T19:03:33.502830 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.512 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.4 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T19:03:33.504674 PSF sigmas in coadd pixels: ['2.49', '2.14', '2.23', '2.69'] Using average PSF sigma 2.3884473567008246 Gaussian PSF norm 0.11810802150713393 vs pixelized 0.098500654 average tim pixel scale / coadd scale: 1.729718141323524 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.95', '2.07', '2.27', '3.60', '4.02'] Using average PSF sigma 2.7838067246303337 Gaussian PSF norm 0.10133418720415585 vs pixelized 0.08159396 average tim pixel scale / coadd scale: 1.7297443647634323 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.37', '1.68', '1.40'] Using average PSF sigma 1.4856506810274925 Gaussian PSF norm 0.18987962337066897 vs pixelized 0.15840328 average tim pixel scale / coadd scale: 0.9909047472347569 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.24 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.566544 MB Stage fit_on_coadds finished: 2020-06-07T19:03:33.790799 Resources for stage fit_on_coadds : 0.361 s worker CPU, 0.375 s worker Wall, Wall: 0.287 s, Cores in use: 2.09, Total efficiency (on 4 cores): 52.3 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T19:03:33.793934 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 31 potential peaks Of 31 potential peaks: 7 in veto map, 7 cut by saddle test, 0 cut by aper test, 17 kept SED z : 17 new peaks Found 27 potential peaks Of 27 potential peaks: 20 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 22 potential peaks Of 22 potential peaks: 19 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 35 potential peaks Of 35 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 41 potential peaks Of 41 potential peaks: 36 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 25 new sources Median coadd sky for g : 0.00013379449 Median coadd sky for r : 0.00034542923 Median coadd sky for z : -0.0001569361 Stage srcs : Wall: 0.66 s, CPU: 0.60 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 217 MB, VmData: 245 MB, maxrss: 0.566544 MB Stage srcs finished: 2020-06-07T19:03:34.455654 Resources for stage srcs : 0.147 s worker CPU, 0.160 s worker Wall, Wall: 0.663 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T19:03:34.470234 Blob 1 of 13, id: 1, sources: 11, size: 123x191, npix 12647, brick X: 80,203, Y: 32,223, one pixel: 92 32 Blob 2 of 13, id: 4, sources: 6, size: 91x137, npix 8740, brick X: 0,91, Y: 82,219, one pixel: 32 82 Blob 3 of 13, id: 0, sources: 3, size: 80x70, npix 3469, brick X: 159,239, Y: 1,71, one pixel: 193 1 Blob 4 of 13, id: 11, sources: 1, size: 38x39, npix 1026, brick X: 72,110, Y: 236,275, one pixel: 89 236 Blob 5 of 13, id: 8, sources: 1, size: 28x33, npix 589, brick X: 112,140, Y: 218,251, one pixel: 125 218 Blob 4 finished, total: Wall: 0.71 s, CPU: 0.65 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.141076 MB Blob 6 of 13, id: 3, sources: 1, size: 27x28, npix 519, brick X: 33,60, Y: 38,66, one pixel: 43 38 Blob 5 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143324 MB Blob 7 of 13, id: 9, sources: 1, size: 25x25, npix 400, brick X: 45,70, Y: 231,256, one pixel: 56 231 Blob 3 finished, total: Wall: 2.76 s, CPU: 2.71 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144292 MB Blob 8 of 13, id: 5, sources: 1, size: 26x24, npix 377, brick X: 218,244, Y: 141,165, one pixel: 229 141 Blob 6 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143324 MB Blob 9 of 13, id: 2, sources: 1, size: 22x23, npix 303, brick X: 8,30, Y: 33,56, one pixel: 18 33 Blob 10 of 13, id: 7, sources: 1, size: 21x21, npix 250, brick X: 86,107, Y: 206,227, one pixel: 96 206 Blob 7 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144292 MB Blob 11 of 13, id: 12, sources: 1, size: 19x21, npix 236, brick X: 203,222, Y: 241,262, one pixel: 211 241 Blob 8 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143324 MB Blob 12 of 13, id: 6, sources: 1, size: 14x20, npix 178, brick X: 261,275, Y: 160,180, one pixel: 269 160 Measuring 1 iterative sources Blob 9 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144292 MB Blob 13 of 13, id: 10, sources: 1, size: 15x19, npix 165, brick X: 0,15, Y: 235,254, one pixel: 5 235 Blob 10 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143324 MB Blob 12 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143324 MB Blob 2 finished, total: Wall: 3.95 s, CPU: 3.94 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143704 MB Blob 11 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 805 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144292 MB Blob 13 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 804 MB, VmSize: 713 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.143928 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.55382, ee1=0.146259, ee2=0.0738082 Blob 1 finished, total: Wall: 8.72 s, CPU: 8.70 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145568 MB Old catalog: 35 New catalog: 31 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/blobs-custom-253686p55440.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/all-models-custom-253686p55440.fits Stage fitblobs : Wall: 9.29 s, CPU: 0.55 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 217 MB, VmData: 245 MB, maxrss: 0.566544 MB Stage fitblobs finished: 2020-06-07T19:03:43.759886 Resources for stage fitblobs : 20.922 s worker CPU, 21.129 s worker Wall, Wall: 9.291 s, Cores in use: 2.31, Total efficiency (on 4 cores): 57.8 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T19:03:43.761673 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/tmp-legacysurvey-custom-253686p55440-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/tmp-legacysurvey-custom-253686p55440-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/tmp-legacysurvey-custom-253686p55440-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/tmp-legacysurvey-custom-253686p55440-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-resid.jpg Stage coadds : Wall: 1.43 s, CPU: 0.61 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 217 MB, VmData: 245 MB, maxrss: 0.566544 MB Stage coadds finished: 2020-06-07T19:03:45.193501 Resources for stage coadds : 2.025 s worker CPU, 2.096 s worker Wall, Wall: 1.433 s, Cores in use: 1.84, Total efficiency (on 4 cores): 45.9 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T19:03:45.195032 Cut to 1 unWISE tiles Reading WISE tile 2533p560 band 2 Reading WISE tile 2533p560 band 1 Reading WISE tile 2533p560 band 3 Reading WISE tile 2533p560 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 805 MB, VmSize: 796 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.187772 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20912 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.208872 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209312 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/tmp-legacysurvey-custom-253686p55440-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/tmp-legacysurvey-custom-253686p55440-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.47 s, CPU: 0.43 s, VmPeak: 975 MB, VmSize: 975 MB, VmRSS: 218 MB, VmData: 245 MB, maxrss: 0.566544 MB Stage wise_forced finished: 2020-06-07T19:03:47.665878 Resources for stage wise_forced : 4.674 s worker CPU, 6.354 s worker Wall, Wall: 2.472 s, Cores in use: 2.07, Total efficiency (on 4 cores): 51.6 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T19:03:47.667441 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253686p55440/legacysurvey-custom-253686p55440-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/tractor-i/cus/tractor-custom-253686p55440.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/tractor/cus/tractor-custom-253686p55440.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/tractor/cus/brick-custom-253686p55440.sha256sum Stage writecat : Wall: 0.89 s, CPU: 0.51 s, VmPeak: 1107 MB, VmSize: 979 MB, VmRSS: 220 MB, VmData: 245 MB, maxrss: 0.566544 MB Stage writecat finished: 2020-06-07T19:03:48.560635 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.894 s, Cores in use: 0.58, Total efficiency (on 4 cores): 14.4 % Stage writecat finished All done: 33.073 s worker CPU, 53.049 s worker Wall, Wall: 31.327 s, Cores in use: 1.30, Total efficiency (on 4 cores): 32.5 % Finished galaxy PGC2502170 in 0.574 minutes. Started working on galaxy PGC2502170 at Fri Aug 7 09:47:13 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.6859872655163 55.44096262996936 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:47:14.457679 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '253.6859872655163', '55.44096262996936', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 253.6859872655163 55.44096262996936 --width 275 --height 275 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 253.6859872655163 55.44096262996936 Starting process 54512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 54513 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 54514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 54515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 54516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Starting process 54517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 54518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 54519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 54520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 54521 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 54522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 54523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 54524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 54525 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 54526 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 54527 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:47:14.963005 Keeping 12 CCDs: k4m_170527_094939_ooi_zd_ls9-CCD2 z expnum 130162 exptime 80.103 propid 2016A-0453 seeing 0.84 MJD 57900.409 object MzLS_670117_z mosaic/CP/V4.3/CP20170526/k4m_170527_094939_ooi_zd_ls9.fits.fz k4m_160606_071337_ooi_zd_ls9-CCD1 z expnum 93736 exptime 80.103 propid 2016A-0453 seeing 1.04 MJD 57545.301 object MzLS_671545_z mosaic/CP/V4.3/CP20160605/k4m_160606_071337_ooi_zd_ls9.fits.fz k4m_160616_064622_ooi_zd_ls9-CCD4 z expnum 95733 exptime 80.104 propid 2016A-0453 seeing 0.86 MJD 57555.282 object MzLS_670832_z mosaic/CP/V4.3/CP20160615/k4m_160616_064622_ooi_zd_ls9.fits.fz ksb_170602_101717_ooi_g_ls9-CCD1 g expnum 79060157 exptime 107.329 propid 2015A-0801 seeing 1.54 MJD 57906.429 object 32621 90prime/CP/V2.3/CP20170601/ksb_170602_101717_ooi_g_ls9.fits.fz ksb_160604_072218_ooi_r_ls9-CCD1 r expnum 75430115 exptime 50.7 propid BASS seeing 1.20 MJD 57543.307 object 32621 90prime/CP/V2.3/CP20160603/ksb_160604_072218_ooi_r_ls9.fits.fz ksb_170521_095635_ooi_g_ls9-CCD4 g expnum 78940173 exptime 110.678 propid 2015A-0801 seeing 1.32 MJD 57894.414 object 33693 90prime/CP/V2.3/CP20170520/ksb_170521_095635_ooi_g_ls9.fits.fz ksb_170519_094635_ooi_r_ls9-CCD4 r expnum 78920201 exptime 92.738 propid 2015A-0801 seeing 1.27 MJD 57892.407 object 33693 90prime/CP/V2.3/CP20170518/ksb_170519_094635_ooi_r_ls9.fits.fz ksb_170521_095141_ooi_g_ls9-CCD2 g expnum 78940171 exptime 109.934 propid 2015A-0801 seeing 1.37 MJD 57894.411 object 33683 90prime/CP/V2.3/CP20170520/ksb_170521_095141_ooi_g_ls9.fits.fz ksb_170519_093751_ooi_r_ls9-CCD2 r expnum 78920197 exptime 92.317 propid 2015A-0801 seeing 1.40 MJD 57892.401 object 33683 90prime/CP/V2.3/CP20170518/ksb_170519_093751_ooi_r_ls9.fits.fz ksb_180223_100145_ooi_r_ls9-CCD3 r expnum 81720203 exptime 220.0 propid BASS seeing 2.22 MJD 58172.418 object 32622 90prime/CP/V2.3/CP20180222/ksb_180223_100145_ooi_r_ls9.fits.fz ksb_160713_072204_ooi_r_ls9-CCD3 r expnum 75820072 exptime 250.0 propid BASS seeing 2.48 MJD 57582.307 object 32622 90prime/CP/V2.3/CP20160712/ksb_160713_072204_ooi_r_ls9.fits.fz ksb_170327_114155_ooi_g_ls9-CCD3 g expnum 78390280 exptime 90.454 propid BASS seeing 1.65 MJD 57839.487 object 32622 90prime/CP/V2.3/CP20170326/ksb_170327_114155_ooi_g_ls9.fits.fz Faked up EXPNUM 75430115 Faked up EXPNUM 75430115 Faked up EXPNUM 75430115 90prime get_fwhm: self.fwhm = 2.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 491 653 and amp range 0 2015 and image y 3527 3687 and amp range 2048 4095 Range in image: x 0 163 , y 0 161 (with image size 163 x 161) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Faked up EXPNUM 78920201 Faked up EXPNUM 78920201 Faked up EXPNUM 78920201 90prime get_fwhm: self.fwhm = 2.81 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2336 2496 and amp range 2016 4031 and image y 3901 4063 and amp range 2048 4095 Range in image: x 0 161 , y 0 163 (with image size 161 x 163) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 75820072 Faked up EXPNUM 75820072 Faked up EXPNUM 75820072 90prime get_fwhm: self.fwhm = 5.47 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2527 2687 and amp range 2016 4031 and image y 1013 1173 and amp range 0 2047 Range in image: x 0 161 , y 0 161 (with image size 161 x 161) dzp 0.004245165 -> scaling image by 1.0039175950705865 Faked up EXPNUM 81720203 Faked up EXPNUM 81720203 Faked up EXPNUM 81720203 90prime get_fwhm: self.fwhm = 4.89 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2535 2695 and amp range 2016 4031 and image y 997 1157 and amp range 0 2047 Range in image: x 0 161 , y 0 161 (with image size 161 x 161) dzp 0.0057031885 -> scaling image by 1.00526665101287 Faked up EXPNUM 78940173 Faked up EXPNUM 78940173 Faked up EXPNUM 78940173 90prime get_fwhm: self.fwhm = 2.91 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2322 2482 and amp range 2016 4031 and image y 3901 4063 and amp range 2048 4095 Range in image: x 0 161 , y 0 163 (with image size 161 x 163) dzp -0.0030897402 -> scaling image by 0.9971582894587289 Faked up EXPNUM 78390280 Faked up EXPNUM 78390280 Faked up EXPNUM 78390280 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2541 2701 and amp range 2016 4031 and image y 1018 1177 and amp range 0 2047 Range in image: x 0 161 , y 0 160 (with image size 161 x 160) dzp -3.875605e-05 -> scaling image by 0.9999643049955675 Faked up EXPNUM 78940171 Faked up EXPNUM 78940171 Faked up EXPNUM 78940171 90prime get_fwhm: self.fwhm = 3.03 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2245 2408 and amp range 2016 4031 and image y 253 417 and amp range 0 2047 Range in image: x 0 164 , y 0 165 (with image size 164 x 165) dzp 0.01918938 -> scaling image by 1.017831182878158 Faked up EXPNUM 78920197 Faked up EXPNUM 78920197 Faked up EXPNUM 78920197 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2256 2418 and amp range 2016 4031 and image y 255 419 and amp range 0 2047 Range in image: x 0 163 , y 0 165 (with image size 163 x 165) dzp 0.032776505 -> scaling image by 1.0306485625912574 mosaic get_fwhm: self.fwhm = 3.33 Found 4 relevant rows in amp-corrections file. Found overlap: image x 7 80 and amp range 0 2047 and image y 1192 1469 and amp range 0 2021 Range in image: x 0 74 , y 0 278 (with image size 74 x 278) dzp 0.005139143 -> scaling image by 1.0047445456970268 mosaic get_fwhm: self.fwhm = 3.99 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1354 1635 and amp range 0 2005 and image y 1248 1531 and amp range 0 2039 Range in image: x 0 282 , y 0 284 (with image size 282 x 284) dzp -0.011066288 -> scaling image by 0.989859339076806 mosaic get_fwhm: self.fwhm = 3.25 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2484 2763 and amp range 2048 4095 and image y 3743 4021 and amp range 2040 4078 Range in image: x 0 280 , y 0 279 (with image size 280 x 279) dzp -0.032976374 -> scaling image by 0.9700842429001929 Faked up EXPNUM 79060157 Faked up EXPNUM 79060157 Faked up EXPNUM 79060157 90prime get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 511 673 and amp range 0 2015 and image y 3515 3675 and amp range 2048 4095 Range in image: x 0 163 , y 0 161 (with image size 163 x 161) dzp -0.034377232 -> scaling image by 0.9688334104074875 Stage tims : Wall: 17.92 s, CPU: 0.85 s, VmPeak: 952 MB, VmSize: 952 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178152 MB Stage tims finished: 2020-08-07T09:47:32.878677 Resources for stage tims : 6.598 s worker CPU, 76.561 s worker Wall, Wall: 17.917 s, Cores in use: 0.42, Total efficiency (on 16 cores): 2.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-07T09:47:32.963955 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00986.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01171.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01076.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01077.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/reference-custom-253685p55440.fits Stage refs : Wall: 25.67 s, CPU: 2.49 s, VmPeak: 982 MB, VmSize: 976 MB, VmRSS: 199 MB, VmData: 232 MB, maxrss: 0.203848 MB Stage refs finished: 2020-08-07T09:47:58.636273 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 25.674 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:48:00.822620 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outlier-mask-custom-253685p55440.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-pre-custom-253685p55440.jpg Image ksb_180223_100145_ooi_r_ls9-CCD3 r : masking 420 positive outlier pixels and 0 negative outlier pixels Image ksb_160713_072204_ooi_r_ls9-CCD3 r : masking 2650 positive outlier pixels and 0 negative outlier pixels Image k4m_160606_071337_ooi_zd_ls9-CCD1 z : masking 1108 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outlier-mask-custom-253685p55440.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-post-custom-253685p55440.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-masked-pos-custom-253685p55440.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/outliers-masked-neg-custom-253685p55440.jpg Stage outliers : Wall: 1.09 s, CPU: 0.75 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 216 MB, VmData: 246 MB, maxrss: 0.221556 MB Stage outliers finished: 2020-08-07T09:48:01.910764 Resources for stage outliers : 1.034 s worker CPU, 1.077 s worker Wall, Wall: 1.090 s, Cores in use: 1.64, Total efficiency (on 16 cores): 10.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:48:01.995599 Stage halos : Wall: 0.33 s, CPU: 0.32 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.221704 MB Stage halos finished: 2020-08-07T09:48:02.323665 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.330 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-halos.p Running stage fit_on_coadds Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Running stage fit_on_coadds at 2020-08-07T09:48:02.422234 PSF sigmas in coadd pixels: ['2.49', '2.14', '2.23', '2.69'] Using average PSF sigma 2.3884473567008246 Gaussian PSF norm 0.11810802150713393 vs pixelized 0.09849867 average tim pixel scale / coadd scale: 1.729718141323524 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.95', '2.07', '2.27', '3.60', '4.02'] Using average PSF sigma 2.7838067246303337 Gaussian PSF norm 0.10133418720415585 vs pixelized 0.08159182 average tim pixel scale / coadd scale: 1.7297443647634323 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.37', '1.68', '1.40'] Using average PSF sigma 1.4856506810274925 Gaussian PSF norm 0.18987962337066897 vs pixelized 0.15840389 average tim pixel scale / coadd scale: 0.9909047472347569 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.27 s, CPU: 0.19 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 219 MB, VmData: 247 MB, maxrss: 0.224188 MB Stage fit_on_coadds finished: 2020-08-07T09:48:02.690079 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage fit_on_coadds : 0.302 s worker CPU, 0.302 s worker Wall, Wall: 0.269 s, Cores in use: 1.84, Total efficiency (on 16 cores): 11.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:48:02.733241 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 55 potential peaks Of 55 potential peaks: 31 in veto map, 6 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 266 potential peaks Of 266 potential peaks: 260 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 63 potential peaks Of 63 potential peaks: 60 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 57 potential peaks Of 57 potential peaks: 53 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 73 potential peaks Of 73 potential peaks: 67 in veto map, 6 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 22 new sources Median coadd sky for g : 0.000119196666 Median coadd sky for r : 0.00033679587 Median coadd sky for z : -0.00011094824 Stage srcs : Wall: 0.52 s, CPU: 0.46 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.224816 MB Stage srcs finished: 2020-08-07T09:48:03.251289 Resources for stage srcs : 0.093 s worker CPU, 0.094 s worker Wall, Wall: 0.519 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:48:03.289613 Blob 1 of 14, id: 1, sources: 10, size: 122x191, npix 12678, brick X: 75,197, Y: 32,223, one pixel: 87 32 Blob 2 of 14, id: 5, sources: 3, size: 86x137, npix 8210, brick X: 0,86, Y: 82,219, one pixel: 26 82 Blob 3 of 14, id: 0, sources: 3, size: 80x71, npix 3521, brick X: 154,234, Y: 0,71, one pixel: 180 0 Blob 4 of 14, id: 12, sources: 1, size: 38x39, npix 1019, brick X: 67,105, Y: 236,275, one pixel: 84 236 Blob 5 of 14, id: 10, sources: 1, size: 29x33, npix 594, brick X: 106,135, Y: 218,251, one pixel: 120 218 Blob 6 of 14, id: 3, sources: 1, size: 27x28, npix 510, brick X: 28,55, Y: 38,66, one pixel: 38 38 Blob 7 of 14, id: 8, sources: 1, size: 20x33, npix 461, brick X: 255,275, Y: 155,188, one pixel: 264 155 Blob 8 of 14, id: 7, sources: 1, size: 25x24, npix 396, brick X: 213,238, Y: 141,165, one pixel: 224 141 Blob 9 of 14, id: 11, sources: 1, size: 25x26, npix 392, brick X: 40,65, Y: 231,257, one pixel: 51 231 Blob 10 of 14, id: 6, sources: 1, size: 19x26, npix 337, brick X: 256,275, Y: 100,126, one pixel: 266 100 Blob 11 of 14, id: 2, sources: 1, size: 23x22, npix 295, brick X: 2,25, Y: 34,56, one pixel: 11 34 Blob 12 of 14, id: 9, sources: 1, size: 21x20, npix 258, brick X: 81,102, Y: 207,227, one pixel: 90 207 Blob 13 of 14, id: 13, sources: 1, size: 19x21, npix 237, brick X: 198,217, Y: 241,262, one pixel: 206 241 Blob 14 of 14, id: 4, sources: 2, size: 15x23, npix 222, brick X: 260,275, Y: 41,64, one pixel: 270 41 Blob 8 finished, total: Wall: 0.28 s, CPU: 0.26 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147456 MB Blob 12 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147132 MB Blob 11 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.1474 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (253.64394, 55.43473), pm (-10.3, 13.1), parallax 2.650 with NanoMaggies: g=15.1, r=14.3, z=13.9 Reset brightness to NanoMaggies: g=15.1, r=14.3, z=13.9 Blob 14 finished, total: Wall: 0.38 s, CPU: 0.37 s, VmPeak: 787 MB, VmSize: 711 MB, VmRSS: 131 MB, VmData: 169 MB, maxrss: 0.133684 MB Blob 9 finished, total: Wall: 0.40 s, CPU: 0.38 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147192 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 0.52 s, CPU: 0.51 s, VmPeak: 808 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14712 MB Blob 10 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 803 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147328 MB Blob 4 finished, total: Wall: 0.61 s, CPU: 0.59 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14736 MB Blob 13 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097104 MB Blob 6 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.095352 MB Blob 7 finished, total: Wall: 0.88 s, CPU: 0.86 s, VmPeak: 804 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146856 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.12 s, CPU: 2.12 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148828 MB Blob 2 finished, total: Wall: 2.14 s, CPU: 2.14 s, VmPeak: 813 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148356 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.37486, ee1=0.144907, ee2=0.0763369 Blob 1 finished, total: Wall: 5.23 s, CPU: 5.23 s, VmPeak: 692 MB, VmSize: 686 MB, VmRSS: 112 MB, VmData: 155 MB, maxrss: 0.120196 MB Old catalog: 32 New catalog: 30 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/blobs-custom-253685p55440.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/metrics/cus/all-models-custom-253685p55440.fits Stage fitblobs : Wall: 5.67 s, CPU: 0.42 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.225236 MB Stage fitblobs finished: 2020-08-07T09:48:08.961122 Resources for stage fitblobs : 15.052 s worker CPU, 15.248 s worker Wall, Wall: 5.673 s, Cores in use: 2.73, Total efficiency (on 16 cores): 17.0 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:48:08.997977 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/tmp-legacysurvey-custom-253685p55440-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/tmp-legacysurvey-custom-253685p55440-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/tmp-legacysurvey-custom-253685p55440-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/tmp-legacysurvey-custom-253685p55440-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-resid.jpg Stage coadds : Wall: 2.26 s, CPU: 0.66 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 220 MB, VmData: 247 MB, maxrss: 0.225688 MB Stage coadds finished: 2020-08-07T09:48:11.257001 Resources for stage coadds : 7.330 s worker CPU, 8.082 s worker Wall, Wall: 2.261 s, Cores in use: 3.53, Total efficiency (on 16 cores): 22.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:48:11.288027 Cut to 1 unWISE tiles Reading WISE tile 2533p560 band 1 Reading WISE tile 2533p560 band 3 Reading WISE tile 2533p560 band 2 Reading WISE tile 2533p560 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 804 MB, VmSize: 802 MB, VmRSS: 149 MB, VmData: 176 MB, maxrss: 0.187952 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 809 MB, VmSize: 797 MB, VmRSS: 140 MB, VmData: 170 MB, maxrss: 0.203444 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 804 MB, VmSize: 802 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.207284 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/253/2533p560/unwise-2533p560-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 813 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203964 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/tmp-legacysurvey-custom-253685p55440-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/tmp-legacysurvey-custom-253685p55440-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.98 s, CPU: 0.58 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 221 MB, VmData: 247 MB, maxrss: 0.226392 MB Stage wise_forced finished: 2020-08-07T09:48:14.268875 Resources for stage wise_forced : 3.039 s worker CPU, 5.309 s worker Wall, Wall: 2.982 s, Cores in use: 1.21, Total efficiency (on 16 cores): 7.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:48:14.290996 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/coadd/cus/custom-253685p55440/legacysurvey-custom-253685p55440-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/tractor-i/cus/tractor-custom-253685p55440.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/tractor/cus/tractor-custom-253685p55440.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/tractor/cus/brick-custom-253685p55440.sha256sum Stage writecat : Wall: 0.79 s, CPU: 0.59 s, VmPeak: 1117 MB, VmSize: 989 MB, VmRSS: 223 MB, VmData: 247 MB, maxrss: 0.359276 MB Stage writecat finished: 2020-08-07T09:48:15.079492 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.790 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/253/PGC2502170/PGC2502170-largegalaxy-writecat.p All done: 33.452 s worker CPU, 106.677 s worker Wall, Wall: 60.134 s, Cores in use: 0.68, Total efficiency (on 16 cores): 4.3 % Finished galaxy PGC2502170 in 1.061 minutes.