Started working on galaxy PGC2303812 at Mon Jun 15 07:16:19 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.76683799999995 47.755553000000006 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T07:16:19.821739 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '283.76683799999995', '47.755553000000006', '--width', '239', '--height', '239', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 283.76683799999995 47.755553000000006 --width 239 --height 239 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 283.76683799999995 47.755553000000006 Starting process 18624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 18625 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 18626 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 18627 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 18628 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 18629 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 18630 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 18631 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T07:16:20.404545 Keeping 14 CCDs: k4m_170910_063709_ooi_zd_ls9.fits.fz k4m_170910_063709_ooi_zd_ls9-CCD2 z exptime 240.103 propid 2016A-0453 seeing 0.88 MJD 58006.276 object MzLS_639593_z k4m_160518_110706_ooi_zd_ls9.fits.fz k4m_160518_110706_ooi_zd_ls9-CCD1 z exptime 80.104 propid 2016A-0453 seeing 0.97 MJD 57526.463 object MzLS_641281_z k4m_160516_110920_ooi_zd_ls9.fits.fz k4m_160516_110920_ooi_zd_ls9-CCD1 z exptime 80.106 propid 2016A-0453 seeing 0.87 MJD 57524.465 object MzLS_640438_z k4m_170901_073933_ooi_zd_ls9.fits.fz k4m_170901_073933_ooi_zd_ls9-CCD4 z exptime 183.106 propid 2016A-0453 seeing 1.09 MJD 57997.319 object MzLS_639592_z ksb_160703_084447_ooi_g_ls9.fits.fz ksb_160703_084447_ooi_g_ls9-CCD1 g exptime 85.8 propid BASS seeing 1.46 MJD 57572.364 object 62812 ksb_160516_111128_ooi_r_ls9.fits.fz ksb_160516_111128_ooi_r_ls9-CCD1 r exptime 89.2 propid BASS seeing 1.58 MJD 57524.466 object 62812 ksb_180510_100416_ooi_g_ls9.fits.fz ksb_180510_100416_ooi_g_ls9-CCD4 g exptime 129.717 propid NOTBASS seeing 1.39 MJD 58248.420 object 62971 ksb_160604_101735_ooi_r_ls9.fits.fz ksb_160604_101735_ooi_r_ls9-CCD4 r exptime 67.6 propid BASS seeing 1.10 MJD 57543.429 object 62971 ksb_160703_085632_ooi_g_ls9.fits.fz ksb_160703_085632_ooi_g_ls9-CCD2 g exptime 93.2 propid BASS seeing 1.21 MJD 57572.373 object 24912 ksb_160605_102044_ooi_r_ls9.fits.fz ksb_160605_102044_ooi_r_ls9-CCD2 r exptime 65.5 propid BASS seeing 1.18 MJD 57544.431 object 24912 ksb_170624_080907_ooi_r_ls9.fits.fz ksb_170624_080907_ooi_r_ls9-CCD3 r exptime 250.0 propid BASS seeing 1.36 MJD 57928.340 object 62973 ksb_160702_103550_ooi_g_ls9.fits.fz ksb_160702_103550_ooi_g_ls9-CCD3 g exptime 142.5 propid BASS seeing 2.13 MJD 57571.442 object 62973 ksb_160703_084932_ooi_g_ls9.fits.fz ksb_160703_084932_ooi_g_ls9-CCD4 g exptime 91.2 propid BASS seeing 1.15 MJD 57572.368 object 62972 ksb_160605_102246_ooi_r_ls9.fits.fz ksb_160605_102246_ooi_r_ls9-CCD4 r exptime 64.5 propid BASS seeing 1.40 MJD 57544.432 object 62972 Faked up EXPNUM 75720080 Faked up EXPNUM 75720080 Faked up EXPNUM 75720080 90prime get_fwhm: self.fwhm = 3.23 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 119 and amp range 0 2015 and image y 2526 2666 and amp range 2048 4095 Range in image: x 0 105 , y 0 141 (with image size 105 x 141) dzp -0.0051191514 -> scaling image by 0.9952961850385206 mosaic get_fwhm: self.fwhm = 3.73 Found 4 relevant rows in amp-corrections file. Found overlap: image x 495 745 and amp range 0 2005 and image y 457 708 and amp range 0 2039 Range in image: x 0 251 , y 0 252 (with image size 251 x 252) dzp -0.011066288 -> scaling image by 0.989859339076806 mosaic get_fwhm: self.fwhm = 3.37 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3232 3472 and amp range 2006 4053 and image y 2114 2355 and amp range 2040 4078 Range in image: x 0 241 , y 0 242 (with image size 241 x 242) dzp -0.006092005 -> scaling image by 0.9944047680378836 mosaic get_fwhm: self.fwhm = 3.39 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1653 1897 and amp range 0 2047 and image y 66 315 and amp range 0 2039 Range in image: x 0 245 , y 0 250 (with image size 245 x 250) dzp 0.007023884 -> scaling image by 1.0064902069278665 Faked up EXPNUM 75240178 Faked up EXPNUM 75240178 Faked up EXPNUM 75240178 90prime get_fwhm: self.fwhm = 3.49 Found 4 relevant rows in amp-corrections file. Found overlap: image x 15 125 and amp range 0 2015 and image y 2532 2672 and amp range 2048 4095 Range in image: x 0 111 , y 0 141 (with image size 111 x 141) dzp -0.00015519658 -> scaling image by 0.9998570688798908 mosaic get_fwhm: self.fwhm = 4.21 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1701 1948 and amp range 0 2047 and image y 3715 3961 and amp range 2022 4060 Range in image: x 0 248 , y 0 247 (with image size 248 x 247) dzp -0.016192675 -> scaling image by 0.9851966584456431 Faked up EXPNUM 82480171 Faked up EXPNUM 82480171 Faked up EXPNUM 82480171 90prime get_fwhm: self.fwhm = 3.07 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1832 1971 and amp range 0 2015 and image y 1917 2056 and amp range 0 2047 Range in image: x 0 140 , y 0 131 (with image size 140 x 140) dzp 0.0059804036 -> scaling image by 1.0055233530762397 Found overlap: image x 1832 1971 and amp range 0 2015 and image y 1917 2056 and amp range 2048 4095 Range in image: x 0 140 , y 131 140 (with image size 140 x 140) dzp 0.027550658 -> scaling image by 1.0256997821704772 Faked up EXPNUM 75430199 Faked up EXPNUM 75430199 Faked up EXPNUM 75430199 90prime get_fwhm: self.fwhm = 2.43 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1833 1972 and amp range 0 2015 and image y 1929 2068 and amp range 0 2047 Range in image: x 0 140 , y 0 119 (with image size 140 x 140) dzp 0.009781551 -> scaling image by 1.0090498455107675 Found overlap: image x 1833 1972 and amp range 0 2015 and image y 1929 2068 and amp range 2048 4095 Range in image: x 0 140 , y 119 140 (with image size 140 x 140) dzp 0.004205519 -> scaling image by 1.0038809374310762 Faked up EXPNUM 75720085 Faked up EXPNUM 75720085 Faked up EXPNUM 75720085 90prime get_fwhm: self.fwhm = 2.67 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3746 3887 and amp range 2016 4031 and image y 330 474 and amp range 0 2047 Range in image: x 0 142 , y 0 145 (with image size 142 x 145) dzp -0.008960029 -> scaling image by 0.9917814665476246 Faked up EXPNUM 75440180 Faked up EXPNUM 75440180 Faked up EXPNUM 75440180 90prime get_fwhm: self.fwhm = 2.61 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3756 3897 and amp range 2016 4031 and image y 334 477 and amp range 0 2047 Range in image: x 0 142 , y 0 144 (with image size 142 x 144) dzp -0.012503507 -> scaling image by 0.9885499019198392 Faked up EXPNUM 75720082 Faked up EXPNUM 75720082 Faked up EXPNUM 75720082 90prime get_fwhm: self.fwhm = 2.53 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3821 3962 and amp range 2016 4031 and image y 3938 4079 and amp range 2048 4095 Range in image: x 0 142 , y 0 142 (with image size 142 x 142) dzp 0.0013913503 -> scaling image by 1.001282302423891 Faked up EXPNUM 75710144 Faked up EXPNUM 75710144 Faked up EXPNUM 75710144 90prime get_fwhm: self.fwhm = 4.71 Found 4 relevant rows in amp-corrections file. Found overlap: image x 4005 4016 and amp range 2016 4031 and image y 15 85 and amp range 0 2047 Range in image: x 0 12 , y 0 71 (with image size 12 x 71) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Faked up EXPNUM 75440181 Faked up EXPNUM 75440181 Faked up EXPNUM 75440181 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3829 3970 and amp range 2016 4031 and image y 3947 4080 and amp range 2048 4095 Range in image: x 0 142 , y 0 134 (with image size 142 x 134) dzp -0.0036899033 -> scaling image by 0.9966072419211972 Stage tims : Wall: 4.54 s, CPU: 1.05 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.246076 MB Stage tims finished: 2020-06-15T07:16:24.948470 Faked up EXPNUM 79280121 Faked up EXPNUM 79280121 Faked up EXPNUM 79280121 Resources for stage tims : 4.533 s worker CPU, 19.283 s worker Wall, Wall: 4.545 s, Cores in use: 1.23, Total efficiency (on 8 cores): 15.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T07:16:25.046207 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01600.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01715.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/reference-custom-283766p47755.fits Stage refs : Wall: 7.51 s, CPU: 7.02 s, VmPeak: 1039 MB, VmSize: 1033 MB, VmRSS: 265 MB, VmData: 297 MB, maxrss: 0.271456 MB Stage refs finished: 2020-06-15T07:16:32.553025 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.508 s, Cores in use: 0.94, Total efficiency (on 8 cores): 11.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T07:16:32.629980 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/outlier-mask-custom-283766p47755.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/outliers-pre-custom-283766p47755.jpg Image ksb_160703_084447_ooi_g_ls9-CCD1 g : masking 117 positive outlier pixels and 0 negative outlier pixels Image ksb_160516_111128_ooi_r_ls9-CCD1 r : masking 521 positive outlier pixels and 0 negative outlier pixels Image ksb_160605_102246_ooi_r_ls9-CCD4 r : masking 143 positive outlier pixels and 0 negative outlier pixels Image k4m_170910_063709_ooi_zd_ls9-CCD2 z : masking 555 positive outlier pixels and 301 negative outlier pixels Image k4m_160516_110920_ooi_zd_ls9-CCD1 z : masking 1418 positive outlier pixels and 0 negative outlier pixels Image k4m_170901_073933_ooi_zd_ls9-CCD4 z : masking 296 positive outlier pixels and 276 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/outlier-mask-custom-283766p47755.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/outliers-post-custom-283766p47755.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/outliers-masked-pos-custom-283766p47755.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/outliers-masked-neg-custom-283766p47755.jpg Stage outliers : Wall: 0.86 s, CPU: 0.70 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 279 MB, VmData: 309 MB, maxrss: 0.286148 MB Stage outliers finished: 2020-06-15T07:16:33.494551 Resources for stage outliers : 0.712 s worker CPU, 0.713 s worker Wall, Wall: 0.866 s, Cores in use: 1.63, Total efficiency (on 8 cores): 20.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T07:16:33.526573 Stage halos : Wall: 0.30 s, CPU: 0.30 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 280 MB, VmData: 310 MB, maxrss: 0.286508 MB Stage halos finished: 2020-06-15T07:16:33.830979 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.306 s, Cores in use: 0.98, Total efficiency (on 8 cores): 12.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-15T07:16:33.929592 PSF sigmas in coadd pixels: ['2.38', '2.26', '1.96', '3.47', '1.86'] Using average PSF sigma 2.386099716205719 Gaussian PSF norm 0.11822422586028974 vs pixelized 0.10073429 average tim pixel scale / coadd scale: 1.72961427730629 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.57', '1.79', '1.92', '2.27'] Using average PSF sigma 2.1377004448112933 Gaussian PSF norm 0.13196179682639317 vs pixelized 0.10414156 average tim pixel scale / coadd scale: 1.7293026452645914 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.43', '1.57', '1.42', '1.78'] Using average PSF sigma 1.5496778726011593 Gaussian PSF norm 0.18203447100937015 vs pixelized 0.15116094 average tim pixel scale / coadd scale: 0.990950527448982 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.17 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 282 MB, VmData: 310 MB, maxrss: 0.28862 MB Stage fit_on_coadds finished: 2020-06-15T07:16:34.119817 Resources for stage fit_on_coadds : 0.176 s worker CPU, 0.176 s worker Wall, Wall: 0.192 s, Cores in use: 1.79, Total efficiency (on 8 cores): 22.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T07:16:34.135381 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 33 potential peaks Of 33 potential peaks: 13 in veto map, 2 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 39 potential peaks Of 39 potential peaks: 36 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 29 potential peaks Of 29 potential peaks: 27 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 47 potential peaks Of 47 potential peaks: 43 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 52 potential peaks Of 52 potential peaks: 46 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 20 new sources Median coadd sky for g : 0.0003402069 Median coadd sky for r : 0.0008809709 Median coadd sky for z : -0.00035247818 Stage srcs : Wall: 0.69 s, CPU: 0.66 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 282 MB, VmData: 310 MB, maxrss: 0.28912 MB Stage srcs finished: 2020-06-15T07:16:34.824863 Resources for stage srcs : 0.062 s worker CPU, 0.062 s worker Wall, Wall: 0.691 s, Cores in use: 1.04, Total efficiency (on 8 cores): 13.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T07:16:34.842988 Blob 1 of 8, id: 3, sources: 18, size: 207x161, npix 22868, brick X: 0,207, Y: 40,201, one pixel: 116 40 Blob 2 of 8, id: 7, sources: 2, size: 54x24, npix 869, brick X: 0,54, Y: 215,239, one pixel: 19 215 Blob 3 of 8, id: 0, sources: 3, size: 42x28, npix 838, brick X: 50,92, Y: 0,28, one pixel: 54 0 Blob 4 of 8, id: 1, sources: 2, size: 41x23, npix 679, brick X: 155,196, Y: 0,23, one pixel: 159 0 Blob 5 of 8, id: 4, sources: 1, size: 26x25, npix 427, brick X: 205,231, Y: 43,68, one pixel: 215 43 Blob 6 of 8, id: 6, sources: 1, size: 26x25, npix 414, brick X: 189,215, Y: 210,235, one pixel: 200 210 Blob 7 of 8, id: 2, sources: 1, size: 22x21, npix 261, brick X: 90,112, Y: 20,41, one pixel: 99 20 Blob 8 of 8, id: 5, sources: 1, size: 21x21, npix 261, brick X: 177,198, Y: 73,94, one pixel: 186 73 Blob 8 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 802 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139716 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.77757, 47.76455), pm (-4.5, -2.2), parallax 0.562 with NanoMaggies: g=17.1, r=16.7, z=16.3 Reset brightness to NanoMaggies: g=17.1, r=16.5, z=16.3 Measuring 1 iterative sources Blob 2 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 808 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139596 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.76064, 47.74666), pm (0.6, -10.5), parallax 0.547 with NanoMaggies: g=17.8, r=17.2, z=16.8 Reset brightness to NanoMaggies: g=17.6, r=16.9, z=16.7 Blob 4 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 808 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.13918 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (283.77195, 47.74672), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=19, r=18.1, z=17.6 Reset brightness to NanoMaggies: g=19.3, r=18.2, z=17.6 Blob 3 finished, total: Wall: 0.32 s, CPU: 0.31 s, VmPeak: 810 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139704 MB Blob 6 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 799 MB, VmSize: 712 MB, VmRSS: 136 MB, VmData: 178 MB, maxrss: 0.139648 MB Blob 7 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 811 MB, VmSize: 712 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.139824 MB Blob 5 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 812 MB, VmSize: 712 MB, VmRSS: 137 MB, VmData: 178 MB, maxrss: 0.140072 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.676862, ee1=0.025766, ee2=-0.0446365 Measuring 3 iterative sources Blob 1 finished, total: Wall: 13.09 s, CPU: 13.07 s, VmPeak: 808 MB, VmSize: 714 MB, VmRSS: 147 MB, VmData: 180 MB, maxrss: 0.15074 MB Old catalog: 37 New catalog: 29 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/blobs-custom-283766p47755.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/metrics/cus/all-models-custom-283766p47755.fits Stage fitblobs : Wall: 14.39 s, CPU: 0.42 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 282 MB, VmData: 310 MB, maxrss: 0.289268 MB Stage fitblobs finished: 2020-06-15T07:16:49.230260 Resources for stage fitblobs : 15.256 s worker CPU, 15.304 s worker Wall, Wall: 14.389 s, Cores in use: 1.09, Total efficiency (on 8 cores): 13.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T07:16:49.246994 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/tmp-legacysurvey-custom-283766p47755-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/tmp-legacysurvey-custom-283766p47755-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/tmp-legacysurvey-custom-283766p47755-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/tmp-legacysurvey-custom-283766p47755-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-resid.jpg Stage coadds : Wall: 1.17 s, CPU: 0.54 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.28966 MB Stage coadds finished: 2020-06-15T07:16:50.416722 Resources for stage coadds : 1.992 s worker CPU, 2.652 s worker Wall, Wall: 1.171 s, Cores in use: 2.16, Total efficiency (on 8 cores): 27.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T07:16:50.435267 Cut to 1 unWISE tiles Reading WISE tile 2834p484 band 1 Reading WISE tile 2834p484 band 2 Reading WISE tile 2834p484 band 3 Reading WISE tile 2834p484 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 811 MB, VmSize: 788 MB, VmRSS: 140 MB, VmData: 169 MB, maxrss: 0.204284 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 794 MB, VmRSS: 146 MB, VmData: 176 MB, maxrss: 0.186692 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 810 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 170 MB, maxrss: 0.202612 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/283/2834p484/unwise-2834p484-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 799 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.206416 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/tmp-legacysurvey-custom-283766p47755-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/tmp-legacysurvey-custom-283766p47755-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.68 s, CPU: 0.48 s, VmPeak: 1042 MB, VmSize: 1042 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.29024 MB Stage wise_forced finished: 2020-06-15T07:16:52.111698 Resources for stage wise_forced : 3.135 s worker CPU, 3.600 s worker Wall, Wall: 1.678 s, Cores in use: 2.16, Total efficiency (on 8 cores): 27.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T07:16:52.131199 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/coadd/cus/custom-283766p47755/legacysurvey-custom-283766p47755-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/tractor-i/cus/tractor-custom-283766p47755.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/tractor/cus/tractor-custom-283766p47755.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/tractor/cus/brick-custom-283766p47755.sha256sum Stage writecat : Wall: 0.73 s, CPU: 0.52 s, VmPeak: 1175 MB, VmSize: 1047 MB, VmRSS: 285 MB, VmData: 310 MB, maxrss: 0.423364 MB Stage writecat finished: 2020-06-15T07:16:52.858376 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.728 s, Cores in use: 0.72, Total efficiency (on 8 cores): 9.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/283/PGC2303812/PGC2303812-largegalaxy-writecat.p All done: 25.868 s worker CPU, 41.794 s worker Wall, Wall: 32.485 s, Cores in use: 1.17, Total efficiency (on 8 cores): 14.6 % Finished galaxy PGC2303812 in 0.574 minutes.