Started working on galaxy PGC2410813 at Sun Jun 7 18:09:53 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.647833 52.2693288 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T18:09:55.368299 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '263.647833', '52.2693288', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 263.647833 52.2693288 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 263.647833 52.2693288 Starting process 27572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB Starting process 27573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB Starting process 27574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB Starting process 27575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T18:09:55.982483 Keeping 13 CCDs: k4m_160529_083553_ooi_zd_ls9.fits.fz k4m_160529_083553_ooi_zd_ls9-CCD4 z exptime 80.104 propid 2016A-0453 seeing 1.22 MJD 57537.358 object MzLS_658202_z k4m_160527_084037_ooi_zd_ls9.fits.fz k4m_160527_084037_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 0.82 MJD 57535.362 object MzLS_659741_z k4m_170519_104330_ooi_zd_ls9.fits.fz k4m_170519_104330_ooi_zd_ls9-CCD3 z exptime 80.104 propid 2016A-0453 seeing 1.16 MJD 57892.447 object MzLS_658973_z ksb_170523_091415_ooi_g_ls9.fits.fz ksb_170523_091415_ooi_g_ls9-CCD2 g exptime 106.057 propid 2015A-0801 seeing 1.44 MJD 57896.385 object 30513 ksb_170520_105916_ooi_r_ls9.fits.fz ksb_170520_105916_ooi_r_ls9-CCD2 r exptime 250.0 propid 2015A-0801 seeing 2.41 MJD 57893.458 object 30513 ksb_160708_073216_ooi_g_ls9.fits.fz ksb_160708_073216_ooi_g_ls9-CCD3 g exptime 156.9 propid BASS seeing 1.89 MJD 57577.314 object 29402 ksb_160712_060530_ooi_r_ls9.fits.fz ksb_160712_060530_ooi_r_ls9-CCD3 r exptime 149.4 propid BASS seeing 2.11 MJD 57581.254 object 29402 ksb_170523_091640_ooi_g_ls9.fits.fz ksb_170523_091640_ooi_g_ls9-CCD1 g exptime 107.204 propid 2015A-0801 seeing 1.73 MJD 57896.387 object 29403 ksb_170501_094339_ooi_r_ls9.fits.fz ksb_170501_094339_ooi_r_ls9-CCD1 r exptime 57.772 propid BASS seeing 1.24 MJD 57874.405 object 29403 ksb_160609_062013_ooi_r_ls9.fits.fz ksb_160609_062013_ooi_r_ls9-CCD1 r exptime 76.3 propid BASS seeing 1.22 MJD 57548.264 object 29401 ksb_170528_101624_ooi_g_ls9.fits.fz ksb_170528_101624_ooi_g_ls9-CCD1 g exptime 115.359 propid 2015A-0801 seeing 1.71 MJD 57901.428 object 29401 ksb_170523_093537_ooi_g_ls9.fits.fz ksb_170523_093537_ooi_g_ls9-CCD4 g exptime 115.5 propid 2015A-0801 seeing 1.61 MJD 57896.400 object 30523 ksb_170520_111826_ooi_r_ls9.fits.fz ksb_170520_111826_ooi_r_ls9-CCD4 r exptime 250.0 propid 2015A-0801 seeing 2.17 MJD 57893.471 object 30523 mosaic get_fwhm: self.fwhm = 4.45 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3461 3751 and amp range 2006 4053 and image y 1372 1663 and amp range 0 2039 Range in image: x 0 291 , y 0 292 (with image size 291 x 292) dzp -0.016180232 -> scaling image by 0.9852079488029655 Faked up EXPNUM 78960152 Faked up EXPNUM 78960152 Faked up EXPNUM 78960152 90prime get_fwhm: self.fwhm = 3.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3624 3793 and amp range 2016 4031 and image y 15 99 and amp range 0 2047 Range in image: x 0 170 , y 0 85 (with image size 170 x 85) dzp 0.01918938 -> scaling image by 1.017831182878158 mosaic get_fwhm: self.fwhm = 4.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1905 2199 and amp range 0 2047 and image y 2461 2753 and amp range 2022 4060 Range in image: x 0 143 , y 0 293 (with image size 295 x 293) dzp 0.0033053984 -> scaling image by 1.0030490232713904 Found overlap: image x 1905 2199 and amp range 2048 4095 and image y 2461 2753 and amp range 2022 4060 Range in image: x 143 295 , y 0 293 (with image size 295 x 293) dzp -0.0028835079 -> scaling image by 0.9973477146455455 Faked up EXPNUM 75770094 Faked up EXPNUM 75770094 Faked up EXPNUM 75770094 90prime get_fwhm: self.fwhm = 4.17 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3892 4016 and amp range 2016 4031 and image y 146 313 and amp range 0 2047 Range in image: x 0 125 , y 0 168 (with image size 125 x 168) dzp -0.0022715968 -> scaling image by 0.9979099691834846 Faked up EXPNUM 78930208 Faked up EXPNUM 78930208 Faked up EXPNUM 78930208 90prime get_fwhm: self.fwhm = 5.31 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3607 3777 and amp range 2016 4031 and image y 15 118 and amp range 0 2047 Range in image: x 0 171 , y 0 104 (with image size 171 x 104) dzp 0.032776505 -> scaling image by 1.0306485625912574 Faked up EXPNUM 75810072 Faked up EXPNUM 75810072 Faked up EXPNUM 75810072 90prime get_fwhm: self.fwhm = 4.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3880 4016 and amp range 2016 4031 and image y 156 323 and amp range 0 2047 Range in image: x 0 137 , y 0 168 (with image size 137 x 168) dzp 0.004245165 -> scaling image by 1.0039175950705865 mosaic get_fwhm: self.fwhm = 3.15 Found 4 relevant rows in amp-corrections file. Found overlap: image x 751 1045 and amp range 0 2005 and image y 2476 2773 and amp range 2040 4078 Range in image: x 0 295 , y 0 298 (with image size 295 x 298) dzp 0.0022078273 -> scaling image by 1.0020355530120029 Faked up EXPNUM 79010171 Faked up EXPNUM 79010171 Faked up EXPNUM 79010171 90prime get_fwhm: self.fwhm = 3.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1870 2038 and amp range 0 2015 and image y 2632 2800 and amp range 2048 4095 Range in image: x 0 146 , y 0 169 (with image size 169 x 169) dzp -0.034377232 -> scaling image by 0.9688334104074875 Found overlap: image x 1870 2038 and amp range 2016 4031 and image y 2632 2800 and amp range 2048 4095 Range in image: x 146 169 , y 0 169 (with image size 169 x 169) dzp 0.020521455 -> scaling image by 1.0190807119283773 Faked up EXPNUM 75480095 Faked up EXPNUM 75480095 Faked up EXPNUM 75480095 90prime get_fwhm: self.fwhm = 2.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1859 2027 and amp range 0 2015 and image y 2632 2800 and amp range 2048 4095 Range in image: x 0 157 , y 0 169 (with image size 169 x 169) dzp -0.00015519658 -> scaling image by 0.9998570688798908 Found overlap: image x 1859 2027 and amp range 2016 4031 and image y 2632 2800 and amp range 2048 4095 Range in image: x 157 169 , y 0 169 (with image size 169 x 169) dzp 0.01301769 -> scaling image by 1.0120619004021345 Faked up EXPNUM 78960153 Faked up EXPNUM 78960153 Faked up EXPNUM 78960153 Faked up EXPNUM 78930212 Faked up EXPNUM 78930212 Faked up EXPNUM 78930212 90prime get_fwhm: self.fwhm = 4.79 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3689 3857 and amp range 2016 4031 and image y 3635 3804 and amp range 2048 4095 Range in image: x 0 169 , y 0 170 (with image size 169 x 170) dzp 0.0004463038 -> scaling image by 1.0004111454932232 Faked up EXPNUM 78740226 Faked up EXPNUM 78740226 Faked up EXPNUM 78740226 Faked up EXPNUM 78960160 Faked up EXPNUM 78960160 Faked up EXPNUM 78960160 90prime get_fwhm: self.fwhm = 3.55 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3694 3863 and amp range 2016 4031 and image y 3622 3791 and amp range 2048 4095 Range in image: x 0 170 , y 0 170 (with image size 170 x 170) dzp -0.0030897402 -> scaling image by 0.9971582894587289 Stage tims : Wall: 7.46 s, CPU: 0.97 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 172 MB, VmData: 206 MB, maxrss: 0.566564 MB Stage tims finished: 2020-06-07T18:10:03.446642 Resources for stage tims : 3.819 s worker CPU, 20.144 s worker Wall, Wall: 7.465 s, Cores in use: 0.64, Total efficiency (on 4 cores): 16.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T18:10:03.472022 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01376.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01273.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01375.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/reference-custom-263647p52269.fits Stage refs : Wall: 4.52 s, CPU: 3.15 s, VmPeak: 979 MB, VmSize: 973 MB, VmRSS: 204 MB, VmData: 237 MB, maxrss: 0.566564 MB Stage refs finished: 2020-06-07T18:10:07.993943 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.523 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T18:10:07.995580 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/outlier-mask-custom-263647p52269.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/outliers-pre-custom-263647p52269.jpg Image ksb_170528_101624_ooi_g_ls9-CCD1 g : masking 204 positive outlier pixels and 0 negative outlier pixels Image ksb_160712_060530_ooi_r_ls9-CCD3 r : masking 782 positive outlier pixels and 0 negative outlier pixels Image k4m_160529_083553_ooi_zd_ls9-CCD4 z : masking 904 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/outlier-mask-custom-263647p52269.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/outliers-post-custom-263647p52269.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/outliers-masked-pos-custom-263647p52269.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/outliers-masked-neg-custom-263647p52269.jpg Stage outliers : Wall: 1.14 s, CPU: 0.82 s, VmPeak: 983 MB, VmSize: 983 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.566564 MB Stage outliers finished: 2020-06-07T18:10:09.133995 Resources for stage outliers : 1.074 s worker CPU, 1.102 s worker Wall, Wall: 1.139 s, Cores in use: 1.66, Total efficiency (on 4 cores): 41.5 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T18:10:09.135699 Stage halos : Wall: 0.41 s, CPU: 0.39 s, VmPeak: 983 MB, VmSize: 983 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.566564 MB Stage halos finished: 2020-06-07T18:10:09.548920 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.414 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.6 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T18:10:09.550948 PSF sigmas in coadd pixels: ['2.33', '3.07', '2.77', '2.61'] Using average PSF sigma 2.697078709795191 Gaussian PSF norm 0.10459271757601013 vs pixelized 0.08989845 average tim pixel scale / coadd scale: 1.7293955220304116 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-copsf-g.fits.fz PSF sigmas in coadd pixels: ['3.91', '3.42', '1.98', '3.53'] Using average PSF sigma 3.2089063024655085 Gaussian PSF norm 0.08790994974117364 vs pixelized 0.0692539 average tim pixel scale / coadd scale: 1.7294417104758464 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.98', '1.33', '1.88'] Using average PSF sigma 1.7273535956344463 Gaussian PSF norm 0.16331039139109588 vs pixelized 0.13263327 average tim pixel scale / coadd scale: 0.9908725552879387 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.22 s, VmPeak: 983 MB, VmSize: 983 MB, VmRSS: 224 MB, VmData: 252 MB, maxrss: 0.566564 MB Stage fit_on_coadds finished: 2020-06-07T18:10:09.813087 Resources for stage fit_on_coadds : 0.261 s worker CPU, 0.277 s worker Wall, Wall: 0.263 s, Cores in use: 1.84, Total efficiency (on 4 cores): 46.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T18:10:09.815946 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 46 potential peaks Of 46 potential peaks: 18 in veto map, 6 cut by saddle test, 0 cut by aper test, 22 kept SED z : 22 new peaks Found 71 potential peaks Of 71 potential peaks: 66 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 87 potential peaks Of 87 potential peaks: 78 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 106 potential peaks Of 106 potential peaks: 99 in veto map, 6 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 153 potential peaks Of 153 potential peaks: 145 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 28 new sources Median coadd sky for g : 0.00034508493 Median coadd sky for r : 0.0010697606 Median coadd sky for z : 1.3659013e-05 Stage srcs : Wall: 0.74 s, CPU: 0.68 s, VmPeak: 983 MB, VmSize: 983 MB, VmRSS: 225 MB, VmData: 252 MB, maxrss: 0.566564 MB Stage srcs finished: 2020-06-07T18:10:10.554685 Resources for stage srcs : 0.143 s worker CPU, 0.143 s worker Wall, Wall: 0.740 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/PGC2410813-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T18:10:10.568516 Blob 1 of 7, id: 1, sources: 23, size: 287x287, npix 49578, brick X: 0,287, Y: 0,287, one pixel: 146 0 Blob 2 of 7, id: 2, sources: 5, size: 86x88, npix 4364, brick X: 0,86, Y: 18,106, one pixel: 36 18 Blob 3 of 7, id: 5, sources: 1, size: 47x47, npix 1534, brick X: 240,287, Y: 214,261, one pixel: 259 214 Blob 4 of 7, id: 4, sources: 1, size: 33x45, npix 1143, brick X: 254,287, Y: 160,205, one pixel: 269 160 Blob 5 of 7, id: 3, sources: 2, size: 31x52, npix 1130, brick X: 0,31, Y: 112,164, one pixel: 14 112 Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143284 MB Blob 6 of 7, id: 6, sources: 1, size: 26x23, npix 357, brick X: 212,238, Y: 245,268, one pixel: 222 245 Blob 4 finished, total: Wall: 1.45 s, CPU: 1.45 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143176 MB Blob 7 of 7, id: 0, sources: 1, size: 22x20, npix 343, brick X: 0,22, Y: 0,20, one pixel: 0 0 Blob 6 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143176 MB Blob 7 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 807 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143176 MB Blob 5 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 808 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143284 MB Blob 2 finished, total: Wall: 4.28 s, CPU: 4.28 s, VmPeak: 809 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143724 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (263.62958, 52.26717), pm (-8.0, -7.9), parallax 1.754 with NanoMaggies: g=15.8, r=14.6, z=13.8 Reset brightness to NanoMaggies: g=15, r=14.1, z=13.7 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.55004, ee1=0.0868188, ee2=0.185017 Measuring 5 iterative sources Blob 1 finished, total: Wall: 22.34 s, CPU: 22.34 s, VmPeak: 815 MB, VmSize: 751 MB, VmRSS: 188 MB, VmData: 217 MB, maxrss: 0.192212 MB Old catalog: 40 New catalog: 34 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/blobs-custom-263647p52269.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/metrics/cus/all-models-custom-263647p52269.fits Stage fitblobs : Wall: 22.92 s, CPU: 0.52 s, VmPeak: 983 MB, VmSize: 970 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.566564 MB Stage fitblobs finished: 2020-06-07T18:10:33.491282 Resources for stage fitblobs : 31.448 s worker CPU, 31.518 s worker Wall, Wall: 22.926 s, Cores in use: 1.39, Total efficiency (on 4 cores): 34.9 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T18:10:33.494855 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/tmp-legacysurvey-custom-263647p52269-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/tmp-legacysurvey-custom-263647p52269-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/tmp-legacysurvey-custom-263647p52269-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/tmp-legacysurvey-custom-263647p52269-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-resid.jpg Stage coadds : Wall: 1.37 s, CPU: 0.57 s, VmPeak: 983 MB, VmSize: 970 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.566564 MB Stage coadds finished: 2020-06-07T18:10:34.867527 Resources for stage coadds : 2.421 s worker CPU, 2.563 s worker Wall, Wall: 1.374 s, Cores in use: 2.18, Total efficiency (on 4 cores): 54.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T18:10:34.869169 Cut to 2 unWISE tiles Reading WISE tile 2638p530 band 1 Reading WISE tile 2638p530 band 2 Reading WISE tile 2638p530 band 4 Reading WISE tile 2638p530 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2646p514 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2646p514 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2646p514 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/263/2638p530/unwise-2638p530-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2646p514 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 808 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.20858 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.15 s, CPU: 0.15 s, VmPeak: 815 MB, VmSize: 802 MB, VmRSS: 162 MB, VmData: 184 MB, maxrss: 0.210156 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 807 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.206944 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 809 MB, VmSize: 792 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.212348 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/tmp-legacysurvey-custom-263647p52269-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/tmp-legacysurvey-custom-263647p52269-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.03 s, CPU: 0.59 s, VmPeak: 983 MB, VmSize: 970 MB, VmRSS: 216 MB, VmData: 242 MB, maxrss: 0.566564 MB Stage wise_forced finished: 2020-06-07T18:10:38.900749 Resources for stage wise_forced : 8.758 s worker CPU, 11.644 s worker Wall, Wall: 4.033 s, Cores in use: 2.32, Total efficiency (on 4 cores): 57.9 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T18:10:38.902594 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/coadd/cus/custom-263647p52269/legacysurvey-custom-263647p52269-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/tractor-i/cus/tractor-custom-263647p52269.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/tractor/cus/tractor-custom-263647p52269.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/263/PGC2410813/tractor/cus/brick-custom-263647p52269.sha256sum Stage writecat : Wall: 0.92 s, CPU: 0.55 s, VmPeak: 1102 MB, VmSize: 974 MB, VmRSS: 218 MB, VmData: 242 MB, maxrss: 0.566564 MB Stage writecat finished: 2020-06-07T18:10:39.820227 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.919 s, Cores in use: 0.60, Total efficiency (on 4 cores): 14.9 % Stage writecat finished All done: 47.925 s worker CPU, 67.394 s worker Wall, Wall: 43.843 s, Cores in use: 1.29, Total efficiency (on 4 cores): 32.2 % Finished galaxy PGC2410813 in 0.780 minutes.