Started working on galaxy DR8-2656p510-2378 at Mon Jun 15 08:47:40 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 265.5385301326375 51.018111594404374 --width 115 --height 115 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-15T08:47:41.457251 legacypipe git version: DR9.5.2-29-gb5a6d7b1 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '265.5385301326375', '51.018111594404374', '--width', '115', '--height', '115', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 265.5385301326375 51.018111594404374 --width 115 --height 115 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 265.5385301326375 51.018111594404374 Starting process 45731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 45732 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057412 MB Starting process 45733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05748 MB Starting process 45734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057416 MB Starting process 45735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057484 MB Starting process 45736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057488 MB Starting process 45737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057488 MB Starting process 45738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057424 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-15T08:47:42.382553 Keeping 11 CCDs: k4m_160524_091011_ooi_zd_ls9.fits.fz k4m_160524_091011_ooi_zd_ls9-CCD2 z exptime 80.106 propid 2016A-0453 seeing 1.26 MJD 57532.382 object MzLS_653510_z k4m_170518_094219_ooi_zd_ls9.fits.fz k4m_170518_094219_ooi_zd_ls9-CCD3 z exptime 102.106 propid 2016A-0453 seeing 0.96 MJD 57891.404 object MzLS_654300_z k4m_170519_105122_ooi_zd_ls9.fits.fz k4m_170519_105122_ooi_zd_ls9-CCD1 z exptime 111.107 propid 2016A-0453 seeing 1.37 MJD 57892.452 object MzLS_654301_z k4m_160518_092136_ooi_zd_ls9.fits.fz k4m_160518_092136_ooi_zd_ls9-CCD4 z exptime 113.103 propid 2016A-0453 seeing 1.02 MJD 57526.390 object MzLS_652716_z ksb_160609_062439_ooi_r_ls9.fits.fz ksb_160609_062439_ooi_r_ls9-CCD1 r exptime 76.9 propid BASS seeing 1.25 MJD 57548.267 object 28281 ksb_170528_102730_ooi_g_ls9.fits.fz ksb_170528_102730_ooi_g_ls9-CCD1 g exptime 134.552 propid 2015A-0801 seeing 1.65 MJD 57901.436 object 28281 ksb_160711_070206_ooi_r_ls9.fits.fz ksb_160711_070206_ooi_r_ls9-CCD2 r exptime 68.9 propid BASS seeing 1.74 MJD 57580.293 object 28282 ksb_160707_083943_ooi_g_ls9.fits.fz ksb_160707_083943_ooi_g_ls9-CCD2 g exptime 231.8 propid BASS seeing 2.53 MJD 57576.361 object 28282 ksb_180510_084641_ooi_g_ls9.fits.fz ksb_180510_084641_ooi_g_ls9-CCD3 g exptime 128.601 propid NOTBASS seeing 1.40 MJD 58248.366 object 28293 ksb_170624_060128_ooi_r_ls9.fits.fz ksb_170624_060128_ooi_r_ls9-CCD3 r exptime 93.912 propid BASS seeing 1.14 MJD 57928.251 object 28293 ksb_170624_055205_ooi_r_ls9.fits.fz ksb_170624_055205_ooi_r_ls9-CCD1 r exptime 175.65 propid BASS seeing 1.35 MJD 57928.245 object 28283 mosaic get_fwhm: self.fwhm = 3.93 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3603 3722 and amp range 2048 4095 and image y 160 276 and amp range 0 2021 Range in image: x 0 120 , y 0 117 (with image size 120 x 117) dzp -0.0006399284 -> scaling image by 0.9994107778325068 Faked up EXPNUM 79010175 Faked up EXPNUM 79010175 Faked up EXPNUM 79010175 90prime get_fwhm: self.fwhm = 3.65 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3902 3970 and amp range 2016 4031 and image y 1940 2008 and amp range 0 2047 Range in image: x 0 69 , y 0 69 (with image size 69 x 69) dzp -0.011406615 -> scaling image by 0.9895491130016149 Faked up EXPNUM 75480097 Faked up EXPNUM 75480097 Faked up EXPNUM 75480097 90prime get_fwhm: self.fwhm = 2.77 Found 4 relevant rows in amp-corrections file. Found overlap: image x 3893 3961 and amp range 2016 4031 and image y 1940 2008 and amp range 0 2047 Range in image: x 0 69 , y 0 69 (with image size 69 x 69) dzp -0.0041296566 -> scaling image by 0.9962036700684744 mosaic get_fwhm: self.fwhm = 4.87 Found 4 relevant rows in amp-corrections file. Found overlap: image x 884 1000 and amp range 0 2047 and image y 1824 1941 and amp range 0 2039 Range in image: x 0 117 , y 0 118 (with image size 117 x 118) dzp -0.006320339 -> scaling image by 0.9941956631368829 mosaic get_fwhm: self.fwhm = 3.69 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2489 2606 and amp range 2006 4053 and image y 3943 4063 and amp range 2040 4078 Range in image: x 0 118 , y 0 121 (with image size 118 x 121) dzp -0.0021409686 -> scaling image by 0.9980300379995196 mosaic get_fwhm: self.fwhm = 5.29 Found 4 relevant rows in amp-corrections file. Found overlap: image x 2440 2557 and amp range 2006 4053 and image y 275 395 and amp range 0 2039 Range in image: x 0 118 , y 0 121 (with image size 118 x 121) dzp 0.000620604 -> scaling image by 1.0005717608254892 Faked up EXPNUM 75800084 Faked up EXPNUM 75800084 Faked up EXPNUM 75800084 90prime get_fwhm: self.fwhm = 3.83 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1723 1790 and amp range 0 2015 and image y 3912 3980 and amp range 2048 4095 Range in image: x 0 68 , y 0 69 (with image size 68 x 69) dzp 0.016961161 -> scaling image by 1.0157444649385616 Faked up EXPNUM 75760086 Faked up EXPNUM 75760086 Faked up EXPNUM 75760086 90prime get_fwhm: self.fwhm = 5.59 WARNING: image median 0.0073462063 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 1730 1798 and amp range 0 2015 and image y 3899 3966 and amp range 2048 4095 Range in image: x 0 69 , y 0 68 (with image size 69 x 68) dzp 0.01693853 -> scaling image by 1.015723292931903 Faked up EXPNUM 82480140 Faked up EXPNUM 82480140 Faked up EXPNUM 82480140 90prime get_fwhm: self.fwhm = 3.09 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1955 2022 and amp range 0 2015 and image y 3473 3541 and amp range 2048 4095 Range in image: x 0 61 , y 0 69 (with image size 68 x 69) dzp -0.027600318 -> scaling image by 0.9748995562775561 Found overlap: image x 1955 2022 and amp range 2016 4031 and image y 3473 3541 and amp range 2048 4095 Range in image: x 61 68 , y 0 69 (with image size 68 x 69) dzp -0.01723723 -> scaling image by 0.9842492857213068 Faked up EXPNUM 79280061 Faked up EXPNUM 79280061 Faked up EXPNUM 79280061 90prime get_fwhm: self.fwhm = 2.51 Found 4 relevant rows in amp-corrections file. Found overlap: image x 1954 2022 and amp range 0 2015 and image y 3486 3554 and amp range 2048 4095 Range in image: x 0 62 , y 0 69 (with image size 69 x 69) dzp -0.07725406 -> scaling image by 0.9313188157188347 Found overlap: image x 1954 2022 and amp range 2016 4031 and image y 3486 3554 and amp range 2048 4095 Range in image: x 62 69 , y 0 69 (with image size 69 x 69) dzp -0.035697103 -> scaling image by 0.9676563679910417 Faked up EXPNUM 79280058 Faked up EXPNUM 79280058 Faked up EXPNUM 79280058 90prime get_fwhm: self.fwhm = 2.99 WARNING: image median 0.014348516 is more than 1 sigma away from zero! Found 4 relevant rows in amp-corrections file. Found overlap: image x 1858 1926 and amp range 0 2015 and image y 15 68 and amp range 0 2047 Range in image: x 0 69 , y 0 54 (with image size 69 x 54) dzp -0.024106435 -> scaling image by 0.9780418215011345 Stage tims : Wall: 4.09 s, CPU: 1.08 s, VmPeak: 942 MB, VmSize: 942 MB, VmRSS: 169 MB, VmData: 202 MB, maxrss: 0.262512 MB Stage tims finished: 2020-06-15T08:47:46.477471 Resources for stage tims : 3.988 s worker CPU, 16.149 s worker Wall, Wall: 4.096 s, Cores in use: 1.24, Total efficiency (on 8 cores): 15.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-15T08:47:47.186734 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01376.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01483.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/reference-custom-265538p51018.fits Stage refs : Wall: 4.07 s, CPU: 3.24 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 203 MB, VmData: 236 MB, maxrss: 0.262512 MB Stage refs finished: 2020-06-15T08:47:51.259722 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.074 s, Cores in use: 0.80, Total efficiency (on 8 cores): 9.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-06-15T08:47:51.292003 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/outlier-mask-custom-265538p51018.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/outliers-pre-custom-265538p51018.jpg Image k4m_170518_094219_ooi_zd_ls9-CCD3 z : masking 477 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/outlier-mask-custom-265538p51018.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/outliers-post-custom-265538p51018.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/outliers-masked-pos-custom-265538p51018.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/outliers-masked-neg-custom-265538p51018.jpg Stage outliers : Wall: 0.86 s, CPU: 0.72 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 208 MB, VmData: 239 MB, maxrss: 0.262512 MB Stage outliers finished: 2020-06-15T08:47:52.151291 Resources for stage outliers : 0.206 s worker CPU, 0.206 s worker Wall, Wall: 0.860 s, Cores in use: 1.08, Total efficiency (on 8 cores): 13.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-06-15T08:47:52.185338 Stage halos : Wall: 0.43 s, CPU: 0.42 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 209 MB, VmData: 239 MB, maxrss: 0.262512 MB Stage halos finished: 2020-06-15T08:47:52.612722 Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Warning: Stellar halo subtraction is only implemented for DECam Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.429 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-15T08:47:52.636111 PSF sigmas in coadd pixels: ['2.69', '4.11', '2.27'] Using average PSF sigma 3.024763224655411 Gaussian PSF norm 0.09326177648368333 vs pixelized 0.074614674 average tim pixel scale / coadd scale: 1.7295289386547248 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.04', '2.82', '1.85', '2.20'] Using average PSF sigma 2.2251477470612135 Gaussian PSF norm 0.12677575776549896 vs pixelized 0.11223059 average tim pixel scale / coadd scale: 1.7285840750231143 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.05', '1.56', '2.23', '1.66'] Using average PSF sigma 1.87432984310675 Gaussian PSF norm 0.1505043484269016 vs pixelized 0.118904345 average tim pixel scale / coadd scale: 0.9909244589703086 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.09 s, CPU: 0.06 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 210 MB, VmData: 239 MB, maxrss: 0.262512 MB Stage fit_on_coadds finished: 2020-06-15T08:47:52.726526 Resources for stage fit_on_coadds : 0.056 s worker CPU, 0.056 s worker Wall, Wall: 0.091 s, Cores in use: 1.32, Total efficiency (on 8 cores): 16.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-06-15T08:47:52.740788 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 7 potential peaks Of 7 potential peaks: 4 in veto map, 1 cut by saddle test, 0 cut by aper test, 2 kept SED z : 2 new peaks Found 7 potential peaks Of 7 potential peaks: 4 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 4 potential peaks Of 4 potential peaks: 3 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 6 potential peaks Of 6 potential peaks: 4 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 9 potential peaks Of 9 potential peaks: 7 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 2 new sources Median coadd sky for g : 0.00035047787 Median coadd sky for r : 0.00034889532 Median coadd sky for z : -0.00020270687 Stage srcs : Wall: 0.50 s, CPU: 0.49 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.262512 MB Stage srcs finished: 2020-06-15T08:47:53.245703 Resources for stage srcs : 0.021 s worker CPU, 0.021 s worker Wall, Wall: 0.506 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-15T08:47:53.268730 Blob 1 of 1, id: 0, sources: 4, size: 111x115, npix 9388, brick X: 2,113, Y: 0,115, one pixel: 43 0 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.467766, ee1=0.109543, ee2=-0.244325 Measuring 3 iterative sources Blob 1 finished, total: Wall: 5.23 s, CPU: 5.22 s, VmPeak: 806 MB, VmSize: 713 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143116 MB Old catalog: 7 New catalog: 7 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/blobs-custom-265538p51018.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/metrics/cus/all-models-custom-265538p51018.fits Stage fitblobs : Wall: 5.78 s, CPU: 0.46 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 211 MB, VmData: 239 MB, maxrss: 0.262512 MB Stage fitblobs finished: 2020-06-15T08:47:59.047441 Resources for stage fitblobs : 5.238 s worker CPU, 5.248 s worker Wall, Wall: 5.780 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-06-15T08:47:59.061757 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/tmp-legacysurvey-custom-265538p51018-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/tmp-legacysurvey-custom-265538p51018-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/tmp-legacysurvey-custom-265538p51018-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/tmp-legacysurvey-custom-265538p51018-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-resid.jpg Stage coadds : Wall: 1.44 s, CPU: 0.74 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.262512 MB Stage coadds finished: 2020-06-15T08:48:00.499120 Resources for stage coadds : 2.012 s worker CPU, 2.782 s worker Wall, Wall: 1.438 s, Cores in use: 1.91, Total efficiency (on 8 cores): 23.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-06-15T08:48:00.514783 Cut to 1 unWISE tiles Reading WISE tile 2646p514 band 2 Reading WISE tile 2646p514 band 3 Reading WISE tile 2646p514 band 1 Reading WISE tile 2646p514 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 800 MB, VmSize: 789 MB, VmRSS: 143 MB, VmData: 175 MB, maxrss: 0.183412 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 795 MB, VmSize: 783 MB, VmRSS: 135 MB, VmData: 169 MB, maxrss: 0.1982 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 791 MB, VmSize: 783 MB, VmRSS: 135 MB, VmData: 169 MB, maxrss: 0.19744 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/264/2646p514/unwise-2646p514-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 794 MB, VmSize: 783 MB, VmRSS: 135 MB, VmData: 169 MB, maxrss: 0.19854 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/tmp-legacysurvey-custom-265538p51018-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/tmp-legacysurvey-custom-265538p51018-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.83 s, CPU: 0.64 s, VmPeak: 985 MB, VmSize: 985 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.262512 MB Stage wise_forced finished: 2020-06-15T08:48:02.348893 Resources for stage wise_forced : 3.044 s worker CPU, 3.428 s worker Wall, Wall: 1.835 s, Cores in use: 2.01, Total efficiency (on 8 cores): 25.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-06-15T08:48:02.363168 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/coadd/cus/custom-265538p51018/legacysurvey-custom-265538p51018-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/tractor-i/cus/tractor-custom-265538p51018.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/tractor/cus/tractor-custom-265538p51018.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/tractor/cus/brick-custom-265538p51018.sha256sum Stage writecat : Wall: 0.98 s, CPU: 0.69 s, VmPeak: 1117 MB, VmSize: 989 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.350696 MB Stage writecat finished: 2020-06-15T08:48:03.345125 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.983 s, Cores in use: 0.70, Total efficiency (on 8 cores): 8.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/265/DR8-2656p510-2378/DR8-2656p510-2378-largegalaxy-writecat.p All done: 14.569 s worker CPU, 27.895 s worker Wall, Wall: 20.998 s, Cores in use: 1.11, Total efficiency (on 8 cores): 13.8 % Finished galaxy DR8-2656p510-2378 in 0.388 minutes.