Started working on galaxy PGC1848733 at Fri Jun 5 04:21:35 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.5564925 28.876075699999998 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-05T04:21:36.023182 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.5564925', '28.876075699999998', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.5564925 28.876075699999998 --width 245 --height 245 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.5564925 28.876075699999998 Starting process 53587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 53588 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 53589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 53590 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-05T04:21:41.247165 Keeping 10 CCDs: c4d_180917_020745_ooi_z_ls9.fits.fz c4d_180917_020745_ooi_z_ls9-N14 z exptime 104.0 propid 2014B-0404 seeing 1.05 MJD 58378.089 object DECaLS_24244_z c4d_180904_042454_ooi_r_ls9.fits.fz c4d_180904_042454_ooi_r_ls9-N14 r exptime 65.0 propid 2014B-0404 seeing 1.35 MJD 58365.184 object DECaLS_24244_r c4d_180906_025147_ooi_g_ls9.fits.fz c4d_180906_025147_ooi_g_ls9-N14 g exptime 129.0 propid 2014B-0404 seeing 1.28 MJD 58367.119 object DECaLS_24244_g c4d_180830_042522_ooi_z_ls9.fits.fz c4d_180830_042522_ooi_z_ls9-N24 z exptime 151.0 propid 2014B-0404 seeing 1.28 MJD 58360.184 object DECaLS_40137_z c4d_180921_015247_ooi_z_ls9.fits.fz c4d_180921_015247_ooi_z_ls9-N24 z exptime 250.0 propid 2014B-0404 seeing 1.07 MJD 58382.078 object DECaLS_40137_z c4d_180906_025012_ooi_r_ls9.fits.fz c4d_180906_025012_ooi_r_ls9-N24 r exptime 66.0 propid 2014B-0404 seeing 1.03 MJD 58367.118 object DECaLS_40137_r c4d_180906_024751_ooi_g_ls9.fits.fz c4d_180906_024751_ooi_g_ls9-N24 g exptime 113.0 propid 2014B-0404 seeing 1.25 MJD 58367.117 object DECaLS_40137_g c4d_170722_071340_ooi_r_ls9.fits.fz c4d_170722_071340_ooi_r_ls9-N15 r exptime 62.0 propid 2014B-0404 seeing 1.30 MJD 57956.300 object DECaLS_8372_r c4d_140813_055745_ooi_z_ls9.fits.fz c4d_140813_055745_ooi_z_ls9-N15 z exptime 142.0 propid 2014B-0404 seeing 0.87 MJD 56882.246 object DECaLS_8372_z c4d_180619_082252_ooi_g_ls9.fits.fz c4d_180619_082252_ooi_g_ls9-N15 g exptime 200.0 propid 2014B-0404 seeing 1.64 MJD 58288.349 object DECaLS_8372_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180904T042454_oi[N14,noinherit][2046,4094][real]: DECaLS_2424 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T025147_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180921T015247_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e95c-r-20180906T025012_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T024751_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T071146_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954bf08-z-20140813T055433_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T042522_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T020745_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T082252_oi[N15,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 97.50 s, CPU: 6.00 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.454592 MB Stage tims finished: 2020-06-05T04:23:18.749774 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180904T042454_oi[N14,noinherit][2046,4094][real]: DECaLS_2424 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180921T015247_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T024751_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954bf08-z-20140813T055433_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T042522_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T020745_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T025147_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e95c-r-20180906T025012_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T071146_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T082252_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.605 s worker CPU, 358.256 s worker Wall, Wall: 97.504 s, Cores in use: 0.11, Total efficiency (on 4 cores): 2.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-05T04:23:26.257911 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03256.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03255.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03127.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03383.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/reference-custom-336556p28876.fits Stage refs : Wall: 12.71 s, CPU: 12.22 s, VmPeak: 1067 MB, VmSize: 1061 MB, VmRSS: 241 MB, VmData: 272 MB, maxrss: 0.454592 MB Stage refs finished: 2020-06-05T04:23:38.970824 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.714 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-05T04:23:38.972532 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outlier-mask-custom-336556p28876.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-pre-custom-336556p28876.jpg Image c4d_180619_082252_ooi_g_ls9-N15 g : masking 226 positive outlier pixels and 248 negative outlier pixels Image c4d_180904_042454_ooi_r_ls9-N14 r : masking 183 positive outlier pixels and 0 negative outlier pixels Image c4d_140813_055745_ooi_z_ls9-N15 z : masking 1848 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_020745_ooi_z_ls9-N14 z : masking 153 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outlier-mask-custom-336556p28876.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-post-custom-336556p28876.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-masked-pos-custom-336556p28876.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-masked-neg-custom-336556p28876.jpg Stage outliers : Wall: 4.97 s, CPU: 4.73 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 251 MB, VmData: 281 MB, maxrss: 0.454592 MB Stage outliers finished: 2020-06-05T04:23:43.943085 Resources for stage outliers : 0.760 s worker CPU, 0.760 s worker Wall, Wall: 4.972 s, Cores in use: 1.10, Total efficiency (on 4 cores): 27.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-05T04:23:43.944882 Stage halos : Wall: 8.54 s, CPU: 5.29 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 251 MB, VmData: 281 MB, maxrss: 0.454592 MB Stage halos finished: 2020-06-05T04:23:52.484345 Resources for stage halos : 0.286 s worker CPU, 10.918 s worker Wall, Wall: 8.541 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-05T04:23:52.486294 PSF sigmas in coadd pixels: ['2.08', '2.03', '2.67'] Using average PSF sigma 2.2586196393116915 Gaussian PSF norm 0.12489698879083767 vs pixelized 0.11711167 average tim pixel scale / coadd scale: 1.0014336799690855 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.19', '1.68', '2.12'] Using average PSF sigma 1.9956000100704074 Gaussian PSF norm 0.14135838361913292 vs pixelized 0.119430065 average tim pixel scale / coadd scale: 1.0014009881473167 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.70', '2.08', '1.73', '1.41'] Using average PSF sigma 1.7319526933183844 Gaussian PSF norm 0.16287673032996677 vs pixelized 0.13300683 average tim pixel scale / coadd scale: 1.0013546247456493 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-copsf-z.fits.fz Stage fit_on_coadds : Wall: 7.56 s, CPU: 0.17 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 254 MB, VmData: 283 MB, maxrss: 0.454592 MB Stage fit_on_coadds finished: 2020-06-05T04:24:00.041900 Resources for stage fit_on_coadds : 0.177 s worker CPU, 0.177 s worker Wall, Wall: 7.557 s, Cores in use: 0.05, Total efficiency (on 4 cores): 1.2 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-05T04:24:00.044802 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 23 potential peaks Of 23 potential peaks: 1 in veto map, 2 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 17 potential peaks Of 17 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 20 potential peaks Of 20 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 27 potential peaks Of 27 potential peaks: 21 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 28 potential peaks Of 28 potential peaks: 26 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : -4.8286278e-05 Median coadd sky for r : -0.00014125022 Median coadd sky for z : 0.00017421637 Stage srcs : Wall: 5.83 s, CPU: 5.79 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.454592 MB Stage srcs finished: 2020-06-05T04:24:05.873055 Resources for stage srcs : 0.098 s worker CPU, 0.108 s worker Wall, Wall: 5.829 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-05T04:24:05.884482 Blob 1 of 17, id: 5, sources: 6, size: 87x147, npix 6784, brick X: 82,169, Y: 49,196, one pixel: 118 49 Blob 2 of 17, id: 2, sources: 3, size: 43x80, npix 2044, brick X: 3,46, Y: 15,95, one pixel: 15 15 Blob 3 of 17, id: 8, sources: 1, size: 34x40, npix 897, brick X: 173,207, Y: 103,143, one pixel: 192 103 Blob 4 of 17, id: 0, sources: 1, size: 37x31, npix 839, brick X: 141,178, Y: 0,31, one pixel: 151 0 Blob 5 of 17, id: 10, sources: 2, size: 40x36, npix 780, brick X: 33,73, Y: 116,152, one pixel: 60 116 Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147972 MB Blob 6 of 17, id: 14, sources: 1, size: 31x31, npix 648, brick X: 23,54, Y: 193,224, one pixel: 37 193 Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.23 s, CPU: 2.23 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147952 MB Blob 7 of 17, id: 4, sources: 2, size: 28x35, npix 609, brick X: 213,241, Y: 35,70, one pixel: 227 35 Blob 5 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147972 MB Blob 8 of 17, id: 16, sources: 2, size: 34x28, npix 546, brick X: 109,143, Y: 215,243, one pixel: 117 215 Blob 6 finished, total: Wall: 1.10 s, CPU: 1.10 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147952 MB Blob 9 of 17, id: 11, sources: 2, size: 33x28, npix 518, brick X: 0,33, Y: 127,155, one pixel: 10 127 Blob 2 finished, total: Wall: 3.45 s, CPU: 3.45 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14922 MB Blob 10 of 17, id: 12, sources: 1, size: 24x30, npix 474, brick X: 186,210, Y: 161,191, one pixel: 197 161 Blob 8 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147952 MB Blob 11 of 17, id: 15, sources: 1, size: 25x25, npix 369, brick X: 194,219, Y: 200,225, one pixel: 205 200 Blob 7 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147972 MB Blob 12 of 17, id: 7, sources: 1, size: 18x26, npix 346, brick X: 227,245, Y: 101,127, one pixel: 238 101 Blob 9 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14922 MB Blob 13 of 17, id: 3, sources: 1, size: 24x23, npix 339, brick X: 42,66, Y: 31,54, one pixel: 53 31 Blob 11 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147972 MB Blob 14 of 17, id: 9, sources: 1, size: 20x20, npix 256, brick X: 18,38, Y: 115,135, one pixel: 26 115 Blob 10 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1488 MB Blob 15 of 17, id: 6, sources: 1, size: 14x23, npix 244, brick X: 231,245, Y: 63,86, one pixel: 239 63 Blob 13 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147972 MB Blob 16 of 17, id: 1, sources: 1, size: 20x19, npix 227, brick X: 119,139, Y: 14,33, one pixel: 127 14 Blob 14 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1488 MB Blob 17 of 17, id: 13, sources: 1, size: 18x18, npix 180, brick X: 90,108, Y: 185,203, one pixel: 98 185 Blob 12 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14922 MB Blob 16 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1488 MB Blob 17 finished, total: Wall: 0.21 s, CPU: 0.21 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14922 MB Blob 15 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.147972 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.97924, ee1=1.03489, ee2=0.396327 Measuring 4 iterative sources Blob 1 finished, total: Wall: 10.59 s, CPU: 10.59 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150936 MB Old catalog: 34 New catalog: 32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/blobs-custom-336556p28876.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/all-models-custom-336556p28876.fits Stage fitblobs : Wall: 21.38 s, CPU: 6.05 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.454592 MB Stage fitblobs finished: 2020-06-05T04:24:27.264594 Resources for stage fitblobs : 29.905 s worker CPU, 29.936 s worker Wall, Wall: 21.381 s, Cores in use: 1.68, Total efficiency (on 4 cores): 42.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-05T04:24:27.266375 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-resid.jpg Stage coadds : Wall: 6.92 s, CPU: 6.00 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 255 MB, VmData: 283 MB, maxrss: 0.454592 MB Stage coadds finished: 2020-06-05T04:24:34.181665 Resources for stage coadds : 2.577 s worker CPU, 2.774 s worker Wall, Wall: 6.916 s, Cores in use: 1.24, Total efficiency (on 4 cores): 31.0 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-05T04:24:34.183464 Cut to 1 unWISE tiles Reading WISE tile 3360p287 band 1 Reading WISE tile 3360p287 band 2 Reading WISE tile 3360p287 band 3 Reading WISE tile 3360p287 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 937 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.191096 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 965 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.20652 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210544 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 954 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210496 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 11.64 s, CPU: 7.46 s, VmPeak: 1070 MB, VmSize: 1070 MB, VmRSS: 256 MB, VmData: 283 MB, maxrss: 0.454592 MB Stage wise_forced finished: 2020-06-05T04:24:45.822630 Resources for stage wise_forced : 3.711 s worker CPU, 12.379 s worker Wall, Wall: 11.640 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-05T04:24:45.824437 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/tractor-i/cus/tractor-custom-336556p28876.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/tractor/cus/tractor-custom-336556p28876.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/tractor/cus/brick-custom-336556p28876.sha256sum Stage writecat : Wall: 9.23 s, CPU: 7.15 s, VmPeak: 1203 MB, VmSize: 1075 MB, VmRSS: 258 MB, VmData: 283 MB, maxrss: 0.454592 MB Stage writecat finished: 2020-06-05T04:24:55.057819 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.234 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.3 % Stage writecat finished All done: 42.120 s worker CPU, 415.310 s worker Wall, Wall: 193.816 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.3 % Finished galaxy PGC1848733 in 3.339 minutes. Started working on galaxy PGC1848733 at Mon Aug 10 08:22:24 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.55605414929494 28.876398722684012 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T08:22:25.403279 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.55605414929494', '28.876398722684012', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.55605414929494 28.876398722684012 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 336.55605414929494 28.876398722684012 Starting process 61014 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 61015 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 61016 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 61017 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 61018 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 61019 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 61020 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 61021 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T08:22:25.806417 Keeping 10 CCDs: c4d_180917_020745_ooi_z_ls9-N14 z expnum 774627 exptime 104.0 propid 2014B-0404 seeing 1.05 MJD 58378.089 object DECaLS_24244_z decam/CP/V4.8.2a/CP20180916/c4d_180917_020745_ooi_z_ls9.fits.fz c4d_180904_042454_ooi_r_ls9-N14 r expnum 768750 exptime 65.0 propid 2014B-0404 seeing 1.35 MJD 58365.184 object DECaLS_24244_r decam/CP/V4.8.2a/CP20180903/c4d_180904_042454_ooi_r_ls9.fits.fz c4d_180906_025147_ooi_g_ls9-N14 g expnum 769546 exptime 129.0 propid 2014B-0404 seeing 1.28 MJD 58367.119 object DECaLS_24244_g decam/CP/V4.8.2a/CP20180905/c4d_180906_025147_ooi_g_ls9.fits.fz c4d_180830_042522_ooi_z_ls9-N24 z expnum 767036 exptime 151.0 propid 2014B-0404 seeing 1.28 MJD 58360.184 object DECaLS_40137_z decam/CP/V4.8.2a/CP20180829/c4d_180830_042522_ooi_z_ls9.fits.fz c4d_180921_015247_ooi_z_ls9-N24 z expnum 775951 exptime 250.0 propid 2014B-0404 seeing 1.07 MJD 58382.078 object DECaLS_40137_z decam/CP/V4.8.2a/CP20180920/c4d_180921_015247_ooi_z_ls9.fits.fz c4d_180906_025012_ooi_r_ls9-N24 r expnum 769545 exptime 66.0 propid 2014B-0404 seeing 1.03 MJD 58367.118 object DECaLS_40137_r decam/CP/V4.8.2a/CP20180905/c4d_180906_025012_ooi_r_ls9.fits.fz c4d_180906_024751_ooi_g_ls9-N24 g expnum 769544 exptime 113.0 propid 2014B-0404 seeing 1.25 MJD 58367.117 object DECaLS_40137_g decam/CP/V4.8.2a/CP20180905/c4d_180906_024751_ooi_g_ls9.fits.fz c4d_170722_071340_ooi_r_ls9-N15 r expnum 660964 exptime 62.0 propid 2014B-0404 seeing 1.30 MJD 57956.300 object DECaLS_8372_r decam/CP/V4.8.2a/CP20170721/c4d_170722_071340_ooi_r_ls9.fits.fz c4d_140813_055745_ooi_z_ls9-N15 z expnum 347431 exptime 142.0 propid 2014B-0404 seeing 0.87 MJD 56882.246 object DECaLS_8372_z decam/CP/V4.8.2a/CP20140812/c4d_140813_055745_ooi_z_ls9.fits.fz c4d_180619_082252_ooi_g_ls9-N15 g expnum 754104 exptime 200.0 propid 2014B-0404 seeing 1.64 MJD 58288.349 object DECaLS_8372_g decam/CP/V4.8.2a/CP20180618/c4d_180619_082252_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T042522_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T020745_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180921T015247_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T071146_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e95c-r-20180906T025012_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T024751_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T025147_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180904T042454_oi[N14,noinherit][2046,4094][real]: DECaLS_2424 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954bf08-z-20140813T055433_oi[N15,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T082252_oi[N15,noinherit][2046,4094][real]: DECaLS_ Clipping 336 pixels with anomalously large oow values: max 0.0159825 vs median 0.0103583 Stage tims : Wall: 42.82 s, CPU: 0.84 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.178992 MB Stage tims finished: 2020-08-10T08:23:08.628139 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T025147_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T024751_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T071146_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T020745_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e95c-r-20180906T025012_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180904T042454_oi[N14,noinherit][2046,4094][real]: DECaLS_2424 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180921T015247_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954bf08-z-20140813T055433_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952aa76-z-20180830T042522_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953138d-g-20180619T082252_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.572 s worker CPU, 262.209 s worker Wall, Wall: 42.823 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T08:23:08.660173 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03256.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03255.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03127.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03383.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/reference-custom-336556p28876.fits Stage refs : Wall: 10.25 s, CPU: 4.58 s, VmPeak: 1072 MB, VmSize: 1066 MB, VmRSS: 238 MB, VmData: 270 MB, maxrss: 0.244204 MB Stage refs finished: 2020-08-10T08:23:18.910952 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.252 s, Cores in use: 0.45, Total efficiency (on 8 cores): 5.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T08:23:19.077662 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outlier-mask-custom-336556p28876.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-pre-custom-336556p28876.jpg Image c4d_180619_082252_ooi_g_ls9-N15 g : masking 295 positive outlier pixels and 0 negative outlier pixels Image c4d_180904_042454_ooi_r_ls9-N14 r : masking 126 positive outlier pixels and 0 negative outlier pixels Image c4d_140813_055745_ooi_z_ls9-N15 z : masking 1877 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_020745_ooi_z_ls9-N14 z : masking 152 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outlier-mask-custom-336556p28876.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-post-custom-336556p28876.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-masked-pos-custom-336556p28876.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/outliers-masked-neg-custom-336556p28876.jpg Stage outliers : Wall: 1.14 s, CPU: 0.92 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 251 MB, VmData: 281 MB, maxrss: 0.257404 MB Stage outliers finished: 2020-08-10T08:23:20.219575 Resources for stage outliers : 0.683 s worker CPU, 0.684 s worker Wall, Wall: 1.143 s, Cores in use: 1.40, Total efficiency (on 8 cores): 17.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T08:23:20.242066 Stage halos : Wall: 0.59 s, CPU: 0.44 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 252 MB, VmData: 281 MB, maxrss: 0.257624 MB Stage halos finished: 2020-08-10T08:23:20.828212 Resources for stage halos : 0.355 s worker CPU, 0.909 s worker Wall, Wall: 0.587 s, Cores in use: 1.36, Total efficiency (on 8 cores): 17.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T08:23:20.853765 PSF sigmas in coadd pixels: ['2.08', '2.03', '2.67'] Using average PSF sigma 2.2586196393116915 Gaussian PSF norm 0.12489698879083767 vs pixelized 0.11710949 average tim pixel scale / coadd scale: 1.0014336799690855 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.19', '1.68', '2.12'] Using average PSF sigma 1.9956000100704074 Gaussian PSF norm 0.14135838361913292 vs pixelized 0.119428985 average tim pixel scale / coadd scale: 1.0014009881473167 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.70', '2.08', '1.73', '1.41'] Using average PSF sigma 1.7319526933183844 Gaussian PSF norm 0.16287673032996677 vs pixelized 0.13301317 average tim pixel scale / coadd scale: 1.0013546247456493 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.15 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 253 MB, VmData: 281 MB, maxrss: 0.259092 MB Stage fit_on_coadds finished: 2020-08-10T08:23:21.016215 Resources for stage fit_on_coadds : 0.157 s worker CPU, 0.157 s worker Wall, Wall: 0.164 s, Cores in use: 1.89, Total efficiency (on 8 cores): 23.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T08:23:21.026709 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 23 potential peaks Of 23 potential peaks: 2 in veto map, 2 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 17 potential peaks Of 17 potential peaks: 15 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 21 potential peaks Of 21 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 28 potential peaks Of 28 potential peaks: 23 in veto map, 3 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 27 potential peaks Of 27 potential peaks: 25 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 25 new sources Median coadd sky for g : -6.990464e-05 Median coadd sky for r : -0.00012555758 Median coadd sky for z : 0.0001891086 Stage srcs : Wall: 0.54 s, CPU: 0.50 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 254 MB, VmData: 281 MB, maxrss: 0.259672 MB Stage srcs finished: 2020-08-10T08:23:21.568651 Resources for stage srcs : 0.070 s worker CPU, 0.070 s worker Wall, Wall: 0.543 s, Cores in use: 1.06, Total efficiency (on 8 cores): 13.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T08:23:21.596327 Blob 1 of 17, id: 5, sources: 5, size: 86x147, npix 6801, brick X: 77,163, Y: 45,192, one pixel: 111 45 Blob 2 of 17, id: 2, sources: 3, size: 40x79, npix 2017, brick X: 0,40, Y: 11,90, one pixel: 9 11 Blob 3 of 17, id: 8, sources: 1, size: 34x40, npix 889, brick X: 167,201, Y: 99,139, one pixel: 186 99 Blob 4 of 17, id: 10, sources: 2, size: 40x35, npix 773, brick X: 28,68, Y: 112,147, one pixel: 53 112 Blob 5 of 17, id: 0, sources: 1, size: 37x27, npix 722, brick X: 135,172, Y: 0,27, one pixel: 143 0 Blob 6 of 17, id: 14, sources: 1, size: 32x31, npix 660, brick X: 17,49, Y: 189,220, one pixel: 31 189 Blob 7 of 17, id: 4, sources: 2, size: 29x35, npix 607, brick X: 207,236, Y: 31,66, one pixel: 221 31 Blob 8 of 17, id: 16, sources: 2, size: 34x29, npix 537, brick X: 104,138, Y: 210,239, one pixel: 113 210 Blob 9 of 17, id: 12, sources: 1, size: 24x29, npix 474, brick X: 181,205, Y: 157,186, one pixel: 191 157 Blob 8 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14504 MB Blob 10 of 17, id: 7, sources: 1, size: 24x27, npix 452, brick X: 221,245, Y: 96,123, one pixel: 233 96 Blob 7 finished, total: Wall: 1.02 s, CPU: 1.01 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14648 MB Blob 11 of 17, id: 11, sources: 2, size: 28x28, npix 422, brick X: 0,28, Y: 123,151, one pixel: 6 123 Blob 6 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14518 MB Measuring 1 iterative sources Blob 12 of 17, id: 6, sources: 1, size: 20x26, npix 366, brick X: 225,245, Y: 57,83, one pixel: 236 57 Blob 5 finished, total: Wall: 1.54 s, CPU: 1.53 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145036 MB Blob 13 of 17, id: 15, sources: 1, size: 24x24, npix 366, brick X: 189,213, Y: 196,220, one pixel: 199 196 Blob 4 finished, total: Wall: 1.73 s, CPU: 1.73 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145472 MB Blob 14 of 17, id: 3, sources: 1, size: 24x23, npix 339, brick X: 37,61, Y: 27,50, one pixel: 47 27 Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.00 s, CPU: 2.00 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144892 MB Blob 15 of 17, id: 9, sources: 1, size: 20x21, npix 249, brick X: 13,33, Y: 110,131, one pixel: 22 110 Blob 9 finished, total: Wall: 1.66 s, CPU: 1.66 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14688 MB Blob 16 of 17, id: 1, sources: 1, size: 20x20, npix 220, brick X: 114,134, Y: 9,29, one pixel: 123 9 Blob 10 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14648 MB Blob 17 of 17, id: 13, sources: 1, size: 19x18, npix 180, brick X: 84,103, Y: 181,199, one pixel: 92 181 Blob 15 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.14688 MB Blob 16 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 940 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14648 MB Blob 12 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145036 MB Blob 13 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145472 MB Blob 14 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144892 MB Blob 17 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147596 MB Blob 11 finished, total: Wall: 1.75 s, CPU: 1.74 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.14696 MB Blob 2 finished, total: Wall: 3.50 s, CPU: 3.49 s, VmPeak: 955 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145336 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.77797, ee1=0.96459, ee2=0.371322 Measuring 2 iterative sources Blob 1 finished, total: Wall: 6.69 s, CPU: 6.68 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148728 MB Old catalog: 33 New catalog: 29 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/blobs-custom-336556p28876.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/metrics/cus/all-models-custom-336556p28876.fits Stage fitblobs : Wall: 7.76 s, CPU: 0.54 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 254 MB, VmData: 281 MB, maxrss: 0.259836 MB Stage fitblobs finished: 2020-08-10T08:23:29.356750 Resources for stage fitblobs : 27.078 s worker CPU, 27.169 s worker Wall, Wall: 7.761 s, Cores in use: 3.56, Total efficiency (on 8 cores): 44.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T08:23:29.370710 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-resid.jpg Stage coadds : Wall: 1.77 s, CPU: 0.83 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 254 MB, VmData: 281 MB, maxrss: 0.260156 MB Stage coadds finished: 2020-08-10T08:23:31.142085 Resources for stage coadds : 4.062 s worker CPU, 4.423 s worker Wall, Wall: 1.772 s, Cores in use: 2.76, Total efficiency (on 8 cores): 34.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T08:23:31.154209 Cut to 1 unWISE tiles Reading WISE tile 3360p287 band 1 Reading WISE tile 3360p287 band 2 Reading WISE tile 3360p287 band 3 Reading WISE tile 3360p287 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 955 MB, VmSize: 805 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.193684 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.2114 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 956 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21008 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/336/3360p287/unwise-3360p287-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 955 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208204 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/tmp-legacysurvey-custom-336556p28876-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.30 s, CPU: 0.48 s, VmPeak: 1076 MB, VmSize: 1076 MB, VmRSS: 255 MB, VmData: 281 MB, maxrss: 0.260672 MB Stage wise_forced finished: 2020-08-10T08:23:35.453734 Resources for stage wise_forced : 3.155 s worker CPU, 9.685 s worker Wall, Wall: 4.301 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T08:23:35.466702 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/coadd/cus/custom-336556p28876/legacysurvey-custom-336556p28876-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/tractor-i/cus/tractor-custom-336556p28876.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/tractor/cus/tractor-custom-336556p28876.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/tractor/cus/brick-custom-336556p28876.sha256sum Stage writecat : Wall: 0.76 s, CPU: 0.52 s, VmPeak: 1208 MB, VmSize: 1080 MB, VmRSS: 256 MB, VmData: 281 MB, maxrss: 0.393656 MB Stage writecat finished: 2020-08-10T08:23:36.230700 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.765 s, Cores in use: 0.69, Total efficiency (on 8 cores): 8.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1848733/PGC1848733-largegalaxy-writecat.p All done: 41.135 s worker CPU, 305.307 s worker Wall, Wall: 70.442 s, Cores in use: 0.73, Total efficiency (on 8 cores): 9.1 % Finished galaxy PGC1848733 in 1.202 minutes.