Started working on galaxy PGC009343 at Thu Jun 4 06:21:39 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.8836665 23.08425 --width 243 --height 243 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T06:21:41.002258 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.8836665', '23.08425', '--width', '243', '--height', '243', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.8836665 23.08425 --width 243 --height 243 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 36.8836665 23.08425 Starting process 36662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 36663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 36664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 36665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 36666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 36667 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 36668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Starting process 36669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057332 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T06:21:45.461272 Keeping 10 CCDs: c4d_181016_063721_ooi_r_ls9.fits.fz c4d_181016_063721_ooi_r_ls9-N24 r exptime 123.0 propid 2014B-0404 seeing 1.72 MJD 58407.276 object DECaLS_46461_r c4d_181002_063518_ooi_z_ls9.fits.fz c4d_181002_063518_ooi_z_ls9-N24 z exptime 80.0 propid 2014B-0404 seeing 1.07 MJD 58393.275 object DECaLS_46461_z c4d_160724_103633_ooi_z_ls9.fits.fz c4d_160724_103633_ooi_z_ls9-N14 z exptime 152.0 propid 2016A-0190 seeing 1.22 MJD 57593.440 object DECaLS_30611_z c4d_180810_093803_ooi_r_ls9.fits.fz c4d_180810_093803_ooi_r_ls9-N14 r exptime 77.0 propid 2014B-0404 seeing 1.14 MJD 58340.401 object DECaLS_30611_r c4d_180907_080307_ooi_g_ls9.fits.fz c4d_180907_080307_ooi_g_ls9-N14 g exptime 200.0 propid 2014B-0404 seeing 1.43 MJD 58368.335 object DECaLS_30611_g c4d_181016_045906_ooi_z_ls9.fits.fz c4d_181016_045906_ooi_z_ls9-N24 z exptime 189.0 propid 2014B-0404 seeing 1.44 MJD 58407.208 object DECaLS_46461_z c4d_181017_062435_ooi_g_ls9.fits.fz c4d_181017_062435_ooi_g_ls9-N24 g exptime 200.0 propid 2014B-0404 seeing 1.46 MJD 58408.267 object DECaLS_46461_g c4d_170917_094043_ooi_z_ls9.fits.fz c4d_170917_094043_ooi_z_ls9-N15 z exptime 190.0 propid 2014B-0404 seeing 1.14 MJD 58013.403 object DECaLS_14739_z c4d_180811_095439_ooi_r_ls9.fits.fz c4d_180811_095439_ooi_r_ls9-N15 r exptime 44.0 propid 2014B-0404 seeing 0.86 MJD 58341.413 object DECaLS_14739_r c4d_180811_095207_ooi_g_ls9.fits.fz c4d_180811_095207_ooi_g_ls9-N15 g exptime 120.0 propid 2014B-0404 seeing 1.04 MJD 58341.411 object DECaLS_14739_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181016T045906_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e046-z-20170917T094043_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160724T103309_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180907T080307_oi[N14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T063518_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181017T062435_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181016T063721_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180811T095439_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180811T095207_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531ac3-r-20180810T093803_oi[N14,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 84.10 s, CPU: 2.88 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.451428 MB Stage tims finished: 2020-06-04T06:23:09.565613 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954b0ee-z-20160724T103309_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T063518_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181017T062435_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180907T080307_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181016T063721_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951e046-z-20170917T094043_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532e22-g-20180811T095207_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.643 s worker CPU, 331.333 s worker Wall, Wall: 84.106 s, Cores in use: 0.10, Total efficiency (on 8 cores): 1.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531ac3-r-20180810T093803_oi[N14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181016T045906_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180811T095439_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-04T06:23:09.586486 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03661.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03789.fits Matched 8 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/reference-custom-036883p23084.fits Stage refs : Wall: 2.49 s, CPU: 1.69 s, VmPeak: 1026 MB, VmSize: 1012 MB, VmRSS: 191 MB, VmData: 224 MB, maxrss: 0.451428 MB Stage refs finished: 2020-06-04T06:23:12.078815 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.494 s, Cores in use: 0.68, Total efficiency (on 8 cores): 8.5 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T06:23:12.080642 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/outlier-mask-custom-036883p23084.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/outliers-pre-custom-036883p23084.jpg Image c4d_180907_080307_ooi_g_ls9-N14 g : masking 191 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_062435_ooi_g_ls9-N24 g : masking 333 positive outlier pixels and 0 negative outlier pixels Image c4d_181016_063721_ooi_r_ls9-N24 r : masking 176 positive outlier pixels and 0 negative outlier pixels Image c4d_170917_094043_ooi_z_ls9-N15 z : masking 272 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/outlier-mask-custom-036883p23084.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/outliers-post-custom-036883p23084.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/outliers-masked-pos-custom-036883p23084.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/outliers-masked-neg-custom-036883p23084.jpg Stage outliers : Wall: 2.75 s, CPU: 2.52 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 205 MB, VmData: 236 MB, maxrss: 0.451428 MB Stage outliers finished: 2020-06-04T06:23:14.828824 Resources for stage outliers : 0.782 s worker CPU, 0.782 s worker Wall, Wall: 2.749 s, Cores in use: 1.20, Total efficiency (on 8 cores): 15.0 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T06:23:14.830666 Stage halos : Wall: 1.78 s, CPU: 1.33 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 205 MB, VmData: 236 MB, maxrss: 0.451428 MB Stage halos finished: 2020-06-04T06:23:16.609253 Resources for stage halos : 0.273 s worker CPU, 2.654 s worker Wall, Wall: 1.780 s, Cores in use: 0.90, Total efficiency (on 8 cores): 11.3 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T06:23:16.611354 PSF sigmas in coadd pixels: ['2.32', '2.37', '1.69'] Using average PSF sigma 2.128003770257354 Gaussian PSF norm 0.13256310713197775 vs pixelized 0.11541968 average tim pixel scale / coadd scale: 1.0013148430308312 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.80', '1.85', '1.40'] Using average PSF sigma 2.015557053260554 Gaussian PSF norm 0.13995872323114605 vs pixelized 0.12068292 average tim pixel scale / coadd scale: 1.0013403366533116 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.74', '1.98', '2.33', '1.86'] Using average PSF sigma 1.975791949582644 Gaussian PSF norm 0.1427755548014387 vs pixelized 0.11613593 average tim pixel scale / coadd scale: 1.00130473722558 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.15 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.451428 MB Stage fit_on_coadds finished: 2020-06-04T06:23:16.776243 Resources for stage fit_on_coadds : 0.163 s worker CPU, 0.168 s worker Wall, Wall: 0.166 s, Cores in use: 1.88, Total efficiency (on 8 cores): 23.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T06:23:16.778966 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 7 potential peaks Of 7 potential peaks: 1 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept SED z : 4 new peaks Found 7 potential peaks Of 7 potential peaks: 5 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 11 potential peaks Of 11 potential peaks: 7 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 18 potential peaks Of 18 potential peaks: 9 in veto map, 3 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 19 potential peaks Of 19 potential peaks: 15 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 14 new sources Median coadd sky for g : 5.2395835e-06 Median coadd sky for r : 6.932781e-05 Median coadd sky for z : 1.7971193e-05 Stage srcs : Wall: 3.32 s, CPU: 3.29 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.451428 MB Stage srcs finished: 2020-06-04T06:23:20.099975 Resources for stage srcs : 0.065 s worker CPU, 0.065 s worker Wall, Wall: 3.322 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/PGC009343-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T06:23:20.116819 Blob 1 of 11, id: 5, sources: 2, size: 143x152, npix 14257, brick X: 54,197, Y: 50,202, one pixel: 124 50 Blob 2 of 11, id: 0, sources: 2, size: 40x42, npix 1037, brick X: 52,92, Y: 0,42, one pixel: 57 0 Blob 3 of 11, id: 1, sources: 2, size: 33x34, npix 669, brick X: 98,131, Y: 0,34, one pixel: 104 0 Blob 4 of 11, id: 4, sources: 1, size: 27x28, npix 497, brick X: 25,52, Y: 20,48, one pixel: 36 20 Blob 5 of 11, id: 3, sources: 1, size: 26x26, npix 443, brick X: 141,167, Y: 19,45, one pixel: 153 19 Blob 6 of 11, id: 7, sources: 2, size: 20x33, npix 407, brick X: 208,228, Y: 164,197, one pixel: 216 164 Blob 7 of 11, id: 8, sources: 1, size: 20x20, npix 229, brick X: 8,28, Y: 207,227, one pixel: 17 207 Blob 8 of 11, id: 2, sources: 1, size: 19x19, npix 217, brick X: 202,221, Y: 15,34, one pixel: 210 15 Blob 9 of 11, id: 6, sources: 1, size: 20x19, npix 209, brick X: 219,239, Y: 126,145, one pixel: 228 126 Blob 8 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146776 MB Blob 10 of 11, id: 10, sources: 1, size: 19x17, npix 177, brick X: 104,123, Y: 226,243, one pixel: 113 226 Blob 7 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 931 MB, VmSize: 714 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.141324 MB Blob 11 of 11, id: 9, sources: 1, size: 17x17, npix 145, brick X: 224,241, Y: 218,235, one pixel: 232 218 Blob 9 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146776 MB Blob 10 finished, total: Wall: 0.10 s, CPU: 0.08 s, VmPeak: 931 MB, VmSize: 714 MB, VmRSS: 138 MB, VmData: 177 MB, maxrss: 0.141324 MB Blob 11 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146776 MB Blob 6 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146336 MB Blob 4 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 935 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146556 MB Blob 5 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 934 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146272 MB Blob 3 finished, total: Wall: 1.36 s, CPU: 1.36 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146904 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.44 s, CPU: 2.40 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148212 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.32807, ee1=0.0451898, ee2=0.0704201 Blob 1 finished, total: Wall: 5.46 s, CPU: 5.46 s, VmPeak: 948 MB, VmSize: 714 MB, VmRSS: 141 MB, VmData: 177 MB, maxrss: 0.144872 MB Old catalog: 17 New catalog: 13 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/blobs-custom-036883p23084.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/metrics/cus/all-models-custom-036883p23084.fits Stage fitblobs : Wall: 7.20 s, CPU: 1.71 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.451428 MB Stage fitblobs finished: 2020-06-04T06:23:27.320295 Resources for stage fitblobs : 12.727 s worker CPU, 12.842 s worker Wall, Wall: 7.205 s, Cores in use: 2.00, Total efficiency (on 8 cores): 25.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T06:23:27.322196 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/tmp-legacysurvey-custom-036883p23084-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/tmp-legacysurvey-custom-036883p23084-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/tmp-legacysurvey-custom-036883p23084-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/tmp-legacysurvey-custom-036883p23084-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-resid.jpg Stage coadds : Wall: 2.14 s, CPU: 1.50 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.451428 MB Stage coadds finished: 2020-06-04T06:23:29.461700 Resources for stage coadds : 3.530 s worker CPU, 3.877 s worker Wall, Wall: 2.140 s, Cores in use: 2.35, Total efficiency (on 8 cores): 29.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T06:23:29.463178 Cut to 1 unWISE tiles Reading WISE tile 0374p227 band 2 Reading WISE tile 0374p227 band 4 Reading WISE tile 0374p227 band 1 Reading WISE tile 0374p227 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 956 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.203952 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 932 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209976 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 935 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.19072 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0374p227/unwise-0374p227-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 931 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206056 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/tmp-legacysurvey-custom-036883p23084-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/tmp-legacysurvey-custom-036883p23084-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.03 s, CPU: 1.27 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.451428 MB Stage wise_forced finished: 2020-06-04T06:23:34.493313 Resources for stage wise_forced : 2.793 s worker CPU, 7.554 s worker Wall, Wall: 5.031 s, Cores in use: 0.81, Total efficiency (on 8 cores): 10.1 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T06:23:34.495162 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/coadd/cus/custom-036883p23084/legacysurvey-custom-036883p23084-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/tractor-i/cus/tractor-custom-036883p23084.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/tractor/cus/tractor-custom-036883p23084.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC009343/tractor/cus/brick-custom-036883p23084.sha256sum Stage writecat : Wall: 1.60 s, CPU: 1.44 s, VmPeak: 1154 MB, VmSize: 1026 MB, VmRSS: 212 MB, VmData: 237 MB, maxrss: 0.451428 MB Stage writecat finished: 2020-06-04T06:23:36.093537 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.599 s, Cores in use: 0.90, Total efficiency (on 8 cores): 11.2 % Stage writecat finished All done: 25.978 s worker CPU, 359.279 s worker Wall, Wall: 110.637 s, Cores in use: 0.40, Total efficiency (on 8 cores): 4.9 % Finished galaxy PGC009343 in 1.948 minutes.