Started working on galaxy PGC1930731 at Fri Jun 5 04:10:00 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.45254150000005 31.079722200000003 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-05T04:10:01.749839 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.45254150000005', '31.079722200000003', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.45254150000005 31.079722200000003 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.45254150000005 31.079722200000003 Starting process 17992 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057368 MB Starting process 17993 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB Starting process 17994 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05746 MB Starting process 17995 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-05T04:10:13.456881 Keeping 6 CCDs: c4d_181102_004412_ooi_z_ls9.fits.fz c4d_181102_004412_ooi_z_ls9-N28 z exptime 90.0 propid 2014B-0404 seeing 1.01 MJD 58424.031 object DECaLS_8299_z c4d_181003_015203_ooi_r_ls9.fits.fz c4d_181003_015203_ooi_r_ls9-N28 r exptime 126.0 propid 2014B-0404 seeing 1.47 MJD 58394.078 object DECaLS_8299_r c4d_181111_013819_ooi_g_ls9.fits.fz c4d_181111_013819_ooi_g_ls9-N28 g exptime 200.0 propid 2014B-0404 seeing 1.93 MJD 58433.068 object DECaLS_8299_g c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-N27 z exptime 120.0 propid 2014B-0404 seeing 1.47 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-N27 g exptime 200.0 propid 2014B-0404 seeing 1.34 MJD 58393.080 object DECaLS_24171_g c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-N27 r exptime 133.0 propid 2014B-0404 seeing 1.53 MJD 58426.052 object DECaLS_24171_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T015203_oi[N28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T004412_oi[N28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181111T013819_oi[N28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[N27,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 133.95 s, CPU: 10.97 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.454656 MB Stage tims finished: 2020-06-05T04:12:27.409268 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538e4d-g-20181111T013819_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181003T015203_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 3.057 s worker CPU, 238.333 s worker Wall, Wall: 133.954 s, Cores in use: 0.10, Total efficiency (on 4 cores): 2.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T004412_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-05T04:12:27.470988 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03130.fits Matched 2 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/reference-custom-343452p31079.fits Stage refs : Wall: 9.20 s, CPU: 8.14 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 215 MB, VmData: 247 MB, maxrss: 0.454656 MB Stage refs finished: 2020-06-05T04:12:36.669531 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.199 s, Cores in use: 0.89, Total efficiency (on 4 cores): 22.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-05T04:12:36.670873 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/outlier-mask-custom-343452p31079.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/outliers-pre-custom-343452p31079.jpg Image c4d_181002_015438_ooi_g_ls9-N27 g : masking 1586 positive outlier pixels and 0 negative outlier pixels Image c4d_181111_013819_ooi_g_ls9-N28 g : masking 1062 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_011503_ooi_r_ls9-N27 r : masking 254 positive outlier pixels and 0 negative outlier pixels Image c4d_181111_002723_ooi_z_ls9-N27 z : masking 0 positive outlier pixels and 85 negative outlier pixels Image c4d_181102_004412_ooi_z_ls9-N28 z : masking 132 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/outlier-mask-custom-343452p31079.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/outliers-post-custom-343452p31079.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/outliers-masked-pos-custom-343452p31079.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/outliers-masked-neg-custom-343452p31079.jpg Stage outliers : Wall: 10.49 s, CPU: 10.18 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 228 MB, VmData: 257 MB, maxrss: 0.454656 MB Stage outliers finished: 2020-06-05T04:12:47.164372 Resources for stage outliers : 0.655 s worker CPU, 0.655 s worker Wall, Wall: 10.494 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-05T04:12:47.165884 Stage halos : Wall: 10.69 s, CPU: 8.56 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 229 MB, VmData: 257 MB, maxrss: 0.454656 MB Stage halos finished: 2020-06-05T04:12:57.859420 Resources for stage halos : 0.155 s worker CPU, 6.679 s worker Wall, Wall: 10.695 s, Cores in use: 0.81, Total efficiency (on 4 cores): 20.4 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-05T04:12:57.861273 PSF sigmas in coadd pixels: ['3.14', '2.18'] Using average PSF sigma 2.6622303477233333 Gaussian PSF norm 0.10596182708799708 vs pixelized 0.10488449 average tim pixel scale / coadd scale: 1.0014757194524304 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.39', '2.49'] Using average PSF sigma 2.4430268549033065 Gaussian PSF norm 0.11546937816409852 vs pixelized 0.09782113 average tim pixel scale / coadd scale: 1.0014200333829344 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.64', '2.39'] Using average PSF sigma 2.012857107286946 Gaussian PSF norm 0.1401464568710012 vs pixelized 0.1163078 average tim pixel scale / coadd scale: 1.0013041123818918 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-copsf-z.fits.fz Stage fit_on_coadds : Wall: 3.39 s, CPU: 0.12 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.454656 MB Stage fit_on_coadds finished: 2020-06-05T04:13:01.250513 Resources for stage fit_on_coadds : 0.132 s worker CPU, 0.133 s worker Wall, Wall: 3.390 s, Cores in use: 0.08, Total efficiency (on 4 cores): 1.9 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-05T04:13:01.252911 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 20 potential peaks Of 20 potential peaks: 4 in veto map, 1 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 25 potential peaks Of 25 potential peaks: 18 in veto map, 3 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 24 potential peaks Of 24 potential peaks: 13 in veto map, 7 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 30 potential peaks Of 30 potential peaks: 24 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 33 potential peaks Of 33 potential peaks: 27 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 26 new sources Median coadd sky for g : 2.7828857e-05 Median coadd sky for r : 5.7487585e-05 Median coadd sky for z : 0.0002058282 Stage srcs : Wall: 7.74 s, CPU: 7.69 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.454656 MB Stage srcs finished: 2020-06-05T04:13:08.991533 Resources for stage srcs : 0.136 s worker CPU, 0.150 s worker Wall, Wall: 7.740 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/PGC1930731-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-05T04:13:09.006248 Blob 1 of 19, id: 7, sources: 5, size: 173x141, npix 11774, brick X: 44,217, Y: 92,233, one pixel: 181 92 Blob 2 of 19, id: 11, sources: 4, size: 67x48, npix 1832, brick X: 225,292, Y: 209,257, one pixel: 236 209 Blob 3 of 19, id: 2, sources: 1, size: 61x40, npix 1698, brick X: 218,279, Y: 0,40, one pixel: 224 0 Blob 4 of 19, id: 5, sources: 3, size: 51x45, npix 1110, brick X: 215,266, Y: 71,116, one pixel: 241 71 Blob 5 of 19, id: 1, sources: 1, size: 40x38, npix 1073, brick X: 118,158, Y: 0,38, one pixel: 124 0 Blob 3 finished, total: Wall: 0.14 s, CPU: 0.14 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146724 MB Blob 6 of 19, id: 16, sources: 1, size: 40x24, npix 719, brick X: 141,181, Y: 271,295, one pixel: 162 271 Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146416 MB Blob 7 of 19, id: 10, sources: 1, size: 28x38, npix 696, brick X: 0,28, Y: 178,216, one pixel: 11 178 Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.19 s, CPU: 2.19 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146724 MB Blob 8 of 19, id: 6, sources: 1, size: 33x32, npix 689, brick X: 16,49, Y: 91,123, one pixel: 31 91 Blob 6 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148176 MB Blob 9 of 19, id: 14, sources: 1, size: 31x33, npix 677, brick X: 190,221, Y: 256,289, one pixel: 203 256 Blob 8 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148904 MB Blob 10 of 19, id: 3, sources: 1, size: 30x39, npix 667, brick X: 68,98, Y: 56,95, one pixel: 87 56 Blob 7 finished, total: Wall: 1.83 s, CPU: 1.83 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14892 MB Blob 11 of 19, id: 12, sources: 2, size: 35x34, npix 559, brick X: 78,113, Y: 231,265, one pixel: 89 231 Blob 2 finished, total: Wall: 4.36 s, CPU: 4.36 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150016 MB Blob 12 of 19, id: 15, sources: 1, size: 20x34, npix 496, brick X: 0,20, Y: 260,294, one pixel: 4 260 Measuring 1 iterative sources Blob 11 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150016 MB Blob 13 of 19, id: 0, sources: 3, size: 28x24, npix 411, brick X: 34,62, Y: 0,24, one pixel: 35 0 Blob 9 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148904 MB Blob 14 of 19, id: 17, sources: 1, size: 30x20, npix 405, brick X: 265,295, Y: 275,295, one pixel: 280 275 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.46120, 31.06273), pm (-10.4, -5.8), parallax 0.574 with NanoMaggies: g=15.8, r=15.3, z=15.1 Reset brightness to NanoMaggies: g=15.8, r=15.3, z=15.1 Blob 13 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148904 MB Blob 15 of 19, id: 13, sources: 1, size: 24x24, npix 374, brick X: 143,167, Y: 245,269, one pixel: 152 245 Blob 10 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14892 MB Blob 16 of 19, id: 8, sources: 1, size: 23x23, npix 307, brick X: 89,112, Y: 97,120, one pixel: 99 97 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.76929, ee1=0.0347025, ee2=0.511216 Measuring 1 iterative sources Blob 12 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150016 MB Blob 17 of 19, id: 4, sources: 1, size: 21x22, npix 269, brick X: 262,283, Y: 58,80, one pixel: 271 58 Blob 15 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14892 MB Blob 18 of 19, id: 18, sources: 2, size: 25x15, npix 262, brick X: 23,48, Y: 280,295, one pixel: 32 280 Blob 14 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148904 MB Blob 19 of 19, id: 9, sources: 1, size: 19x19, npix 217, brick X: 241,260, Y: 174,193, one pixel: 249 174 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.46223, 31.09112), pm (-3.3, -4.1), parallax 0.428 with NanoMaggies: g=19.4, r=17.6, z=17.2 Reset brightness to NanoMaggies: g=18.9, r=18, z=17.7 Blob 18 finished, total: Wall: 0.13 s, CPU: 0.13 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148904 MB Blob 16 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.150016 MB Blob 17 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14892 MB Blob 19 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 933 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148904 MB Blob 1 finished, total: Wall: 7.34 s, CPU: 7.34 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150212 MB Old catalog: 34 New catalog: 27 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/blobs-custom-343452p31079.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/metrics/cus/all-models-custom-343452p31079.fits Stage fitblobs : Wall: 18.14 s, CPU: 7.02 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 231 MB, VmData: 257 MB, maxrss: 0.454656 MB Stage fitblobs finished: 2020-06-05T04:13:27.145303 Resources for stage fitblobs : 27.880 s worker CPU, 27.926 s worker Wall, Wall: 18.140 s, Cores in use: 1.92, Total efficiency (on 4 cores): 48.1 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-05T04:13:27.147024 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/tmp-legacysurvey-custom-343452p31079-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/tmp-legacysurvey-custom-343452p31079-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/tmp-legacysurvey-custom-343452p31079-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/tmp-legacysurvey-custom-343452p31079-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-resid.jpg Stage coadds : Wall: 8.19 s, CPU: 7.38 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 231 MB, VmData: 258 MB, maxrss: 0.454656 MB Stage coadds finished: 2020-06-05T04:13:35.338305 Resources for stage coadds : 2.187 s worker CPU, 2.356 s worker Wall, Wall: 8.192 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.2 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-05T04:13:35.339811 Cut to 1 unWISE tiles Reading WISE tile 3441p318 band 1 Reading WISE tile 3441p318 band 3 Reading WISE tile 3441p318 band 4 Reading WISE tile 3441p318 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 959 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.191 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 953 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210344 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 958 MB, VmSize: 796 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.20884 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/344/3441p318/unwise-3441p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 933 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21068 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/tmp-legacysurvey-custom-343452p31079-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/tmp-legacysurvey-custom-343452p31079-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 18.18 s, CPU: 6.30 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 232 MB, VmData: 258 MB, maxrss: 0.454656 MB Stage wise_forced finished: 2020-06-05T04:13:53.517779 Resources for stage wise_forced : 3.015 s worker CPU, 11.102 s worker Wall, Wall: 18.179 s, Cores in use: 0.51, Total efficiency (on 4 cores): 12.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-05T04:13:53.519377 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/coadd/cus/custom-343452p31079/legacysurvey-custom-343452p31079-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/tractor-i/cus/tractor-custom-343452p31079.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/tractor/cus/tractor-custom-343452p31079.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1930731/tractor/cus/brick-custom-343452p31079.sha256sum Stage writecat : Wall: 9.21 s, CPU: 8.96 s, VmPeak: 1179 MB, VmSize: 1051 MB, VmRSS: 234 MB, VmData: 258 MB, maxrss: 0.454656 MB Stage writecat finished: 2020-06-05T04:14:02.730534 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.212 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.3 % Stage writecat finished All done: 37.218 s worker CPU, 287.336 s worker Wall, Wall: 229.278 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.3 % Finished galaxy PGC1930731 in 4.041 minutes.