Started working on galaxy PGC058110 at Thu Jun 4 06:36:46 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 246.49253249999998 4.24335 --width 285 --height 285 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T06:36:47.115190 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '246.49253249999998', '4.24335', '--width', '285', '--height', '285', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 246.49253249999998 4.24335 --width 285 --height 285 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 246.49253249999998 4.24335 Starting process 43065 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057456 MB Starting process 43066 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05746 MB Starting process 43068 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057468 MB Starting process 43069 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB Starting process 43071 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057468 MB Starting process 43072 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057472 MB Starting process 43073 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057472 MB Starting process 43074 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057472 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T06:36:48.696363 Keeping 9 CCDs: c4d_170422_094457_ooi_z_ls9.fits.fz c4d_170422_094457_ooi_z_ls9-S23 z exptime 117.0 propid 2014B-0404 seeing 0.88 MJD 57865.404 object DECaLS_15101_z c4d_180516_081411_ooi_g_ls9.fits.fz c4d_180516_081411_ooi_g_ls9-S23 g exptime 143.0 propid 2014B-0404 seeing 1.26 MJD 58254.343 object DECaLS_15101_g c4d_170722_031913_ooi_r_ls9.fits.fz c4d_170722_031913_ooi_r_ls9-S23 r exptime 46.0 propid 2014B-0404 seeing 1.03 MJD 57956.137 object DECaLS_15101_r c4d_180911_004858_ooi_r_ls9.fits.fz c4d_180911_004858_ooi_r_ls9-S21 r exptime 64.0 propid 2014B-0404 seeing 1.36 MJD 58372.034 object DECaLS_46845_r c4d_170515_090000_ooi_z_ls9.fits.fz c4d_170515_090000_ooi_z_ls9-S21 z exptime 250.0 propid 2014B-0404 seeing 1.41 MJD 57888.371 object DECaLS_46845_z c4d_180910_003827_ooi_g_ls9.fits.fz c4d_180910_003827_ooi_g_ls9-S21 g exptime 136.0 propid 2014B-0404 seeing 1.47 MJD 58371.027 object DECaLS_46845_g c4d_160409_075524_ooi_r_ls9.fits.fz c4d_160409_075524_ooi_r_ls9-S22 r exptime 106.0 propid 2014B-0404 seeing 1.25 MJD 57487.328 object DECaLS_30973_r c4d_170515_051019_ooi_z_ls9.fits.fz c4d_170515_051019_ooi_z_ls9-S22 z exptime 144.0 propid 2014B-0404 seeing 1.35 MJD 57888.213 object DECaLS_30973_z c4d_160802_235016_ooi_g_ls9.fits.fz c4d_160802_235016_ooi_g_ls9-S22 g exptime 120.0 propid 2014B-0404 seeing 1.37 MJD 57602.991 object DECaLS_30973_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95144db-z-20170422T094210_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180911T004858_oi[S21,noinherit][2046,4094][real]: DECaLS_4684 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530281-g-20180516T081411_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516f40-z-20170515T085455_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T075247_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180910T003827_oi[S21,noinherit][2046,4094][real]: DECaLS_4684 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160802T234726_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T031733_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95164f7-z-20170515T050659_oi[S22,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 56.27 s, CPU: 1.96 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.452716 MB Stage tims finished: 2020-06-04T06:37:44.964308 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180911T004858_oi[S21,noinherit][2046,4094][real]: DECaLS_4684 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530281-g-20180516T081411_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e596-r-20160409T075247_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180910T003827_oi[S21,noinherit][2046,4094][real]: DECaLS_4684 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516f40-z-20170515T085455_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95144db-z-20170422T094210_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160802T234726_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95164f7-z-20170515T050659_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T031733_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.449 s worker CPU, 243.658 s worker Wall, Wall: 56.269 s, Cores in use: 0.13, Total efficiency (on 8 cores): 1.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-04T06:37:44.986060 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05784.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05655.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/reference-custom-246492p04243.fits Stage refs : Wall: 7.88 s, CPU: 6.53 s, VmPeak: 1055 MB, VmSize: 1049 MB, VmRSS: 231 MB, VmData: 263 MB, maxrss: 0.452716 MB Stage refs finished: 2020-06-04T06:37:52.865941 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.881 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T06:37:52.867673 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/outlier-mask-custom-246492p04243.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/outliers-pre-custom-246492p04243.jpg Image c4d_160802_235016_ooi_g_ls9-S22 g : masking 409 positive outlier pixels and 0 negative outlier pixels Image c4d_160409_075524_ooi_r_ls9-S22 r : masking 491 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_031913_ooi_r_ls9-S23 r : masking 3536 positive outlier pixels and 0 negative outlier pixels Image c4d_180911_004858_ooi_r_ls9-S21 r : masking 460 positive outlier pixels and 0 negative outlier pixels Image c4d_170515_051019_ooi_z_ls9-S22 z : masking 473 positive outlier pixels and 0 negative outlier pixels Image c4d_170422_094457_ooi_z_ls9-S23 z : masking 0 positive outlier pixels and 92 negative outlier pixels Image c4d_170515_090000_ooi_z_ls9-S21 z : masking 834 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/outlier-mask-custom-246492p04243.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/outliers-post-custom-246492p04243.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/outliers-masked-pos-custom-246492p04243.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/outliers-masked-neg-custom-246492p04243.jpg Stage outliers : Wall: 3.58 s, CPU: 3.18 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 247 MB, VmData: 276 MB, maxrss: 0.452716 MB Stage outliers finished: 2020-06-04T06:37:56.444717 Resources for stage outliers : 1.483 s worker CPU, 1.489 s worker Wall, Wall: 3.578 s, Cores in use: 1.30, Total efficiency (on 8 cores): 16.3 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T06:37:56.446649 Stage halos : Wall: 4.81 s, CPU: 3.32 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 248 MB, VmData: 276 MB, maxrss: 0.452716 MB Stage halos finished: 2020-06-04T06:38:01.259529 Resources for stage halos : 0.680 s worker CPU, 6.093 s worker Wall, Wall: 4.814 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.4 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T06:38:01.261896 PSF sigmas in coadd pixels: ['2.04', '2.38', '2.23'] Using average PSF sigma 2.2197403331432777 Gaussian PSF norm 0.12708459073427567 vs pixelized 0.10534349 average tim pixel scale / coadd scale: 1.0011298226491185 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.68', '2.21', '2.03'] Using average PSF sigma 1.9720225120037316 Gaussian PSF norm 0.14304846423241255 vs pixelized 0.12225874 average tim pixel scale / coadd scale: 1.0011535500467734 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.44', '2.29', '2.19'] Using average PSF sigma 1.971204830446104 Gaussian PSF norm 0.14310780260721925 vs pixelized 0.117501274 average tim pixel scale / coadd scale: 1.0011881413933543 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.26 s, CPU: 0.20 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.452716 MB Stage fit_on_coadds finished: 2020-06-04T06:38:01.517699 Resources for stage fit_on_coadds : 0.436 s worker CPU, 0.443 s worker Wall, Wall: 0.257 s, Cores in use: 2.46, Total efficiency (on 8 cores): 30.8 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T06:38:01.520686 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 74 potential peaks Of 74 potential peaks: 43 in veto map, 15 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 68 potential peaks Of 68 potential peaks: 53 in veto map, 9 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 50 potential peaks Of 50 potential peaks: 41 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 59 potential peaks Of 59 potential peaks: 48 in veto map, 9 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 66 potential peaks Of 66 potential peaks: 55 in veto map, 9 cut by saddle test, 1 cut by aper test, 1 kept SED Red : 1 new peaks Adding 25 new sources Median coadd sky for g : 0.00017309374 Median coadd sky for r : 0.00034587376 Median coadd sky for z : 0.0012891691 Stage srcs : Wall: 2.49 s, CPU: 2.45 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 249 MB, VmData: 276 MB, maxrss: 0.452716 MB Stage srcs finished: 2020-06-04T06:38:04.007107 Resources for stage srcs : 0.104 s worker CPU, 0.104 s worker Wall, Wall: 2.487 s, Cores in use: 1.03, Total efficiency (on 8 cores): 12.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/PGC058110-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T06:38:04.021966 Blob 1 of 9, id: 1, sources: 23, size: 285x285, npix 43005, brick X: 0,285, Y: 0,285, one pixel: 127 0 Blob 2 of 9, id: 3, sources: 3, size: 67x44, npix 2123, brick X: 36,103, Y: 7,51, one pixel: 61 7 Blob 3 of 9, id: 2, sources: 4, size: 71x35, npix 1864, brick X: 205,276, Y: 0,35, one pixel: 210 0 Blob 4 of 9, id: 6, sources: 4, size: 33x52, npix 1101, brick X: 252,285, Y: 233,285, one pixel: 273 233 Blob 5 of 9, id: 8, sources: 1, size: 40x32, npix 916, brick X: 41,81, Y: 253,285, one pixel: 59 253 Blob 6 of 9, id: 4, sources: 1, size: 26x29, npix 493, brick X: 259,285, Y: 69,98, one pixel: 272 69 Blob 7 of 9, id: 5, sources: 1, size: 20x21, npix 238, brick X: 223,243, Y: 232,253, one pixel: 232 232 Blob 8 of 9, id: 7, sources: 1, size: 20x20, npix 228, brick X: 208,228, Y: 247,267, one pixel: 218 247 Blob 9 of 9, id: 0, sources: 2, size: 13x14, npix 134, brick X: 0,13, Y: 0,14, one pixel: 0 0 Blob 8 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146212 MB Blob 7 finished, total: Wall: 0.30 s, CPU: 0.28 s, VmPeak: 952 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.14688 MB Blob 6 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 929 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148128 MB Blob 5 finished, total: Wall: 0.88 s, CPU: 0.87 s, VmPeak: 954 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146636 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (246.48540, 4.23287), pm (-5.6, -19.1), parallax 0.974 with NanoMaggies: g=14.9, r=14.5, z=15 Reset brightness to NanoMaggies: g=15, r=14.5, z=14.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (246.48519, 4.23254), pm (-5.6, -19.0), parallax 0.949 with NanoMaggies: g=(flux -415), r=(flux -128), z=15.3 Reset brightness to NanoMaggies: g=16.7, r=15.7, z=15.2 Blob 3 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 937 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147892 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (246.50441, 4.23328), pm (6.1, -5.1), parallax 0.093 with NanoMaggies: g=16.6, r=14.1, z=13.2 Reset brightness to NanoMaggies: g=21.9, r=20.4, z=19.2 Blob 9 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148176 MB Blob 4 finished, total: Wall: 1.57 s, CPU: 1.57 s, VmPeak: 931 MB, VmSize: 715 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143256 MB Blob 2 finished, total: Wall: 2.22 s, CPU: 2.21 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147868 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.02297, ee1=0.102905, ee2=0.171855 Measuring 1 iterative sources Blob 1 finished, total: Wall: 34.14 s, CPU: 34.13 s, VmPeak: 947 MB, VmSize: 734 MB, VmRSS: 165 MB, VmData: 197 MB, maxrss: 0.180452 MB Old catalog: 46 New catalog: 37 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/blobs-custom-246492p04243.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/metrics/cus/all-models-custom-246492p04243.fits Stage fitblobs : Wall: 37.28 s, CPU: 3.09 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 252 MB, VmData: 279 MB, maxrss: 0.452716 MB Stage fitblobs finished: 2020-06-04T06:38:41.300566 Resources for stage fitblobs : 42.324 s worker CPU, 42.471 s worker Wall, Wall: 37.280 s, Cores in use: 1.22, Total efficiency (on 8 cores): 15.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T06:38:41.302575 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/tmp-legacysurvey-custom-246492p04243-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/tmp-legacysurvey-custom-246492p04243-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/tmp-legacysurvey-custom-246492p04243-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/tmp-legacysurvey-custom-246492p04243-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-resid.jpg Stage coadds : Wall: 2.77 s, CPU: 1.67 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 253 MB, VmData: 279 MB, maxrss: 0.452716 MB Stage coadds finished: 2020-06-04T06:38:44.071611 Resources for stage coadds : 4.173 s worker CPU, 4.570 s worker Wall, Wall: 2.770 s, Cores in use: 2.11, Total efficiency (on 8 cores): 26.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T06:38:44.073726 Cut to 1 unWISE tiles Reading WISE tile 2460p045 band 2 Reading WISE tile 2460p045 band 1 Reading WISE tile 2460p045 band 3 Reading WISE tile 2460p045 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 931 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.204336 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 930 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.188888 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 929 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.204516 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/246/2460p045/unwise-2460p045-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 952 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21054 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/tmp-legacysurvey-custom-246492p04243-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/tmp-legacysurvey-custom-246492p04243-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.98 s, CPU: 1.55 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 253 MB, VmData: 279 MB, maxrss: 0.452716 MB Stage wise_forced finished: 2020-06-04T06:38:47.053357 Resources for stage wise_forced : 3.410 s worker CPU, 4.417 s worker Wall, Wall: 2.981 s, Cores in use: 1.67, Total efficiency (on 8 cores): 20.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T06:38:47.055484 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/coadd/cus/custom-246492p04243/legacysurvey-custom-246492p04243-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/tractor-i/cus/tractor-custom-246492p04243.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/tractor/cus/tractor-custom-246492p04243.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/246/PGC058110/tractor/cus/brick-custom-246492p04243.sha256sum Stage writecat : Wall: 4.74 s, CPU: 4.56 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 255 MB, VmData: 279 MB, maxrss: 0.452716 MB Stage writecat finished: 2020-06-04T06:38:51.797307 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.743 s, Cores in use: 0.96, Total efficiency (on 8 cores): 12.0 % Stage writecat finished All done: 58.060 s worker CPU, 303.249 s worker Wall, Wall: 123.108 s, Cores in use: 0.70, Total efficiency (on 8 cores): 8.8 % Finished galaxy PGC058110 in 2.097 minutes.