Started working on galaxy PGC1068365 at Sun Jun 7 05:13:07 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.51575 -3.6668 --width 281 --height 281 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T05:13:08.653279 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '142.51575', '-3.6668', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.51575 -3.6668 --width 281 --height 281 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 142.51575 -3.6668 Starting process 51835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 51836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 51837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 51838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T05:13:18.381615 Keeping 10 CCDs: c4d_181211_055538_ooi_g_ls9.fits.fz c4d_181211_055538_ooi_g_ls9-N16 g exptime 129.0 propid 2014B-0404 seeing 1.34 MJD 58463.247 object DECaLS_47464_g c4d_181211_055816_ooi_r_ls9.fits.fz c4d_181211_055816_ooi_r_ls9-N16 r exptime 52.0 propid 2014B-0404 seeing 1.08 MJD 58463.249 object DECaLS_47464_r c4d_180225_020043_ooi_z_ls9.fits.fz c4d_180225_020043_ooi_z_ls9-N16 z exptime 89.0 propid 2014B-0404 seeing 0.77 MJD 58174.084 object DECaLS_47464_z c4d_160116_061947_ooi_r_ls9.fits.fz c4d_160116_061947_ooi_r_ls9-N17 r exptime 40.0 propid 2014B-0404 seeing 0.94 MJD 57403.263 object DECaLS_15720_r c4d_160116_062117_ooi_g_ls9.fits.fz c4d_160116_062117_ooi_g_ls9-N17 g exptime 64.0 propid 2014B-0404 seeing 0.99 MJD 57403.263 object DECaLS_15720_g c4d_151128_063453_ooi_z_ls9.fits.fz c4d_151128_063453_ooi_z_ls9-N17 z exptime 102.0 propid 2014B-0404 seeing 0.88 MJD 57354.272 object DECaLS_15720_z c4d_160302_031606_ooi_r_ls9.fits.fz c4d_160302_031606_ooi_r_ls9-N16 r exptime 52.0 propid 2014B-0404 seeing 1.27 MJD 57449.135 object DECaLS_31592_r c4d_150410_011417_ooi_z_ls9.fits.fz c4d_150410_011417_ooi_z_ls9-N16 z exptime 80.0 propid 2014B-0404 seeing 0.86 MJD 57122.050 object DECaLS_31592_z c4d_180212_054134_ooi_g_ls9.fits.fz c4d_180212_054134_ooi_g_ls9-N16 g exptime 200.0 propid 2014B-0404 seeing 1.52 MJD 58161.237 object DECaLS_31592_g c4d_181211_055538_ooi_g_ls9.fits.fz c4d_181211_055538_ooi_g_ls9-N15 g exptime 129.0 propid 2014B-0404 seeing 1.38 MJD 58463.247 object DECaLS_47464_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539519-g-20181211T055538_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T020043_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575880-r-20160116T061816_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955577e-z-20151128T063217_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956fd6c-g-20160116T061925_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9570b49-r-20160302T031423_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150410T011207_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a6ef-g-20180212T054134_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538cf2-r-20181211T055816_oi[N16,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 117.46 s, CPU: 10.32 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 173 MB, VmData: 207 MB, maxrss: 0.45468 MB Stage tims finished: 2020-06-07T05:15:15.842294 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575880-r-20160116T061816_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9570b49-r-20160302T031423_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T020043_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955577e-z-20151128T063217_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150410T011207_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538cf2-r-20181211T055816_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539519-g-20181211T055538_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956fd6c-g-20160116T061925_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a6ef-g-20180212T054134_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 3.707 s worker CPU, 378.004 s worker Wall, Wall: 117.462 s, Cores in use: 0.12, Total efficiency (on 4 cores): 3.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T05:15:16.000909 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06386.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06642.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06515.fits Matched 2 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/reference-custom-142515m03666.fits Stage refs : Wall: 8.76 s, CPU: 8.06 s, VmPeak: 1025 MB, VmSize: 1016 MB, VmRSS: 195 MB, VmData: 228 MB, maxrss: 0.45468 MB Stage refs finished: 2020-06-07T05:15:24.761840 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.762 s, Cores in use: 0.92, Total efficiency (on 4 cores): 23.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T05:15:24.763100 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outlier-mask-custom-142515m03666.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-pre-custom-142515m03666.jpg Image c4d_180212_054134_ooi_g_ls9-N16 g : masking 1810 positive outlier pixels and 0 negative outlier pixels Image c4d_181211_055538_ooi_g_ls9-N16 g : masking 0 positive outlier pixels and 653 negative outlier pixels Image c4d_160116_062117_ooi_g_ls9-N17 g : masking 292 positive outlier pixels and 249 negative outlier pixels Image c4d_181211_055816_ooi_r_ls9-N16 r : masking 0 positive outlier pixels and 848 negative outlier pixels Image c4d_160302_031606_ooi_r_ls9-N16 r : masking 158 positive outlier pixels and 0 negative outlier pixels Image c4d_160116_061947_ooi_r_ls9-N17 r : masking 127 positive outlier pixels and 0 negative outlier pixels Image c4d_150410_011417_ooi_z_ls9-N16 z : masking 511 positive outlier pixels and 0 negative outlier pixels Image c4d_151128_063453_ooi_z_ls9-N17 z : masking 1367 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outlier-mask-custom-142515m03666.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-post-custom-142515m03666.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-masked-pos-custom-142515m03666.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-masked-neg-custom-142515m03666.jpg Stage outliers : Wall: 6.22 s, CPU: 5.90 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage outliers finished: 2020-06-07T05:15:30.987650 Resources for stage outliers : 0.881 s worker CPU, 0.975 s worker Wall, Wall: 6.226 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.3 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T05:15:30.989744 Stage halos : Wall: 10.23 s, CPU: 7.52 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage halos finished: 2020-06-07T05:15:41.217789 Resources for stage halos : 0.285 s worker CPU, 8.290 s worker Wall, Wall: 10.229 s, Cores in use: 0.76, Total efficiency (on 4 cores): 19.1 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T05:15:41.219486 PSF sigmas in coadd pixels: ['2.17', '1.61', '2.47'] Using average PSF sigma 2.082103285999667 Gaussian PSF norm 0.13548549376523258 vs pixelized 0.104857184 average tim pixel scale / coadd scale: 1.0011518504719412 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.76', '1.53', '2.06'] Using average PSF sigma 1.7810828244906542 Gaussian PSF norm 0.1583838706964963 vs pixelized 0.1305965 average tim pixel scale / coadd scale: 1.001166846720459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.26', '1.44', '1.40'] Using average PSF sigma 1.3662571009329347 Gaussian PSF norm 0.2064726994511155 vs pixelized 0.16094689 average tim pixel scale / coadd scale: 1.0010912656279294 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.15 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage fit_on_coadds finished: 2020-06-07T05:15:41.419659 Resources for stage fit_on_coadds : 0.185 s worker CPU, 0.202 s worker Wall, Wall: 0.201 s, Cores in use: 1.68, Total efficiency (on 4 cores): 42.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T05:15:41.421935 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 24 potential peaks Of 24 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 20 potential peaks Of 20 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 23 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 27 potential peaks Of 27 potential peaks: 24 in veto map, 2 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 19 new sources Median coadd sky for g : 1.8730907e-05 Median coadd sky for r : 8.54549e-05 Median coadd sky for z : 9.887846e-05 Stage srcs : Wall: 6.20 s, CPU: 6.15 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage srcs finished: 2020-06-07T05:15:47.623169 Resources for stage srcs : 0.128 s worker CPU, 0.132 s worker Wall, Wall: 6.202 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T05:15:47.633909 Blob 1 of 17, id: 5, sources: 5, size: 112x134, npix 7971, brick X: 76,188, Y: 94,228, one pixel: 138 94 Blob 2 of 17, id: 7, sources: 3, size: 80x79, npix 3873, brick X: 10,90, Y: 136,215, one pixel: 35 136 Blob 3 of 17, id: 9, sources: 3, size: 57x39, npix 1396, brick X: 224,281, Y: 170,209, one pixel: 246 170 Blob 4 of 17, id: 4, sources: 1, size: 45x39, npix 1209, brick X: 227,272, Y: 78,117, one pixel: 245 78 Blob 5 of 17, id: 13, sources: 1, size: 31x34, npix 710, brick X: 190,221, Y: 234,268, one pixel: 202 234 Blob 4 finished, total: Wall: 1.59 s, CPU: 1.59 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149448 MB Blob 6 of 17, id: 3, sources: 1, size: 27x29, npix 563, brick X: 254,281, Y: 50,79, one pixel: 264 50 Measuring 1 iterative sources Measuring 1 iterative sources Blob 5 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149448 MB Blob 7 of 17, id: 2, sources: 1, size: 30x28, npix 556, brick X: 51,81, Y: 45,73, one pixel: 60 45 Blob 2 finished, total: Wall: 2.42 s, CPU: 2.42 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147128 MB Blob 8 of 17, id: 10, sources: 1, size: 32x27, npix 546, brick X: 108,140, Y: 211,238, one pixel: 117 211 Blob 3 finished, total: Wall: 3.12 s, CPU: 3.12 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1468 MB Blob 9 of 17, id: 15, sources: 1, size: 30x26, npix 529, brick X: 97,127, Y: 255,281, one pixel: 111 255 Blob 7 finished, total: Wall: 2.49 s, CPU: 2.49 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149268 MB Blob 10 of 17, id: 6, sources: 1, size: 27x26, npix 447, brick X: 13,40, Y: 106,132, one pixel: 25 106 Blob 6 finished, total: Wall: 2.62 s, CPU: 2.62 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149448 MB Blob 11 of 17, id: 1, sources: 1, size: 25x23, npix 343, brick X: 105,130, Y: 11,34, one pixel: 116 11 Blob 8 finished, total: Wall: 2.60 s, CPU: 2.60 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148868 MB Blob 12 of 17, id: 0, sources: 1, size: 23x18, npix 287, brick X: 12,35, Y: 0,18, one pixel: 17 0 Blob 9 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149268 MB Blob 13 of 17, id: 16, sources: 1, size: 23x17, npix 268, brick X: 227,250, Y: 264,281, one pixel: 236 264 Blob 10 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149448 MB Blob 14 of 17, id: 8, sources: 1, size: 19x21, npix 255, brick X: 208,227, Y: 162,183, one pixel: 216 162 Blob 11 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148868 MB Blob 15 of 17, id: 14, sources: 1, size: 19x21, npix 253, brick X: 0,19, Y: 255,276, one pixel: 7 255 Blob 13 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149448 MB Blob 16 of 17, id: 11, sources: 1, size: 20x20, npix 227, brick X: 225,245, Y: 228,248, one pixel: 234 228 Blob 12 finished, total: Wall: 0.96 s, CPU: 0.95 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149268 MB Blob 17 of 17, id: 12, sources: 1, size: 19x18, npix 198, brick X: 252,271, Y: 229,247, one pixel: 260 229 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.74926, ee1=-0.264878, ee2=-0.625343 Blob 1 finished, total: Wall: 6.74 s, CPU: 6.74 s, VmPeak: 946 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149932 MB Blob 14 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148868 MB Blob 17 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 946 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149932 MB Blob 16 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 954 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149268 MB Blob 15 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149448 MB Old catalog: 27 New catalog: 27 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/blobs-custom-142515m03666.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/all-models-custom-142515m03666.fits Stage fitblobs : Wall: 10.57 s, CPU: 3.19 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage fitblobs finished: 2020-06-07T05:15:58.204613 Resources for stage fitblobs : 28.770 s worker CPU, 28.790 s worker Wall, Wall: 10.572 s, Cores in use: 3.02, Total efficiency (on 4 cores): 75.6 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T05:15:58.206359 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/tmp-legacysurvey-custom-142515m03666-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/tmp-legacysurvey-custom-142515m03666-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/tmp-legacysurvey-custom-142515m03666-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/tmp-legacysurvey-custom-142515m03666-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-resid.jpg Stage coadds : Wall: 4.69 s, CPU: 3.95 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 212 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage coadds finished: 2020-06-07T05:16:02.893886 Resources for stage coadds : 2.327 s worker CPU, 2.518 s worker Wall, Wall: 4.688 s, Cores in use: 1.34, Total efficiency (on 4 cores): 33.5 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T05:16:02.895317 Cut to 1 unWISE tiles Reading WISE tile 1421m031 band 1 Reading WISE tile 1421m031 band 2 Reading WISE tile 1421m031 band 3 Reading WISE tile 1421m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.209064 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210384 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 954 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21074 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 946 MB, VmSize: 799 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.19492 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/tmp-legacysurvey-custom-142515m03666-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/tmp-legacysurvey-custom-142515m03666-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.51 s, CPU: 3.75 s, VmPeak: 1026 MB, VmSize: 1026 MB, VmRSS: 213 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage wise_forced finished: 2020-06-07T05:16:10.403842 Resources for stage wise_forced : 3.213 s worker CPU, 12.333 s worker Wall, Wall: 7.510 s, Cores in use: 0.93, Total efficiency (on 4 cores): 23.2 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T05:16:10.405544 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142515m03666/legacysurvey-custom-142515m03666-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/tractor-i/cus/tractor-custom-142515m03666.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/tractor/cus/tractor-custom-142515m03666.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/tractor/cus/brick-custom-142515m03666.sha256sum Stage writecat : Wall: 4.07 s, CPU: 3.95 s, VmPeak: 1158 MB, VmSize: 1030 MB, VmRSS: 215 MB, VmData: 240 MB, maxrss: 0.45468 MB Stage writecat finished: 2020-06-07T05:16:14.478607 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.074 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage writecat finished All done: 39.497 s worker CPU, 431.247 s worker Wall, Wall: 176.101 s, Cores in use: 0.53, Total efficiency (on 4 cores): 13.1 % Finished galaxy PGC1068365 in 3.119 minutes. Started working on galaxy PGC1068365 at Mon Aug 10 10:13:24 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.51621713105746 -3.6668348846603127 --width 281 --height 281 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T10:13:24.986011 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '142.51621713105746', '-3.6668348846603127', '--width', '281', '--height', '281', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 142.51621713105746 -3.6668348846603127 --width 281 --height 281 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 142.51621713105746 -3.6668348846603127 Starting process 55056 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 55058 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 55059 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 55061 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 55063 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 55065 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 55067 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 55069 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T10:13:25.699913 Keeping 10 CCDs: c4d_181211_055538_ooi_g_ls9-N16 g expnum 801959 exptime 129.0 propid 2014B-0404 seeing 1.34 MJD 58463.247 object DECaLS_47464_g decam/CP/V4.8.2a/CP20181210/c4d_181211_055538_ooi_g_ls9.fits.fz c4d_181211_055816_ooi_r_ls9-N16 r expnum 801960 exptime 52.0 propid 2014B-0404 seeing 1.08 MJD 58463.249 object DECaLS_47464_r decam/CP/V4.8.2a/CP20181210/c4d_181211_055816_ooi_r_ls9.fits.fz c4d_180225_020043_ooi_z_ls9-N16 z expnum 725104 exptime 89.0 propid 2014B-0404 seeing 0.77 MJD 58174.084 object DECaLS_47464_z decam/CP/V4.8.2a/CP20180224/c4d_180225_020043_ooi_z_ls9.fits.fz c4d_160116_061947_ooi_r_ls9-N17 r expnum 511868 exptime 40.0 propid 2014B-0404 seeing 0.94 MJD 57403.263 object DECaLS_15720_r decam/CP/V4.8.2a/CP20160115/c4d_160116_061947_ooi_r_ls9.fits.fz c4d_160116_062117_ooi_g_ls9-N17 g expnum 511869 exptime 64.0 propid 2014B-0404 seeing 0.99 MJD 57403.263 object DECaLS_15720_g decam/CP/V4.8.2a/CP20160115/c4d_160116_062117_ooi_g_ls9.fits.fz c4d_151128_063453_ooi_z_ls9-N17 z expnum 497234 exptime 102.0 propid 2014B-0404 seeing 0.88 MJD 57354.272 object DECaLS_15720_z decam/CP/V4.8.2a/CP20151127/c4d_151128_063453_ooi_z_ls9.fits.fz c4d_160302_031606_ooi_r_ls9-N16 r expnum 522081 exptime 52.0 propid 2014B-0404 seeing 1.27 MJD 57449.135 object DECaLS_31592_r decam/CP/V4.8.2a/CP20160301/c4d_160302_031606_ooi_r_ls9.fits.fz c4d_150410_011417_ooi_z_ls9-N16 z expnum 431135 exptime 80.0 propid 2014B-0404 seeing 0.86 MJD 57122.050 object DECaLS_31592_z decam/CP/V4.8.2a/CP20150409/c4d_150410_011417_ooi_z_ls9.fits.fz c4d_180212_054134_ooi_g_ls9-N16 g expnum 720499 exptime 200.0 propid 2014B-0404 seeing 1.52 MJD 58161.237 object DECaLS_31592_g decam/CP/V4.8.2a/CP20180211/c4d_180212_054134_ooi_g_ls9.fits.fz c4d_181211_055538_ooi_g_ls9-N15 g expnum 801959 exptime 129.0 propid 2014B-0404 seeing 1.38 MJD 58463.247 object DECaLS_47464_g decam/CP/V4.8.2a/CP20181210/c4d_181211_055538_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955577e-z-20151128T063217_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150410T011207_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538cf2-r-20181211T055816_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539519-g-20181211T055538_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T020043_oi[N16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575880-r-20160116T061816_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956fd6c-g-20160116T061925_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9570b49-r-20160302T031423_oi[N16,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a6ef-g-20180212T054134_oi[N16,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 139.08 s, CPU: 1.11 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.179364 MB Stage tims finished: 2020-08-10T10:15:44.782936 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T020043_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956fd6c-g-20160116T061925_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539519-g-20181211T055538_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538cf2-r-20181211T055816_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9575880-r-20160116T061816_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150410T011207_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9570b49-r-20160302T031423_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955577e-z-20151128T063217_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a6ef-g-20180212T054134_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.588 s worker CPU, 350.637 s worker Wall, Wall: 139.084 s, Cores in use: 0.05, Total efficiency (on 8 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-tims.p Running stage refs Running stage refs at 2020-08-10T10:15:44.859860 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06386.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06642.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06515.fits Matched 2 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/reference-custom-142516m03666.fits Stage refs : Wall: 19.86 s, CPU: 2.07 s, VmPeak: 1035 MB, VmSize: 1026 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202836 MB Stage refs finished: 2020-08-10T10:16:04.718312 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 19.860 s, Cores in use: 0.10, Total efficiency (on 8 cores): 1.3 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T10:16:04.780216 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outlier-mask-custom-142516m03666.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-pre-custom-142516m03666.jpg Image c4d_181211_055538_ooi_g_ls9-N16 g : masking 0 positive outlier pixels and 735 negative outlier pixels Image c4d_180212_054134_ooi_g_ls9-N16 g : masking 1795 positive outlier pixels and 187 negative outlier pixels Image c4d_160116_062117_ooi_g_ls9-N17 g : masking 607 positive outlier pixels and 260 negative outlier pixels Image c4d_181211_055816_ooi_r_ls9-N16 r : masking 0 positive outlier pixels and 1006 negative outlier pixels Image c4d_160116_061947_ooi_r_ls9-N17 r : masking 265 positive outlier pixels and 0 negative outlier pixels Image c4d_150410_011417_ooi_z_ls9-N16 z : masking 502 positive outlier pixels and 0 negative outlier pixels Image c4d_151128_063453_ooi_z_ls9-N17 z : masking 1360 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outlier-mask-custom-142516m03666.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-post-custom-142516m03666.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-masked-pos-custom-142516m03666.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/outliers-masked-neg-custom-142516m03666.jpg Stage outliers : Wall: 0.90 s, CPU: 0.61 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 212 MB, VmData: 243 MB, maxrss: 0.21744 MB Stage outliers finished: 2020-08-10T10:16:05.682492 Resources for stage outliers : 0.855 s worker CPU, 0.856 s worker Wall, Wall: 0.903 s, Cores in use: 1.62, Total efficiency (on 8 cores): 20.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T10:16:05.702222 Stage halos : Wall: 0.43 s, CPU: 0.27 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 213 MB, VmData: 243 MB, maxrss: 0.217628 MB Stage halos finished: 2020-08-10T10:16:06.136231 Resources for stage halos : 0.357 s worker CPU, 1.017 s worker Wall, Wall: 0.435 s, Cores in use: 1.44, Total efficiency (on 8 cores): 18.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T10:16:06.202903 PSF sigmas in coadd pixels: ['2.17', '1.61', '2.47'] Using average PSF sigma 2.082103285999667 Gaussian PSF norm 0.13548549376523258 vs pixelized 0.10485763 average tim pixel scale / coadd scale: 1.0011518504719412 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.76', '1.53', '2.06'] Using average PSF sigma 1.7810828244906542 Gaussian PSF norm 0.1583838706964963 vs pixelized 0.13059786 average tim pixel scale / coadd scale: 1.001166846720459 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.26', '1.44', '1.40'] Using average PSF sigma 1.3662571009329347 Gaussian PSF norm 0.2064726994511155 vs pixelized 0.16094963 average tim pixel scale / coadd scale: 1.0010912656279294 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.15 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 214 MB, VmData: 243 MB, maxrss: 0.219276 MB Stage fit_on_coadds finished: 2020-08-10T10:16:06.368893 Resources for stage fit_on_coadds : 0.202 s worker CPU, 0.202 s worker Wall, Wall: 0.167 s, Cores in use: 2.11, Total efficiency (on 8 cores): 26.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T10:16:06.380535 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 25 potential peaks Of 25 potential peaks: 8 in veto map, 4 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 25 potential peaks Of 25 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept SED r : 6 new peaks Found 19 potential peaks Of 19 potential peaks: 17 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 28 potential peaks Of 28 potential peaks: 24 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 29 potential peaks Of 29 potential peaks: 25 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 20 new sources Median coadd sky for g : 2.4178953e-05 Median coadd sky for r : 7.381537e-05 Median coadd sky for z : 4.1737727e-05 Stage srcs : Wall: 0.55 s, CPU: 0.50 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 215 MB, VmData: 243 MB, maxrss: 0.219808 MB Stage srcs finished: 2020-08-10T10:16:06.933586 Resources for stage srcs : 0.108 s worker CPU, 0.108 s worker Wall, Wall: 0.554 s, Cores in use: 1.10, Total efficiency (on 8 cores): 13.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T10:16:06.946463 Blob 1 of 18, id: 5, sources: 5, size: 112x148, npix 8155, brick X: 83,195, Y: 81,229, one pixel: 129 81 Blob 2 of 18, id: 7, sources: 3, size: 79x79, npix 3843, brick X: 17,96, Y: 137,216, one pixel: 41 137 Blob 3 of 18, id: 10, sources: 3, size: 50x38, npix 1216, brick X: 231,281, Y: 171,209, one pixel: 250 171 Blob 4 of 18, id: 4, sources: 1, size: 45x40, npix 1204, brick X: 234,279, Y: 78,118, one pixel: 252 78 Blob 5 of 18, id: 14, sources: 1, size: 32x33, npix 709, brick X: 196,228, Y: 235,268, one pixel: 208 235 Blob 6 of 18, id: 2, sources: 1, size: 31x28, npix 561, brick X: 57,88, Y: 45,73, one pixel: 67 45 Blob 7 of 18, id: 11, sources: 1, size: 32x27, npix 537, brick X: 114,146, Y: 211,238, one pixel: 124 211 Blob 8 of 18, id: 16, sources: 1, size: 30x25, npix 523, brick X: 104,134, Y: 256,281, one pixel: 117 256 Blob 9 of 18, id: 6, sources: 1, size: 28x26, npix 445, brick X: 19,47, Y: 107,133, one pixel: 30 107 Blob 5 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145548 MB Blob 10 of 18, id: 3, sources: 1, size: 21x29, npix 426, brick X: 260,281, Y: 50,79, one pixel: 272 50 Blob 8 finished, total: Wall: 1.19 s, CPU: 0.98 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145644 MB Blob 11 of 18, id: 1, sources: 1, size: 24x23, npix 349, brick X: 112,136, Y: 12,35, one pixel: 122 12 Blob 4 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147928 MB Blob 12 of 18, id: 0, sources: 1, size: 24x18, npix 298, brick X: 18,42, Y: 0,18, one pixel: 23 0 Blob 6 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147828 MB Blob 13 of 18, id: 15, sources: 1, size: 22x22, npix 290, brick X: 3,25, Y: 255,277, one pixel: 14 255 Blob 9 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145548 MB Blob 14 of 18, id: 17, sources: 1, size: 23x17, npix 258, brick X: 234,257, Y: 264,281, one pixel: 243 264 Blob 7 finished, total: Wall: 2.13 s, CPU: 1.87 s, VmPeak: 952 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146932 MB Blob 15 of 18, id: 8, sources: 1, size: 20x22, npix 250, brick X: 214,234, Y: 162,184, one pixel: 223 162 Blob 11 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147928 MB Blob 16 of 18, id: 12, sources: 1, size: 19x20, npix 226, brick X: 232,251, Y: 229,249, one pixel: 240 229 Blob 12 finished, total: Wall: 0.95 s, CPU: 0.94 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147892 MB Blob 17 of 18, id: 9, sources: 1, size: 14x22, npix 212, brick X: 0,14, Y: 167,189, one pixel: 2 167 Blob 15 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147928 MB Blob 18 of 18, id: 13, sources: 1, size: 19x19, npix 199, brick X: 259,278, Y: 229,248, one pixel: 267 229 Blob 13 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145548 MB Blob 10 finished, total: Wall: 1.41 s, CPU: 1.41 s, VmPeak: 940 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147456 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 16 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147892 MB Blob 14 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 952 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147188 MB Blob 17 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 956 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147928 MB Blob 18 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 939 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145548 MB Blob 2 finished, total: Wall: 3.44 s, CPU: 3.10 s, VmPeak: 951 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145308 MB Blob 3 finished, total: Wall: 3.53 s, CPU: 3.53 s, VmPeak: 968 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143464 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.63775, ee1=-0.253226, ee2=-0.60611 Blob 1 finished, total: Wall: 5.58 s, CPU: 5.58 s, VmPeak: 944 MB, VmSize: 726 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149536 MB Old catalog: 28 New catalog: 28 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/blobs-custom-142516m03666.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/metrics/cus/all-models-custom-142516m03666.fits Stage fitblobs : Wall: 6.01 s, CPU: 0.46 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 215 MB, VmData: 243 MB, maxrss: 0.220164 MB Stage fitblobs finished: 2020-08-10T10:16:12.961237 Resources for stage fitblobs : 26.748 s worker CPU, 27.601 s worker Wall, Wall: 6.016 s, Cores in use: 4.52, Total efficiency (on 8 cores): 56.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T10:16:12.974307 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/tmp-legacysurvey-custom-142516m03666-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/tmp-legacysurvey-custom-142516m03666-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/tmp-legacysurvey-custom-142516m03666-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/tmp-legacysurvey-custom-142516m03666-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-resid.jpg Stage coadds : Wall: 1.55 s, CPU: 0.70 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 215 MB, VmData: 243 MB, maxrss: 0.220616 MB Stage coadds finished: 2020-08-10T10:16:14.521278 Resources for stage coadds : 3.913 s worker CPU, 4.590 s worker Wall, Wall: 1.548 s, Cores in use: 2.98, Total efficiency (on 8 cores): 37.3 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T10:16:14.535529 Cut to 1 unWISE tiles Reading WISE tile 1421m031 band 1 Reading WISE tile 1421m031 band 2 Reading WISE tile 1421m031 band 3 Reading WISE tile 1421m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 944 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.194228 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 940 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.206292 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 951 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.207348 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/142/1421m031/unwise-1421m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 968 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.206532 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/tmp-legacysurvey-custom-142516m03666-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/tmp-legacysurvey-custom-142516m03666-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.45 s, CPU: 0.78 s, VmPeak: 1036 MB, VmSize: 1036 MB, VmRSS: 216 MB, VmData: 243 MB, maxrss: 0.22132 MB Stage wise_forced finished: 2020-08-10T10:16:16.981222 Resources for stage wise_forced : 3.316 s worker CPU, 5.014 s worker Wall, Wall: 2.447 s, Cores in use: 1.68, Total efficiency (on 8 cores): 21.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T10:16:17.067131 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/coadd/cus/custom-142516m03666/legacysurvey-custom-142516m03666-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/tractor-i/cus/tractor-custom-142516m03666.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/tractor/cus/tractor-custom-142516m03666.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/tractor/cus/brick-custom-142516m03666.sha256sum Stage writecat : Wall: 0.79 s, CPU: 0.62 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 218 MB, VmData: 243 MB, maxrss: 0.354192 MB Stage writecat finished: 2020-08-10T10:16:17.852985 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.787 s, Cores in use: 0.79, Total efficiency (on 8 cores): 9.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/142/PGC1068365/PGC1068365-largegalaxy-writecat.p All done: 41.088 s worker CPU, 390.025 s worker Wall, Wall: 172.174 s, Cores in use: 0.28, Total efficiency (on 8 cores): 3.5 % Finished galaxy PGC1068365 in 2.901 minutes.