Started working on galaxy PGC1859322 at Fri Jun 5 03:50:33 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.84575650000002 29.2162922 --width 255 --height 255 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-05T03:50:35.126988 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '122.84575650000002', '29.2162922', '--width', '255', '--height', '255', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 122.84575650000002 29.2162922 --width 255 --height 255 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 122.84575650000002 29.2162922 Starting process 15616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 15617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 15618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 15619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-05T03:50:44.305863 Keeping 12 CCDs: c4d_180209_044856_ooi_r_ls9.fits.fz c4d_180209_044856_ooi_r_ls9-S16 r exptime 120.0 propid 2014B-0404 seeing 1.23 MJD 58158.201 object DECaLS_26686_r c4d_180209_045124_ooi_r_ls9.fits.fz c4d_180209_045124_ooi_r_ls9-S16 r exptime 120.0 propid 2014B-0404 seeing 1.12 MJD 58158.202 object DECaLS_26686_r c4d_161229_062636_ooi_g_ls9.fits.fz c4d_161229_062636_ooi_g_ls9-S16 g exptime 175.0 propid 2014B-0404 seeing 1.78 MJD 57751.266 object DECaLS_26686_g c4d_160409_232826_ooi_z_ls9.fits.fz c4d_160409_232826_ooi_z_ls9-S16 z exptime 153.0 propid 2014B-0404 seeing 1.33 MJD 57487.976 object DECaLS_26686_z c4d_181209_062902_ooi_r_ls9.fits.fz c4d_181209_062902_ooi_r_ls9-S17 r exptime 75.0 propid 2014B-0404 seeing 1.58 MJD 58461.270 object DECaLS_10814_r c4d_180214_041836_ooi_g_ls9.fits.fz c4d_180214_041836_ooi_g_ls9-S17 g exptime 200.0 propid 2014B-0404 seeing 1.44 MJD 58163.180 object DECaLS_10814_g c4d_141228_061536_ooi_g_ls9.fits.fz c4d_141228_061536_ooi_g_ls9-S17 g exptime 84.0 propid 2014B-0404 seeing 1.81 MJD 57019.259 object DECaLS_10814_g c4d_141228_060955_ooi_r_ls9.fits.fz c4d_141228_060955_ooi_r_ls9-S17 r exptime 69.0 propid 2014B-0404 seeing 1.65 MJD 57019.255 object DECaLS_10814_r c4d_141231_050134_ooi_z_ls9.fits.fz c4d_141231_050134_ooi_z_ls9-S17 z exptime 123.0 propid 2014B-0404 seeing 1.06 MJD 57022.207 object DECaLS_10814_z c4d_181110_080159_ooi_r_ls9.fits.fz c4d_181110_080159_ooi_r_ls9-S21 r exptime 130.0 propid 2014B-0404 seeing 1.69 MJD 58432.335 object DECaLS_42558_r c4d_180314_011323_ooi_g_ls9.fits.fz c4d_180314_011323_ooi_g_ls9-S21 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58191.051 object DECaLS_42558_g c4d_180314_003151_ooi_z_ls9.fits.fz c4d_180314_003151_ooi_z_ls9-S21 z exptime 250.0 propid 2014B-0404 seeing 1.34 MJD 58191.022 object DECaLS_42558_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955833c-g-20161229T062250_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180209T044856_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180209T045124_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T232503_oi[S16,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538963-r-20181209T062902_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ad11-g-20180214T041836_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9552e01-g-20141228T061320_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95506eb-r-20141228T060754_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953861c-r-20181110T080159_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ccca-g-20180314T011323_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559743-z-20141231T045842_oi[S17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9528b21-z-20180314T003151_oi[S21,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 149.54 s, CPU: 9.34 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.454628 MB Stage tims finished: 2020-06-05T03:53:13.845550 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180209T044856_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ad11-g-20180214T041836_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953861c-r-20181110T080159_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160409T232503_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9552e01-g-20141228T061320_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ccca-g-20180314T011323_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180209T045124_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95506eb-r-20141228T060754_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9528b21-z-20180314T003151_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955833c-g-20161229T062250_oi[S16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538963-r-20181209T062902_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559743-z-20141231T045842_oi[S17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.123 s worker CPU, 368.126 s worker Wall, Wall: 149.541 s, Cores in use: 0.09, Total efficiency (on 4 cores): 2.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-05T03:53:13.868959 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03051.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03180.fits Matched 11 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/reference-custom-122845p29216.fits Stage refs : Wall: 8.33 s, CPU: 7.88 s, VmPeak: 1026 MB, VmSize: 1020 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.454628 MB Stage refs finished: 2020-06-05T03:53:22.195360 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.327 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-05T03:53:22.196720 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/outlier-mask-custom-122845p29216.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/outliers-pre-custom-122845p29216.jpg Image c4d_161229_062636_ooi_g_ls9-S16 g : masking 373 positive outlier pixels and 0 negative outlier pixels Image c4d_180314_011323_ooi_g_ls9-S21 g : masking 158 positive outlier pixels and 0 negative outlier pixels Image c4d_181209_062902_ooi_r_ls9-S17 r : masking 264 positive outlier pixels and 0 negative outlier pixels Image c4d_180314_003151_ooi_z_ls9-S21 z : masking 267 positive outlier pixels and 0 negative outlier pixels Image c4d_160409_232826_ooi_z_ls9-S16 z : masking 67 positive outlier pixels and 0 negative outlier pixels Image c4d_141231_050134_ooi_z_ls9-S17 z : masking 0 positive outlier pixels and 71 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/outlier-mask-custom-122845p29216.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/outliers-post-custom-122845p29216.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/outliers-masked-pos-custom-122845p29216.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/outliers-masked-neg-custom-122845p29216.jpg Stage outliers : Wall: 5.26 s, CPU: 4.62 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 213 MB, VmData: 244 MB, maxrss: 0.454628 MB Stage outliers finished: 2020-06-05T03:53:27.452735 Resources for stage outliers : 0.962 s worker CPU, 0.970 s worker Wall, Wall: 5.257 s, Cores in use: 1.06, Total efficiency (on 4 cores): 26.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-05T03:53:27.454336 Stage halos : Wall: 8.54 s, CPU: 5.83 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 213 MB, VmData: 244 MB, maxrss: 0.454628 MB Stage halos finished: 2020-06-05T03:53:35.996161 Resources for stage halos : 0.551 s worker CPU, 10.789 s worker Wall, Wall: 8.543 s, Cores in use: 0.75, Total efficiency (on 4 cores): 18.7 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-05T03:53:35.998226 PSF sigmas in coadd pixels: ['2.90', '2.33', '2.95', '2.60'] Using average PSF sigma 2.6928266635285296 Gaussian PSF norm 0.10475787231111151 vs pixelized 0.09610222 average tim pixel scale / coadd scale: 1.001322907680034 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.00', '1.83', '2.57', '2.69', '2.75'] Using average PSF sigma 2.3667464598714263 Gaussian PSF norm 0.11919096386403931 vs pixelized 0.10295836 average tim pixel scale / coadd scale: 1.0014292210845261 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.16', '1.71', '2.18'] Using average PSF sigma 2.019898548246734 Gaussian PSF norm 0.13965790114495383 vs pixelized 0.1166383 average tim pixel scale / coadd scale: 1.0012856503337166 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.20 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.454628 MB Stage fit_on_coadds finished: 2020-06-05T03:53:36.234725 Resources for stage fit_on_coadds : 0.238 s worker CPU, 0.252 s worker Wall, Wall: 0.238 s, Cores in use: 1.83, Total efficiency (on 4 cores): 45.9 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-05T03:53:36.237720 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 34 potential peaks Of 34 potential peaks: 15 in veto map, 4 cut by saddle test, 0 cut by aper test, 15 kept SED z : 15 new peaks Found 28 potential peaks Of 28 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 21 potential peaks Of 21 potential peaks: 17 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 26 potential peaks Of 26 potential peaks: 20 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 27 potential peaks Of 27 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 17 new sources Median coadd sky for g : 8.04515e-05 Median coadd sky for r : 0.00028897854 Median coadd sky for z : 0.00069083535 Stage srcs : Wall: 5.92 s, CPU: 5.89 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.454628 MB Stage srcs finished: 2020-06-05T03:53:42.160386 Resources for stage srcs : 0.104 s worker CPU, 0.113 s worker Wall, Wall: 5.924 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/PGC1859322-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-05T03:53:42.172250 Blob 1 of 13, id: 5, sources: 1, size: 166x111, npix 12259, brick X: 51,217, Y: 71,182, one pixel: 110 71 Blob 2 of 13, id: 9, sources: 4, size: 66x63, npix 2340, brick X: 10,76, Y: 192,255, one pixel: 42 192 Blob 3 of 13, id: 10, sources: 4, size: 61x53, npix 1947, brick X: 194,255, Y: 202,255, one pixel: 220 202 Blob 4 of 13, id: 0, sources: 1, size: 47x40, npix 1436, brick X: 87,134, Y: 0,40, one pixel: 97 0 Blob 5 of 13, id: 2, sources: 2, size: 48x44, npix 1249, brick X: 9,57, Y: 7,51, one pixel: 20 7 Blob 4 finished, total: Wall: 2.56 s, CPU: 2.56 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.1464 MB Blob 6 of 13, id: 8, sources: 1, size: 35x43, npix 990, brick X: 39,74, Y: 153,196, one pixel: 51 153 Measuring 1 iterative sources Blob 3 finished, total: Wall: 4.34 s, CPU: 4.34 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146204 MB Blob 7 of 13, id: 3, sources: 1, size: 35x34, npix 813, brick X: 174,209, Y: 27,61, one pixel: 189 27 Measuring 1 iterative sources Blob 5 finished, total: Wall: 3.34 s, CPU: 3.34 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148952 MB Blob 8 of 13, id: 6, sources: 1, size: 32x30, npix 657, brick X: 9,41, Y: 86,116, one pixel: 21 86 Blob 6 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148276 MB Blob 9 of 13, id: 1, sources: 1, size: 30x29, npix 585, brick X: 153,183, Y: 2,31, one pixel: 167 2 Blob 2 finished, total: Wall: 6.56 s, CPU: 6.55 s, VmPeak: 967 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149012 MB Blob 10 of 13, id: 12, sources: 1, size: 36x21, npix 559, brick X: 139,175, Y: 234,255, one pixel: 155 234 Blob 8 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148276 MB Blob 11 of 13, id: 7, sources: 2, size: 20x35, npix 511, brick X: 235,255, Y: 94,129, one pixel: 249 94 Blob 7 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148952 MB Blob 12 of 13, id: 11, sources: 1, size: 26x21, npix 401, brick X: 85,111, Y: 234,255, one pixel: 97 234 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.32495, ee1=-0.248534, ee2=-0.208118 Measuring 1 iterative sources Blob 9 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 967 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149012 MB Blob 13 of 13, id: 4, sources: 1, size: 19x20, npix 209, brick X: 207,226, Y: 48,68, one pixel: 216 48 Blob 1 finished, total: Wall: 7.61 s, CPU: 7.60 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150036 MB Blob 10 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148276 MB Blob 12 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 967 MB, VmSize: 719 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149012 MB Blob 13 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150036 MB Blob 11 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 961 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148952 MB Old catalog: 27 New catalog: 24 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/blobs-custom-122845p29216.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/metrics/cus/all-models-custom-122845p29216.fits Stage fitblobs : Wall: 14.69 s, CPU: 5.87 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 216 MB, VmData: 245 MB, maxrss: 0.454628 MB Stage fitblobs finished: 2020-06-05T03:53:56.861972 Resources for stage fitblobs : 33.731 s worker CPU, 33.763 s worker Wall, Wall: 14.691 s, Cores in use: 2.70, Total efficiency (on 4 cores): 67.4 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-05T03:53:56.863677 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/tmp-legacysurvey-custom-122845p29216-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/tmp-legacysurvey-custom-122845p29216-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/tmp-legacysurvey-custom-122845p29216-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/tmp-legacysurvey-custom-122845p29216-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-resid.jpg Stage coadds : Wall: 7.19 s, CPU: 6.44 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 217 MB, VmData: 245 MB, maxrss: 0.454628 MB Stage coadds finished: 2020-06-05T03:54:04.058439 Resources for stage coadds : 2.498 s worker CPU, 2.615 s worker Wall, Wall: 7.196 s, Cores in use: 1.24, Total efficiency (on 4 cores): 31.1 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-05T03:54:04.060176 Cut to 1 unWISE tiles Reading WISE tile 1234p287 band 1 Reading WISE tile 1234p287 band 2 Reading WISE tile 1234p287 band 3 Reading WISE tile 1234p287 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 967 MB, VmSize: 799 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.189528 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.21012 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210324 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/123/1234p287/unwise-1234p287-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 961 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.208948 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/tmp-legacysurvey-custom-122845p29216-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/tmp-legacysurvey-custom-122845p29216-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.53 s, CPU: 6.67 s, VmPeak: 1030 MB, VmSize: 1030 MB, VmRSS: 218 MB, VmData: 245 MB, maxrss: 0.454628 MB Stage wise_forced finished: 2020-06-05T03:54:12.590518 Resources for stage wise_forced : 4.209 s worker CPU, 6.101 s worker Wall, Wall: 8.531 s, Cores in use: 1.27, Total efficiency (on 4 cores): 31.9 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-05T03:54:12.592310 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/coadd/cus/custom-122845p29216/legacysurvey-custom-122845p29216-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/tractor-i/cus/tractor-custom-122845p29216.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/tractor/cus/tractor-custom-122845p29216.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/122/PGC1859322/tractor/cus/brick-custom-122845p29216.sha256sum Stage writecat : Wall: 6.68 s, CPU: 6.26 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 220 MB, VmData: 245 MB, maxrss: 0.454628 MB Stage writecat finished: 2020-06-05T03:54:19.269857 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.679 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 % Stage writecat finished All done: 46.416 s worker CPU, 422.732 s worker Wall, Wall: 214.968 s, Cores in use: 0.49, Total efficiency (on 4 cores): 12.3 % Finished galaxy PGC1859322 in 3.761 minutes.