Started working on galaxy PGC1232888 at Sun Jun 7 05:36:19 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.2437895 2.6282808999999996 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T05:36:21.333284 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.2437895', '2.6282808999999996', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.2437895 2.6282808999999996 --width 275 --height 275 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.2437895 2.6282808999999996 Starting process 10392 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 10393 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 10394 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 10395 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T05:36:23.643753 Keeping 12 CCDs: c4d_160812_052345_ooi_z_ls9.fits.fz c4d_160812_052345_ooi_z_ls9-N19 z exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 57612.223 object DECaLS_7949_z c4d_170726_053700_ooi_g_ls9.fits.fz c4d_170726_053700_ooi_g_ls9-N19 g exptime 149.0 propid 2014B-0404 seeing 1.28 MJD 57960.232 object DECaLS_7949_g c4d_170822_040551_ooi_r_ls9.fits.fz c4d_170822_040551_ooi_r_ls9-N19 r exptime 40.0 propid 2014B-0404 seeing 0.86 MJD 57987.171 object DECaLS_7949_r c4d_170821_040958_ooi_r_ls9.fits.fz c4d_170821_040958_ooi_r_ls9-N18 r exptime 115.0 propid 2014B-0404 seeing 1.47 MJD 57986.174 object DECaLS_23821_r c4d_160811_053359_ooi_g_ls9.fits.fz c4d_160811_053359_ooi_g_ls9-N18 g exptime 92.0 propid 2014B-0404 seeing 1.48 MJD 57611.230 object DECaLS_23821_g c4d_160813_045955_ooi_z_ls9.fits.fz c4d_160813_045955_ooi_z_ls9-N18 z exptime 93.0 propid 2014B-0404 seeing 0.87 MJD 57613.207 object DECaLS_23821_z c4d_180918_011407_ooi_z_ls9.fits.fz c4d_180918_011407_ooi_z_ls9-N17 z exptime 122.0 propid 2014B-0404 seeing 1.26 MJD 58379.051 object DECaLS_39693_z c4d_170719_063922_ooi_r_ls9.fits.fz c4d_170719_063922_ooi_r_ls9-N17 r exptime 102.0 propid 2014B-0404 seeing 1.86 MJD 57953.276 object DECaLS_39693_r c4d_180914_031422_ooi_g_ls9.fits.fz c4d_180914_031422_ooi_g_ls9-N17 g exptime 99.0 propid 2014B-0404 seeing 1.21 MJD 58375.135 object DECaLS_39693_g c4d_180907_040852_ooi_g_ls9.fits.fz c4d_180907_040852_ooi_g_ls9-S9 g exptime 151.0 propid 2014B-0404 seeing 1.05 MJD 58368.173 object DECaLS_49403_g c4d_180907_041152_ooi_r_ls9.fits.fz c4d_180907_041152_ooi_r_ls9-S9 r exptime 53.0 propid 2014B-0404 seeing 0.92 MJD 58368.175 object DECaLS_49403_r c4d_180916_031035_ooi_z_ls9.fits.fz c4d_180916_031035_ooi_z_ls9-S9 z exptime 80.0 propid 2014B-0404 seeing 1.43 MJD 58377.132 object DECaLS_49403_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T052134_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T040551_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T053334_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T040958_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T045732_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160811T053137_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T063648_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T011407_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536616-g-20180914T031422_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T031035_oi[S9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T040852_oi[S9,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T041152_oi[S9,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 70.94 s, CPU: 2.57 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.454648 MB Stage tims finished: 2020-06-07T05:37:34.581510 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T040551_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T045732_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536616-g-20180914T031422_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T053334_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T011407_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T031035_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T052134_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160811T053137_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T041152_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T040958_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T063648_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T040852_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Resources for stage tims : 4.726 s worker CPU, 253.565 s worker Wall, Wall: 70.939 s, Cores in use: 0.10, Total efficiency (on 4 cores): 2.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T05:37:34.605466 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06074.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05945.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05946.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05818.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/reference-custom-343243p02628.fits Stage refs : Wall: 5.37 s, CPU: 4.52 s, VmPeak: 1026 MB, VmSize: 1011 MB, VmRSS: 192 MB, VmData: 224 MB, maxrss: 0.454648 MB Stage refs finished: 2020-06-07T05:37:39.975297 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 5.371 s, Cores in use: 0.84, Total efficiency (on 4 cores): 21.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T05:37:39.976780 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outlier-mask-custom-343243p02628.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-pre-custom-343243p02628.jpg Image c4d_180914_031422_ooi_g_ls9-N17 g : masking 510 positive outlier pixels and 0 negative outlier pixels Image c4d_170726_053700_ooi_g_ls9-N19 g : masking 403 positive outlier pixels and 0 negative outlier pixels Image c4d_170821_040958_ooi_r_ls9-N18 r : masking 1713 positive outlier pixels and 0 negative outlier pixels Image c4d_180918_011407_ooi_z_ls9-N17 z : masking 106 positive outlier pixels and 0 negative outlier pixels Image c4d_180916_031035_ooi_z_ls9-S9 z : masking 73 positive outlier pixels and 0 negative outlier pixels Image c4d_160812_052345_ooi_z_ls9-N19 z : masking 778 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outlier-mask-custom-343243p02628.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-post-custom-343243p02628.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-masked-pos-custom-343243p02628.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-masked-neg-custom-343243p02628.jpg Stage outliers : Wall: 4.55 s, CPU: 4.22 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 208 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage outliers finished: 2020-06-07T05:37:44.523860 Resources for stage outliers : 0.977 s worker CPU, 1.006 s worker Wall, Wall: 4.548 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.6 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T05:37:44.525320 Stage halos : Wall: 8.45 s, CPU: 4.95 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 208 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage halos finished: 2020-06-07T05:37:52.979997 Resources for stage halos : 0.325 s worker CPU, 13.388 s worker Wall, Wall: 8.456 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.6 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T05:37:52.981779 PSF sigmas in coadd pixels: ['2.07', '2.40', '1.97', '1.71'] Using average PSF sigma 2.038260315427095 Gaussian PSF norm 0.13839978615036144 vs pixelized 0.1250867 average tim pixel scale / coadd scale: 1.0011310556739967 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.40', '2.39', '3.02', '1.50'] Using average PSF sigma 2.078360492629862 Gaussian PSF norm 0.13572948137448876 vs pixelized 0.110930644 average tim pixel scale / coadd scale: 1.0011534500717831 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.55', '1.41', '2.04', '2.32'] Using average PSF sigma 1.8317495417615732 Gaussian PSF norm 0.15400292744312125 vs pixelized 0.12855023 average tim pixel scale / coadd scale: 1.0010863668534136 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.18 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 209 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage fit_on_coadds finished: 2020-06-07T05:37:53.180566 Resources for stage fit_on_coadds : 0.213 s worker CPU, 0.214 s worker Wall, Wall: 0.200 s, Cores in use: 1.98, Total efficiency (on 4 cores): 49.6 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T05:37:53.183025 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 87 potential peaks Of 87 potential peaks: 64 in veto map, 11 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 63 potential peaks Of 63 potential peaks: 52 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 85 potential peaks Of 85 potential peaks: 63 in veto map, 13 cut by saddle test, 0 cut by aper test, 9 kept SED g : 9 new peaks Found 83 potential peaks Of 83 potential peaks: 62 in veto map, 16 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 89 potential peaks Of 89 potential peaks: 71 in veto map, 16 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 29 new sources Median coadd sky for g : 8.866153e-05 Median coadd sky for r : 0.000109445886 Median coadd sky for z : 0.00052616413 Stage srcs : Wall: 3.10 s, CPU: 3.06 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage srcs finished: 2020-06-07T05:37:56.282983 Resources for stage srcs : 0.110 s worker CPU, 0.119 s worker Wall, Wall: 3.101 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T05:37:56.296158 Blob 1 of 12, id: 3, sources: 19, size: 258x236, npix 33240, brick X: 0,258, Y: 34,270, one pixel: 111 34 Blob 2 of 12, id: 4, sources: 2, size: 29x41, npix 682, brick X: 4,33, Y: 54,95, one pixel: 19 54 Blob 3 of 12, id: 1, sources: 1, size: 27x30, npix 561, brick X: 188,215, Y: 6,36, one pixel: 198 6 Blob 4 of 12, id: 0, sources: 2, size: 22x41, npix 488, brick X: 66,88, Y: 2,43, one pixel: 75 2 Blob 5 of 12, id: 5, sources: 1, size: 26x26, npix 419, brick X: 247,273, Y: 61,87, one pixel: 258 61 Blob 4 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14724 MB Blob 6 of 12, id: 8, sources: 1, size: 24x23, npix 361, brick X: 99,123, Y: 223,246, one pixel: 109 223 Blob 2 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14692 MB Blob 7 of 12, id: 7, sources: 1, size: 23x24, npix 328, brick X: 48,71, Y: 205,229, one pixel: 58 205 Blob 5 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14724 MB Blob 8 of 12, id: 2, sources: 1, size: 24x20, npix 273, brick X: 227,251, Y: 29,49, one pixel: 242 29 Blob 7 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14724 MB Blob 9 of 12, id: 11, sources: 1, size: 22x21, npix 272, brick X: 177,199, Y: 249,270, one pixel: 186 249 Blob 8 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14724 MB Blob 10 of 12, id: 9, sources: 1, size: 21x22, npix 250, brick X: 182,203, Y: 223,245, one pixel: 191 223 Blob 3 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149364 MB Blob 11 of 12, id: 10, sources: 1, size: 19x20, npix 200, brick X: 74,93, Y: 237,257, one pixel: 83 237 Blob 10 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149364 MB Blob 12 of 12, id: 6, sources: 1, size: 19x19, npix 199, brick X: 37,56, Y: 191,210, one pixel: 46 191 Blob 6 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14692 MB Blob 12 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14692 MB Blob 11 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149364 MB Blob 9 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14724 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.25495, 2.63270), pm (50.9, 18.0), parallax 4.496 with NanoMaggies: g=14.4, r=13.7, z=13.3 Reset brightness to NanoMaggies: g=13.7, r=12.9, z=12.5 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.27159, ee1=-0.0280819, ee2=0.0103604 Measuring 23 iterative sources Blob 1 finished, total: Wall: 30.68 s, CPU: 30.68 s, VmPeak: 961 MB, VmSize: 757 MB, VmRSS: 191 MB, VmData: 220 MB, maxrss: 0.196052 MB Old catalog: 36 New catalog: 48 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/blobs-custom-343243p02628.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/all-models-custom-343243p02628.fits Stage fitblobs : Wall: 33.83 s, CPU: 3.12 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage fitblobs finished: 2020-06-07T05:38:30.129646 Resources for stage fitblobs : 36.422 s worker CPU, 36.440 s worker Wall, Wall: 33.836 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T05:38:30.132733 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-resid.jpg Stage coadds : Wall: 6.91 s, CPU: 5.84 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage coadds finished: 2020-06-07T05:38:37.043494 Resources for stage coadds : 2.992 s worker CPU, 3.066 s worker Wall, Wall: 6.912 s, Cores in use: 1.28, Total efficiency (on 4 cores): 32.0 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T05:38:37.044785 Cut to 1 unWISE tiles Reading WISE tile 3433p030 band 1 Reading WISE tile 3433p030 band 2 Reading WISE tile 3433p030 band 3 Reading WISE tile 3433p030 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 961 MB, VmSize: 814 MB, VmRSS: 172 MB, VmData: 193 MB, maxrss: 0.215068 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205192 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 965 MB, VmSize: 796 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.213944 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 961 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.210176 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 13.24 s, CPU: 7.14 s, VmPeak: 1026 MB, VmSize: 1021 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage wise_forced finished: 2020-06-07T05:38:50.287235 Resources for stage wise_forced : 3.288 s worker CPU, 16.919 s worker Wall, Wall: 13.244 s, Cores in use: 0.79, Total efficiency (on 4 cores): 19.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T05:38:50.288907 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/tractor-i/cus/tractor-custom-343243p02628.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/tractor/cus/tractor-custom-343243p02628.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/tractor/cus/brick-custom-343243p02628.sha256sum Stage writecat : Wall: 8.73 s, CPU: 7.91 s, VmPeak: 1153 MB, VmSize: 1025 MB, VmRSS: 214 MB, VmData: 238 MB, maxrss: 0.454648 MB Stage writecat finished: 2020-06-07T05:38:59.020815 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.733 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.6 % Stage writecat finished All done: 49.055 s worker CPU, 324.719 s worker Wall, Wall: 155.381 s, Cores in use: 0.60, Total efficiency (on 4 cores): 14.9 % Finished galaxy PGC1232888 in 2.663 minutes. Started working on galaxy PGC1232888 at Mon Aug 10 09:04:44 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.2434302095838 2.6283749813107753 --width 275 --height 275 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T09:04:44.921044 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.2434302095838', '2.6283749813107753', '--width', '275', '--height', '275', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.2434302095838 2.6283749813107753 --width 275 --height 275 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.2434302095838 2.6283749813107753 Starting process 40470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 40472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 40474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 40476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 40478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 40480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 40482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 40484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T09:04:45.359645 Keeping 12 CCDs: c4d_160812_052345_ooi_z_ls9-N19 z expnum 563165 exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 57612.223 object DECaLS_7949_z decam/CP/V4.8.2a/CP20160811/c4d_160812_052345_ooi_z_ls9.fits.fz c4d_170726_053700_ooi_g_ls9-N19 g expnum 662303 exptime 149.0 propid 2014B-0404 seeing 1.28 MJD 57960.232 object DECaLS_7949_g decam/CP/V4.8.2a/CP20170725/c4d_170726_053700_ooi_g_ls9.fits.fz c4d_170822_040551_ooi_r_ls9-N19 r expnum 670331 exptime 40.0 propid 2014B-0404 seeing 0.86 MJD 57987.171 object DECaLS_7949_r decam/CP/V4.8.2a/CP20170821/c4d_170822_040551_ooi_r_ls9.fits.fz c4d_170821_040958_ooi_r_ls9-N18 r expnum 669941 exptime 115.0 propid 2014B-0404 seeing 1.47 MJD 57986.174 object DECaLS_23821_r decam/CP/V4.8.2a/CP20170820/c4d_170821_040958_ooi_r_ls9.fits.fz c4d_160811_053359_ooi_g_ls9-N18 g expnum 562815 exptime 92.0 propid 2014B-0404 seeing 1.48 MJD 57611.230 object DECaLS_23821_g decam/CP/V4.8.2a/CP20160810/c4d_160811_053359_ooi_g_ls9.fits.fz c4d_160813_045955_ooi_z_ls9-N18 z expnum 563561 exptime 93.0 propid 2014B-0404 seeing 0.87 MJD 57613.207 object DECaLS_23821_z decam/CP/V4.8.2a/CP20160812/c4d_160813_045955_ooi_z_ls9.fits.fz c4d_180918_011407_ooi_z_ls9-N17 z expnum 775008 exptime 122.0 propid 2014B-0404 seeing 1.26 MJD 58379.051 object DECaLS_39693_z decam/CP/V4.8.2a/CP20180917/c4d_180918_011407_ooi_z_ls9.fits.fz c4d_170719_063922_ooi_r_ls9-N17 r expnum 660025 exptime 102.0 propid 2014B-0404 seeing 1.86 MJD 57953.276 object DECaLS_39693_r decam/CP/V4.8.2/CP20170718/c4d_170719_063922_ooi_r_ls9.fits.fz c4d_180914_031422_ooi_g_ls9-N17 g expnum 773255 exptime 99.0 propid 2014B-0404 seeing 1.21 MJD 58375.135 object DECaLS_39693_g decam/CP/V4.8.2a/CP20180913/c4d_180914_031422_ooi_g_ls9.fits.fz c4d_180907_040852_ooi_g_ls9-S9 g expnum 770029 exptime 151.0 propid 2014B-0404 seeing 1.05 MJD 58368.173 object DECaLS_49403_g decam/CP/V4.8.2a/CP20180906/c4d_180907_040852_ooi_g_ls9.fits.fz c4d_180907_041152_ooi_r_ls9-S9 r expnum 770030 exptime 53.0 propid 2014B-0404 seeing 0.92 MJD 58368.175 object DECaLS_49403_r decam/CP/V4.8.2a/CP20180906/c4d_180907_041152_ooi_r_ls9.fits.fz c4d_180916_031035_ooi_z_ls9-S9 z expnum 774204 exptime 80.0 propid 2014B-0404 seeing 1.43 MJD 58377.132 object DECaLS_49403_z decam/CP/V4.8.2a/CP20180915/c4d_180916_031035_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T045732_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160811T053137_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T063648_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T052134_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T040551_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T040958_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T011407_oi[N17,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T053334_oi[N19,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536616-g-20180914T031422_oi[N17,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T041152_oi[S9,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T031035_oi[S9,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T040852_oi[S9,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 88.99 s, CPU: 0.90 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 177 MB, VmData: 211 MB, maxrss: 0.181636 MB Stage tims finished: 2020-08-10T09:06:14.351315 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951beed-r-20170719T063648_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f17b-z-20180918T011407_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954fc69-z-20160813T045732_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521d7c-r-20170822T040551_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95217b0-r-20170821T040958_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T041152_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a179-z-20160812T052134_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536616-g-20180914T031422_oi[N17,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95624c3-g-20160811T053137_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952e572-z-20180916T031035_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Resources for stage tims : 6.449 s worker CPU, 419.072 s worker Wall, Wall: 88.993 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95203e2-g-20170726T053334_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535945-g-20180907T040852_oi[S9,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Running stage refs at 2020-08-10T09:06:15.128165 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06074.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05945.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05946.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05818.fits Matched 3 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/reference-custom-343243p02628.fits Stage refs : Wall: 11.25 s, CPU: 1.95 s, VmPeak: 1036 MB, VmSize: 1022 MB, VmRSS: 195 MB, VmData: 227 MB, maxrss: 0.199684 MB Stage refs finished: 2020-08-10T09:06:26.378333 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.251 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T09:06:26.407397 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outlier-mask-custom-343243p02628.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-pre-custom-343243p02628.jpg Image c4d_180914_031422_ooi_g_ls9-N17 g : masking 514 positive outlier pixels and 0 negative outlier pixels Image c4d_170726_053700_ooi_g_ls9-N19 g : masking 336 positive outlier pixels and 0 negative outlier pixels Image c4d_170821_040958_ooi_r_ls9-N18 r : masking 1416 positive outlier pixels and 0 negative outlier pixels Image c4d_180916_031035_ooi_z_ls9-S9 z : masking 67 positive outlier pixels and 0 negative outlier pixels Image c4d_160812_052345_ooi_z_ls9-N19 z : masking 606 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outlier-mask-custom-343243p02628.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-post-custom-343243p02628.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-masked-pos-custom-343243p02628.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/outliers-masked-neg-custom-343243p02628.jpg Stage outliers : Wall: 0.87 s, CPU: 0.68 s, VmPeak: 1036 MB, VmSize: 1031 MB, VmRSS: 210 MB, VmData: 240 MB, maxrss: 0.215468 MB Stage outliers finished: 2020-08-10T09:06:27.275987 Resources for stage outliers : 0.817 s worker CPU, 0.817 s worker Wall, Wall: 0.870 s, Cores in use: 1.72, Total efficiency (on 8 cores): 21.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T09:06:27.474659 Stage halos : Wall: 1.38 s, CPU: 0.43 s, VmPeak: 1036 MB, VmSize: 1031 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.215776 MB Stage halos finished: 2020-08-10T09:06:28.854377 Resources for stage halos : 0.381 s worker CPU, 2.901 s worker Wall, Wall: 1.381 s, Cores in use: 0.59, Total efficiency (on 8 cores): 7.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T09:06:28.884076 PSF sigmas in coadd pixels: ['2.07', '2.40', '1.97', '1.71'] Using average PSF sigma 2.038260315427095 Gaussian PSF norm 0.13839978615036144 vs pixelized 0.1250856 average tim pixel scale / coadd scale: 1.0011310556739967 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.40', '2.39', '3.02', '1.50'] Using average PSF sigma 2.078360492629862 Gaussian PSF norm 0.13572948137448876 vs pixelized 0.11093556 average tim pixel scale / coadd scale: 1.0011534500717831 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.55', '1.41', '2.04', '2.32'] Using average PSF sigma 1.8317495417615732 Gaussian PSF norm 0.15400292744312125 vs pixelized 0.12854956 average tim pixel scale / coadd scale: 1.0010863668534136 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.17 s, VmPeak: 1036 MB, VmSize: 1031 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.218236 MB Stage fit_on_coadds finished: 2020-08-10T09:06:29.085003 Resources for stage fit_on_coadds : 0.198 s worker CPU, 0.203 s worker Wall, Wall: 0.202 s, Cores in use: 1.83, Total efficiency (on 8 cores): 22.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T09:06:29.095471 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 87 potential peaks Of 87 potential peaks: 66 in veto map, 10 cut by saddle test, 0 cut by aper test, 11 kept SED z : 11 new peaks Found 63 potential peaks Of 63 potential peaks: 51 in veto map, 11 cut by saddle test, 0 cut by aper test, 1 kept SED r : 1 new peaks Found 86 potential peaks Of 86 potential peaks: 64 in veto map, 13 cut by saddle test, 0 cut by aper test, 9 kept SED g : 9 new peaks Found 82 potential peaks Of 82 potential peaks: 62 in veto map, 16 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 87 potential peaks Of 87 potential peaks: 69 in veto map, 16 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 27 new sources Median coadd sky for g : 8.050835e-05 Median coadd sky for r : 9.53633e-05 Median coadd sky for z : 0.0005210681 Stage srcs : Wall: 1.23 s, CPU: 1.18 s, VmPeak: 1036 MB, VmSize: 1031 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.218784 MB Stage srcs finished: 2020-08-10T09:06:30.322579 Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 1.228 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T09:06:31.247683 Blob 1 of 13, id: 4, sources: 17, size: 255x236, npix 32782, brick X: 0,255, Y: 33,269, one pixel: 106 33 Blob 2 of 13, id: 5, sources: 2, size: 28x40, npix 649, brick X: 0,28, Y: 53,93, one pixel: 13 53 Blob 3 of 13, id: 1, sources: 1, size: 27x31, npix 552, brick X: 183,210, Y: 4,35, one pixel: 195 4 Blob 4 of 13, id: 6, sources: 1, size: 26x25, npix 425, brick X: 242,268, Y: 60,85, one pixel: 253 60 Blob 5 of 13, id: 9, sources: 1, size: 24x24, npix 354, brick X: 94,118, Y: 221,245, one pixel: 106 221 Blob 6 of 13, id: 8, sources: 1, size: 24x24, npix 339, brick X: 42,66, Y: 204,228, one pixel: 53 204 Blob 7 of 13, id: 12, sources: 1, size: 22x22, npix 290, brick X: 172,194, Y: 247,269, one pixel: 182 247 Blob 8 of 13, id: 0, sources: 1, size: 22x20, npix 258, brick X: 61,83, Y: 1,21, one pixel: 70 1 Blob 9 of 13, id: 10, sources: 1, size: 21x21, npix 251, brick X: 177,198, Y: 222,243, one pixel: 186 222 Blob 8 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146284 MB Blob 6 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145428 MB Blob 10 of 13, id: 2, sources: 1, size: 20x20, npix 229, brick X: 62,82, Y: 22,42, one pixel: 71 22 Blob 11 of 13, id: 3, sources: 1, size: 20x19, npix 217, brick X: 222,242, Y: 29,48, one pixel: 230 29 Blob 4 finished, total: Wall: 0.36 s, CPU: 0.35 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145036 MB Blob 12 of 13, id: 11, sources: 1, size: 19x19, npix 217, brick X: 69,88, Y: 236,255, one pixel: 77 236 Blob 9 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146284 MB Blob 13 of 13, id: 7, sources: 1, size: 19x19, npix 199, brick X: 32,51, Y: 190,209, one pixel: 41 190 Blob 11 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145036 MB Blob 13 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145036 MB Blob 10 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145428 MB Blob 12 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 941 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146284 MB Blob 7 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 961 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.144988 MB Blob 5 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143308 MB Blob 2 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147176 MB Blob 3 finished, total: Wall: 1.17 s, CPU: 1.16 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.1474 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.25495, 2.63270), pm (50.9, 18.0), parallax 4.496 with NanoMaggies: g=13.8, r=13.2, z=12.8 Reset brightness to NanoMaggies: g=13.7, r=12.9, z=12.5 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.94476, ee1=-0.0267471, ee2=0.0103198 Measuring 28 iterative sources Blob 1 finished, total: Wall: 33.36 s, CPU: 33.36 s, VmPeak: 955 MB, VmSize: 727 MB, VmRSS: 151 MB, VmData: 182 MB, maxrss: 0.173784 MB Old catalog: 34 New catalog: 46 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/blobs-custom-343243p02628.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/metrics/cus/all-models-custom-343243p02628.fits Stage fitblobs : Wall: 34.23 s, CPU: 0.79 s, VmPeak: 1036 MB, VmSize: 1029 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.219204 MB Stage fitblobs finished: 2020-08-10T09:07:05.480082 Resources for stage fitblobs : 39.210 s worker CPU, 39.289 s worker Wall, Wall: 34.233 s, Cores in use: 1.17, Total efficiency (on 8 cores): 14.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T09:07:05.495702 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-resid.jpg Stage coadds : Wall: 2.09 s, CPU: 1.04 s, VmPeak: 1036 MB, VmSize: 1029 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.219204 MB Stage coadds finished: 2020-08-10T09:07:07.584612 Resources for stage coadds : 4.372 s worker CPU, 5.154 s worker Wall, Wall: 2.090 s, Cores in use: 2.59, Total efficiency (on 8 cores): 32.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T09:07:07.602151 Cut to 1 unWISE tiles Reading WISE tile 3433p030 band 1 Reading WISE tile 3433p030 band 2 Reading WISE tile 3433p030 band 3 Reading WISE tile 3433p030 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 967 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205432 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 967 MB, VmSize: 805 MB, VmRSS: 147 MB, VmData: 176 MB, maxrss: 0.191224 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 802 MB, VmRSS: 145 MB, VmData: 173 MB, maxrss: 0.20868 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3433p030/unwise-3433p030-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 971 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.208208 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/tmp-legacysurvey-custom-343243p02628-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.97 s, CPU: 0.54 s, VmPeak: 1036 MB, VmSize: 1029 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.219204 MB Stage wise_forced finished: 2020-08-10T09:07:09.573427 Resources for stage wise_forced : 3.372 s worker CPU, 4.673 s worker Wall, Wall: 1.972 s, Cores in use: 1.99, Total efficiency (on 8 cores): 24.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T09:07:09.591364 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/coadd/cus/custom-343243p02628/legacysurvey-custom-343243p02628-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/tractor-i/cus/tractor-custom-343243p02628.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/tractor/cus/tractor-custom-343243p02628.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/tractor/cus/brick-custom-343243p02628.sha256sum Stage writecat : Wall: 0.87 s, CPU: 0.63 s, VmPeak: 1162 MB, VmSize: 1034 MB, VmRSS: 215 MB, VmData: 239 MB, maxrss: 0.3511 MB Stage writecat finished: 2020-08-10T09:07:10.462055 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.872 s, Cores in use: 0.72, Total efficiency (on 8 cores): 9.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC1232888/PGC1232888-largegalaxy-writecat.p All done: 54.881 s worker CPU, 472.190 s worker Wall, Wall: 145.164 s, Cores in use: 0.44, Total efficiency (on 8 cores): 5.5 % Finished galaxy PGC1232888 in 2.444 minutes.