Started working on galaxy PGC069996 at Sun Jun 7 13:57:16 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T13:57:17.870674 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.71766499999995', '32.7937009', '--width', '533', '--height', '533', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.71766499999995 32.7937009 Starting process 51402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 51403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 51404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 51405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T13:57:24.471480 Keeping 13 CCDs: c4d_181017_013846_ooi_z_ls9.fits.fz c4d_181017_013846_ooi_z_ls9-S30 z exptime 221.0 propid 2014B-0404 seeing 1.69 MJD 58408.069 object DECaLS_40043_z c4d_180919_022543_ooi_z_ls9.fits.fz c4d_180919_022543_ooi_z_ls9-S30 z exptime 250.0 propid 2014B-0404 seeing 1.57 MJD 58380.101 object DECaLS_40043_z c4d_181110_011957_ooi_g_ls9.fits.fz c4d_181110_011957_ooi_g_ls9-S30 g exptime 149.0 propid 2014B-0404 seeing 2.11 MJD 58432.056 object DECaLS_40043_g c4d_181105_005716_ooi_r_ls9.fits.fz c4d_181105_005716_ooi_r_ls9-S30 r exptime 74.0 propid 2014B-0404 seeing 1.32 MJD 58427.040 object DECaLS_40043_r c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N15 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N15 z exptime 115.0 propid 2014B-0404 seeing 1.04 MJD 58378.137 object DECaLS_8283_z c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N21 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N21 z exptime 115.0 propid 2014B-0404 seeing 1.01 MJD 58378.137 object DECaLS_8283_z c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-S31 z exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-S31 g exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 58393.080 object DECaLS_24171_g c4d_171025_011731_ooi_z_ls9.fits.fz c4d_171025_011731_ooi_z_ls9-N20 z exptime 195.0 propid 2014B-0404 seeing 1.44 MJD 58051.054 object DECaLS_24155_z c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-S31 r exptime 133.0 propid 2014B-0404 seeing 1.64 MJD 58426.052 object DECaLS_24171_r c4d_181002_022242_ooi_r_ls9.fits.fz c4d_181002_022242_ooi_r_ls9-N20 r exptime 88.0 propid 2014B-0404 seeing 1.38 MJD 58393.099 object DECaLS_24155_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 151.88 s, CPU: 7.08 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.454648 MB Stage tims finished: 2020-06-07T13:59:56.347274 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.213 s worker CPU, 507.068 s worker Wall, Wall: 151.877 s, Cores in use: 0.08, Total efficiency (on 4 cores): 2.0 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T13:59:56.579237 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02874.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02746.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/reference-custom-343717p32793.fits Stage refs : Wall: 11.05 s, CPU: 10.71 s, VmPeak: 1053 MB, VmSize: 1047 MB, VmRSS: 253 MB, VmData: 284 MB, maxrss: 0.454648 MB Stage refs finished: 2020-06-07T14:00:07.627391 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.049 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T14:00:07.628753 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-pre-custom-343717p32793.jpg Image c4d_181002_015438_ooi_g_ls9-S31 g : masking 748 positive outlier pixels and 0 negative outlier pixels Image c4d_181003_020336_ooi_g_ls9-N21 g : masking 13059 positive outlier pixels and 0 negative outlier pixels Image c4d_181110_011957_ooi_g_ls9-S30 g : masking 1223 positive outlier pixels and 214 negative outlier pixels Image c4d_181104_011503_ooi_r_ls9-S31 r : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_005716_ooi_r_ls9-S30 r : masking 453 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_022242_ooi_r_ls9-N20 r : masking 1177 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_031748_ooi_z_ls9-N21 z : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_180919_022543_ooi_z_ls9-S30 z : masking 1264 positive outlier pixels and 176 negative outlier pixels Image c4d_181017_013846_ooi_z_ls9-S30 z : masking 1189 positive outlier pixels and 0 negative outlier pixels Image c4d_171025_011731_ooi_z_ls9-N20 z : masking 289 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-post-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-pos-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-neg-custom-343717p32793.jpg Stage outliers : Wall: 11.61 s, CPU: 8.52 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 297 MB, VmData: 326 MB, maxrss: 0.454648 MB Stage outliers finished: 2020-06-07T14:00:19.235527 Resources for stage outliers : 5.422 s worker CPU, 5.644 s worker Wall, Wall: 11.608 s, Cores in use: 1.20, Total efficiency (on 4 cores): 30.0 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T14:00:19.237095 Stage halos : Wall: 11.23 s, CPU: 5.96 s, VmPeak: 1058 MB, VmSize: 1058 MB, VmRSS: 297 MB, VmData: 326 MB, maxrss: 0.454648 MB Stage halos finished: 2020-06-07T14:00:30.465278 Resources for stage halos : 4.223 s worker CPU, 20.573 s worker Wall, Wall: 11.229 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.7 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T14:00:30.467128 PSF sigmas in coadd pixels: ['3.42', '2.61', '2.59', '2.70'] Using average PSF sigma 2.8300878852731586 Gaussian PSF norm 0.09967704297870258 vs pixelized 0.09604344 average tim pixel scale / coadd scale: 1.0014639224035964 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.14', '2.67', '2.25'] Using average PSF sigma 2.351146556471552 Gaussian PSF norm 0.11998179824112186 vs pixelized 0.10424567 average tim pixel scale / coadd scale: 1.0014268483447608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.75', '2.55', '1.69', '1.63', '2.52', '2.34'] Using average PSF sigma 2.248088969960469 Gaussian PSF norm 0.1254820407658682 vs pixelized 0.10650161 average tim pixel scale / coadd scale: 1.0014075031841727 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.81 s, CPU: 0.64 s, VmPeak: 1186 MB, VmSize: 1058 MB, VmRSS: 304 MB, VmData: 331 MB, maxrss: 0.454648 MB Stage fit_on_coadds finished: 2020-06-07T14:00:31.279130 Resources for stage fit_on_coadds : 1.311 s worker CPU, 1.428 s worker Wall, Wall: 0.814 s, Cores in use: 2.40, Total efficiency (on 4 cores): 60.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T14:00:31.283154 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 213 potential peaks Of 213 potential peaks: 107 in veto map, 31 cut by saddle test, 0 cut by aper test, 75 kept SED z : 75 new peaks Found 209 potential peaks Of 209 potential peaks: 164 in veto map, 28 cut by saddle test, 0 cut by aper test, 17 kept SED r : 17 new peaks Found 139 potential peaks Of 139 potential peaks: 108 in veto map, 30 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 209 potential peaks Of 209 potential peaks: 170 in veto map, 35 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 243 potential peaks Of 243 potential peaks: 206 in veto map, 36 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 98 new sources Median coadd sky for g : 9.724771e-05 Median coadd sky for r : 0.00010384932 Median coadd sky for z : 0.00068560406 Stage srcs : Wall: 8.42 s, CPU: 8.28 s, VmPeak: 1186 MB, VmSize: 1058 MB, VmRSS: 275 MB, VmData: 331 MB, maxrss: 0.454648 MB Stage srcs finished: 2020-06-07T14:00:39.702945 Resources for stage srcs : 0.455 s worker CPU, 0.455 s worker Wall, Wall: 8.421 s, Cores in use: 1.04, Total efficiency (on 4 cores): 25.9 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T14:00:40.263687 Blob 1 of 37, id: 9, sources: 58, size: 531x502, npix 109199, brick X: 0,531, Y: 31,533, one pixel: 185 31 Blob 2 of 37, id: 5, sources: 9, size: 184x147, npix 15149, brick X: 349,533, Y: 13,160, one pixel: 457 13 Blob 3 of 37, id: 25, sources: 5, size: 63x90, npix 3260, brick X: 74,137, Y: 443,533, one pixel: 105 443 Blob 4 of 37, id: 0, sources: 3, size: 60x61, npix 2081, brick X: 115,175, Y: 0,61, one pixel: 138 0 Blob 5 of 37, id: 21, sources: 2, size: 54x47, npix 1530, brick X: 466,520, Y: 239,286, one pixel: 504 239 Measuring 1 iterative sources Blob 4 finished, total: Wall: 3.32 s, CPU: 3.32 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 6 of 37, id: 13, sources: 3, size: 25x66, npix 1289, brick X: 0,25, Y: 100,166, one pixel: 6 100 Measuring 3 iterative sources Measuring 1 iterative sources Blob 5 finished, total: Wall: 3.72 s, CPU: 3.72 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 7 of 37, id: 8, sources: 1, size: 44x39, npix 1203, brick X: 83,127, Y: 25,64, one pixel: 101 25 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74177, 32.78421), pm (-9.6, -6.3), parallax 1.220 with NanoMaggies: g=16.2, r=15, z=14.5 Reset brightness to NanoMaggies: g=15.4, r=14.6, z=14.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74980, 32.78490), pm (-8.0, -3.6), parallax 0.541 with NanoMaggies: g=16.6, r=16.1, z=16 Reset brightness to NanoMaggies: g=16.6, r=16.1, z=16 Blob 6 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 8 of 37, id: 28, sources: 1, size: 38x42, npix 1127, brick X: 264,302, Y: 450,492, one pixel: 281 450 Measuring 1 iterative sources Blob 7 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 9 of 37, id: 23, sources: 1, size: 44x34, npix 1073, brick X: 83,127, Y: 394,428, one pixel: 93 394 Blob 3 finished, total: Wall: 9.20 s, CPU: 8.09 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158292 MB Blob 10 of 37, id: 29, sources: 2, size: 43x40, npix 962, brick X: 305,348, Y: 474,514, one pixel: 318 474 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.69373, 32.77859), pm (-5.8, -4.9), parallax 0.365 with NanoMaggies: g=16.8, r=16, z=15.6 Reset brightness to NanoMaggies: g=16.5, r=16.1, z=15.9 Blob 2 finished, total: Wall: 10.30 s, CPU: 9.28 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.155088 MB Blob 11 of 37, id: 11, sources: 2, size: 43x35, npix 954, brick X: 95,138, Y: 86,121, one pixel: 126 86 Blob 9 finished, total: Wall: 1.41 s, CPU: 1.41 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158492 MB Blob 12 of 37, id: 4, sources: 1, size: 37x35, npix 881, brick X: 362,399, Y: 4,39, one pixel: 380 4 Measuring 1 iterative sources Blob 8 finished, total: Wall: 2.98 s, CPU: 2.98 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 13 of 37, id: 7, sources: 1, size: 31x42, npix 861, brick X: 49,80, Y: 24,66, one pixel: 64 24 Blob 10 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.155088 MB Blob 14 of 37, id: 20, sources: 2, size: 34x46, npix 856, brick X: 439,473, Y: 216,262, one pixel: 451 216 Blob 12 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 15 of 37, id: 34, sources: 2, size: 29x42, npix 841, brick X: 276,305, Y: 491,533, one pixel: 287 491 Blob 11 finished, total: Wall: 1.96 s, CPU: 1.96 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158492 MB Blob 16 of 37, id: 27, sources: 2, size: 36x34, npix 823, brick X: 497,533, Y: 443,477, one pixel: 511 443 Blob 14 finished, total: Wall: 0.56 s, CPU: 0.56 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 17 of 37, id: 30, sources: 2, size: 34x43, npix 793, brick X: 376,410, Y: 476,519, one pixel: 385 476 Measuring 1 iterative sources Blob 13 finished, total: Wall: 1.52 s, CPU: 1.52 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.155088 MB Blob 18 of 37, id: 17, sources: 1, size: 32x36, npix 782, brick X: 13,45, Y: 166,202, one pixel: 27 166 Blob 15 finished, total: Wall: 1.57 s, CPU: 1.57 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158492 MB Blob 19 of 37, id: 26, sources: 1, size: 36x31, npix 744, brick X: 375,411, Y: 443,474, one pixel: 386 443 Blob 17 finished, total: Wall: 1.07 s, CPU: 1.07 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.155088 MB Blob 20 of 37, id: 16, sources: 1, size: 32x34, npix 711, brick X: 500,532, Y: 149,183, one pixel: 515 149 Blob 16 finished, total: Wall: 2.09 s, CPU: 2.09 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 21 of 37, id: 18, sources: 1, size: 30x32, npix 667, brick X: 420,450, Y: 185,217, one pixel: 431 185 Measuring 1 iterative sources Blob 18 finished, total: Wall: 1.77 s, CPU: 1.77 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158492 MB Blob 22 of 37, id: 36, sources: 2, size: 45x20, npix 647, brick X: 187,232, Y: 513,533, one pixel: 218 513 Blob 19 finished, total: Wall: 1.79 s, CPU: 1.79 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.155088 MB Blob 23 of 37, id: 19, sources: 1, size: 30x31, npix 619, brick X: 387,417, Y: 187,218, one pixel: 401 187 Blob 21 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158492 MB Blob 24 of 37, id: 10, sources: 1, size: 35x27, npix 588, brick X: 336,371, Y: 51,78, one pixel: 346 51 Blob 20 finished, total: Wall: 1.70 s, CPU: 1.70 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 25 of 37, id: 6, sources: 1, size: 28x33, npix 587, brick X: 19,47, Y: 16,49, one pixel: 31 16 Blob 24 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 26 of 37, id: 22, sources: 1, size: 29x34, npix 579, brick X: 490,519, Y: 370,404, one pixel: 504 370 Blob 22 finished, total: Wall: 1.62 s, CPU: 1.62 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 151 MB, VmData: 188 MB, maxrss: 0.155088 MB Blob 27 of 37, id: 2, sources: 1, size: 34x22, npix 530, brick X: 276,310, Y: 0,22, one pixel: 279 0 Measuring 1 iterative sources Blob 26 finished, total: Wall: 1.78 s, CPU: 1.78 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 152 MB, VmData: 188 MB, maxrss: 0.155516 MB Blob 28 of 37, id: 3, sources: 1, size: 33x20, npix 509, brick X: 500,533, Y: 0,20, one pixel: 503 0 Blob 23 finished, total: Wall: 3.44 s, CPU: 3.44 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158492 MB Blob 29 of 37, id: 12, sources: 1, size: 26x28, npix 443, brick X: 42,68, Y: 96,124, one pixel: 56 96 Blob 25 finished, total: Wall: 2.68 s, CPU: 2.68 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 30 of 37, id: 31, sources: 1, size: 25x25, npix 412, brick X: 151,176, Y: 480,505, one pixel: 162 480 Blob 29 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 31 of 37, id: 35, sources: 1, size: 25x24, npix 387, brick X: 131,156, Y: 495,519, one pixel: 142 495 Blob 27 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 152 MB, VmData: 188 MB, maxrss: 0.155516 MB Blob 32 of 37, id: 33, sources: 1, size: 23x24, npix 349, brick X: 177,200, Y: 486,510, one pixel: 186 486 Blob 30 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 33 of 37, id: 15, sources: 1, size: 23x22, npix 312, brick X: 384,407, Y: 136,158, one pixel: 392 136 Blob 32 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 34 of 37, id: 24, sources: 1, size: 23x21, npix 302, brick X: 175,198, Y: 427,448, one pixel: 184 427 Blob 31 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 152 MB, VmData: 188 MB, maxrss: 0.155516 MB Blob 35 of 37, id: 14, sources: 1, size: 21x22, npix 291, brick X: 132,153, Y: 105,127, one pixel: 141 105 Blob 33 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Blob 36 of 37, id: 1, sources: 1, size: 22x17, npix 238, brick X: 182,204, Y: 0,17, one pixel: 187 0 Blob 34 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 152 MB, VmData: 188 MB, maxrss: 0.155516 MB Blob 37 of 37, id: 32, sources: 1, size: 20x20, npix 228, brick X: 209,229, Y: 485,505, one pixel: 218 485 Blob 28 finished, total: Wall: 2.47 s, CPU: 2.47 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158748 MB Blob 36 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 972 MB, VmSize: 725 MB, VmRSS: 152 MB, VmData: 188 MB, maxrss: 0.155516 MB Blob 37 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158748 MB Blob 35 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 971 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158412 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.84879, ee1=0.0890491, ee2=-0.316569 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74377, 32.79835), pm (-6.9, -3.3), parallax 0.515 with NanoMaggies: g=17.6, r=17, z=16.7 Reset brightness to NanoMaggies: g=17.6, r=17, z=16.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74345, 32.80108), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -4.03e+05), r=(flux -5.32e+05), z=(flux -1.25e+06) Reset brightness to NanoMaggies: g=20.9, r=19.7, z=18.9 Measuring 6 iterative sources Blob 1 finished, total: Wall: 55.93 s, CPU: 54.83 s, VmPeak: 973 MB, VmSize: 798 MB, VmRSS: 233 MB, VmData: 261 MB, maxrss: 0.342644 MB Old catalog: 127 New catalog: 118 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/blobs-custom-343717p32793.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/all-models-custom-343717p32793.fits Stage fitblobs : Wall: 63.89 s, CPU: 7.83 s, VmPeak: 1186 MB, VmSize: 1058 MB, VmRSS: 283 MB, VmData: 340 MB, maxrss: 0.454648 MB Stage fitblobs finished: 2020-06-07T14:01:44.149071 Resources for stage fitblobs : 121.625 s worker CPU, 125.003 s worker Wall, Wall: 63.889 s, Cores in use: 2.03, Total efficiency (on 4 cores): 50.7 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T14:01:44.153850 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-resid.jpg Stage coadds : Wall: 11.95 s, CPU: 10.74 s, VmPeak: 1186 MB, VmSize: 1093 MB, VmRSS: 326 MB, VmData: 375 MB, maxrss: 0.454648 MB Stage coadds finished: 2020-06-07T14:01:56.105635 Resources for stage coadds : 3.994 s worker CPU, 4.136 s worker Wall, Wall: 11.954 s, Cores in use: 1.23, Total efficiency (on 4 cores): 30.8 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T14:01:56.108878 Cut to 1 unWISE tiles Reading WISE tile 3437p333 band 1 Reading WISE tile 3437p333 band 2 Reading WISE tile 3437p333 band 3 Reading WISE tile 3437p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.55 s, CPU: 1.62 s, VmPeak: 1070 MB, VmSize: 1006 MB, VmRSS: 155 MB, VmData: 193 MB, maxrss: 0.198972 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.21 s, CPU: 0.45 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 151 MB, VmData: 190 MB, maxrss: 0.214328 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.28 s, CPU: 0.54 s, VmPeak: 1196 MB, VmSize: 1087 MB, VmRSS: 241 MB, VmData: 274 MB, maxrss: 0.342644 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.25 s, CPU: 0.74 s, VmPeak: 1064 MB, VmSize: 1000 MB, VmRSS: 147 MB, VmData: 187 MB, maxrss: 0.211052 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 11.24 s, CPU: 6.56 s, VmPeak: 1186 MB, VmSize: 1056 MB, VmRSS: 286 MB, VmData: 338 MB, maxrss: 0.454648 MB Stage wise_forced finished: 2020-06-07T14:02:07.344240 Resources for stage wise_forced : 6.151 s worker CPU, 12.301 s worker Wall, Wall: 11.237 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T14:02:07.346044 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor-i/cus/tractor-custom-343717p32793.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/tractor-custom-343717p32793.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/brick-custom-343717p32793.sha256sum Stage writecat : Wall: 9.16 s, CPU: 8.99 s, VmPeak: 1200 MB, VmSize: 1072 MB, VmRSS: 304 MB, VmData: 350 MB, maxrss: 0.454648 MB Stage writecat finished: 2020-06-07T14:02:16.510372 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.165 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.5 % Stage writecat finished All done: 148.394 s worker CPU, 676.611 s worker Wall, Wall: 292.045 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.2 % Finished galaxy PGC069996 in 5.001 minutes. Started working on galaxy PGC069996 at Thu Jul 16 06:00:15 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-16T06:00:16.028135 legacypipe git version: DR9.5.4-57-g2fd66136 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.71766499999995', '32.7937009', '--width', '533', '--height', '533', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.71766499999995 32.7937009 Starting process 12583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB Starting process 12585 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 12587 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 12589 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 12591 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058952 MB Starting process 12593 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058952 MB Starting process 12594 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 12596 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 12598 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 12600 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 12602 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 12604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 12606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 12609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 12611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 12616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-16T06:00:16.383493 Keeping 13 CCDs: c4d_181017_013846_ooi_z_ls9.fits.fz c4d_181017_013846_ooi_z_ls9-S30 z exptime 221.0 propid 2014B-0404 seeing 1.69 MJD 58408.069 object DECaLS_40043_z c4d_180919_022543_ooi_z_ls9.fits.fz c4d_180919_022543_ooi_z_ls9-S30 z exptime 250.0 propid 2014B-0404 seeing 1.57 MJD 58380.101 object DECaLS_40043_z c4d_181110_011957_ooi_g_ls9.fits.fz c4d_181110_011957_ooi_g_ls9-S30 g exptime 149.0 propid 2014B-0404 seeing 2.11 MJD 58432.056 object DECaLS_40043_g c4d_181105_005716_ooi_r_ls9.fits.fz c4d_181105_005716_ooi_r_ls9-S30 r exptime 74.0 propid 2014B-0404 seeing 1.32 MJD 58427.040 object DECaLS_40043_r c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N15 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N15 z exptime 115.0 propid 2014B-0404 seeing 1.04 MJD 58378.137 object DECaLS_8283_z c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N21 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N21 z exptime 115.0 propid 2014B-0404 seeing 1.01 MJD 58378.137 object DECaLS_8283_z c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-S31 z exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-S31 g exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 58393.080 object DECaLS_24171_g c4d_171025_011731_ooi_z_ls9.fits.fz c4d_171025_011731_ooi_z_ls9-N20 z exptime 195.0 propid 2014B-0404 seeing 1.44 MJD 58051.054 object DECaLS_24155_z c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-S31 r exptime 133.0 propid 2014B-0404 seeing 1.64 MJD 58426.052 object DECaLS_24171_r c4d_181002_022242_ooi_r_ls9.fits.fz c4d_181002_022242_ooi_r_ls9-N20 r exptime 88.0 propid 2014B-0404 seeing 1.38 MJD 58393.099 object DECaLS_24155_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 9.34 s, CPU: 0.84 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 200 MB, VmData: 234 MB, maxrss: 0.205124 MB Stage tims finished: 2020-07-16T06:00:25.727720 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 8.639 s worker CPU, 102.251 s worker Wall, Wall: 9.346 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-16T06:00:25.815396 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02874.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02746.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/reference-custom-343717p32793.fits Stage refs : Wall: 4.29 s, CPU: 4.00 s, VmPeak: 1056 MB, VmSize: 1051 MB, VmRSS: 255 MB, VmData: 286 MB, maxrss: 0.260612 MB Stage refs finished: 2020-07-16T06:00:30.100625 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.287 s, Cores in use: 0.93, Total efficiency (on 16 cores): 5.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-16T06:00:30.155513 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-pre-custom-343717p32793.jpg Image c4d_181003_020336_ooi_g_ls9-N21 g : masking 13059 positive outlier pixels and 0 negative outlier pixels Image c4d_181110_011957_ooi_g_ls9-S30 g : masking 1223 positive outlier pixels and 214 negative outlier pixels Image c4d_181002_015438_ooi_g_ls9-S31 g : masking 748 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_005716_ooi_r_ls9-S30 r : masking 453 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_011503_ooi_r_ls9-S31 r : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_022242_ooi_r_ls9-N20 r : masking 1177 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_031748_ooi_z_ls9-N21 z : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_180919_022543_ooi_z_ls9-S30 z : masking 1264 positive outlier pixels and 176 negative outlier pixels Image c4d_181017_013846_ooi_z_ls9-S30 z : masking 1189 positive outlier pixels and 0 negative outlier pixels Image c4d_171025_011731_ooi_z_ls9-N20 z : masking 289 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-post-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-pos-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-neg-custom-343717p32793.jpg Stage outliers : Wall: 2.63 s, CPU: 1.51 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 303 MB, VmData: 332 MB, maxrss: 0.31018 MB Stage outliers finished: 2020-07-16T06:00:32.785711 Resources for stage outliers : 4.645 s worker CPU, 4.720 s worker Wall, Wall: 2.633 s, Cores in use: 2.34, Total efficiency (on 16 cores): 14.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-16T06:00:32.843152 Stage halos : Wall: 0.82 s, CPU: 0.26 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 282 MB, VmData: 332 MB, maxrss: 0.31018 MB Stage halos finished: 2020-07-16T06:00:33.663884 Resources for stage halos : 4.965 s worker CPU, 5.169 s worker Wall, Wall: 0.823 s, Cores in use: 6.36, Total efficiency (on 16 cores): 39.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-16T06:00:33.805517 PSF sigmas in coadd pixels: ['3.42', '2.61', '2.59', '2.70'] Using average PSF sigma 2.8300878852731586 Gaussian PSF norm 0.09967704297870258 vs pixelized 0.09604344 average tim pixel scale / coadd scale: 1.0014639224035964 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.14', '2.67', '2.25'] Using average PSF sigma 2.351146556471552 Gaussian PSF norm 0.11998179824112186 vs pixelized 0.10424567 average tim pixel scale / coadd scale: 1.0014268483447608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.75', '2.55', '1.69', '1.63', '2.52', '2.34'] Using average PSF sigma 2.248088969960469 Gaussian PSF norm 0.1254820407658682 vs pixelized 0.10650161 average tim pixel scale / coadd scale: 1.0014075031841727 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.63 s, CPU: 0.55 s, VmPeak: 1190 MB, VmSize: 1126 MB, VmRSS: 312 MB, VmData: 340 MB, maxrss: 0.319704 MB Stage fit_on_coadds finished: 2020-07-16T06:00:34.439409 Resources for stage fit_on_coadds : 1.240 s worker CPU, 1.240 s worker Wall, Wall: 0.637 s, Cores in use: 2.82, Total efficiency (on 16 cores): 17.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-16T06:00:34.462510 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 1545 potential peaks Of 1545 potential peaks: 1453 in veto map, 26 cut by saddle test, 0 cut by aper test, 66 kept SED z : 66 new peaks Found 475 potential peaks Of 475 potential peaks: 429 in veto map, 24 cut by saddle test, 0 cut by aper test, 22 kept SED r : 22 new peaks Found 138 potential peaks Of 138 potential peaks: 109 in veto map, 26 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 228 potential peaks Of 228 potential peaks: 193 in veto map, 32 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 254 potential peaks Of 254 potential peaks: 222 in veto map, 31 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 95 new sources Median coadd sky for g : 9.1153255e-05 Median coadd sky for r : 9.681531e-05 Median coadd sky for z : 0.00069602474 Stage srcs : Wall: 2.79 s, CPU: 2.67 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 273 MB, VmData: 332 MB, maxrss: 0.319704 MB Stage srcs finished: 2020-07-16T06:00:37.248447 Resources for stage srcs : 0.312 s worker CPU, 0.312 s worker Wall, Wall: 2.787 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-16T06:00:37.288919 Blob 1 of 27, id: 1, sources: 59, size: 533x502, npix 117109, brick X: 0,533, Y: 31,533, one pixel: 185 31 Blob 2 of 27, id: 0, sources: 21, size: 533x160, npix 33364, brick X: 0,533, Y: 0,160, one pixel: 0 0 Blob 3 of 27, id: 15, sources: 5, size: 63x90, npix 3260, brick X: 74,137, Y: 443,533, one pixel: 105 443 Blob 4 of 27, id: 5, sources: 3, size: 25x66, npix 1289, brick X: 0,25, Y: 100,166, one pixel: 6 100 Blob 5 of 27, id: 18, sources: 1, size: 38x42, npix 1127, brick X: 264,302, Y: 450,492, one pixel: 281 450 Blob 6 of 27, id: 13, sources: 1, size: 44x34, npix 1073, brick X: 83,127, Y: 394,428, one pixel: 93 394 Blob 7 of 27, id: 19, sources: 2, size: 43x40, npix 962, brick X: 305,348, Y: 474,514, one pixel: 318 474 Blob 8 of 27, id: 3, sources: 2, size: 43x35, npix 954, brick X: 95,138, Y: 86,121, one pixel: 126 86 Blob 9 of 27, id: 24, sources: 2, size: 29x42, npix 841, brick X: 276,305, Y: 491,533, one pixel: 287 491 Blob 10 of 27, id: 17, sources: 2, size: 36x34, npix 823, brick X: 497,533, Y: 443,477, one pixel: 511 443 Blob 11 of 27, id: 20, sources: 2, size: 34x43, npix 793, brick X: 376,410, Y: 476,519, one pixel: 385 476 Blob 12 of 27, id: 9, sources: 1, size: 32x36, npix 782, brick X: 13,45, Y: 166,202, one pixel: 27 166 Blob 13 of 27, id: 16, sources: 1, size: 36x31, npix 744, brick X: 375,411, Y: 443,474, one pixel: 386 443 Blob 14 of 27, id: 8, sources: 1, size: 32x34, npix 711, brick X: 500,532, Y: 149,183, one pixel: 515 149 Blob 15 of 27, id: 10, sources: 1, size: 30x32, npix 667, brick X: 420,450, Y: 185,217, one pixel: 431 185 Blob 16 of 27, id: 26, sources: 2, size: 45x20, npix 647, brick X: 187,232, Y: 513,533, one pixel: 218 513 Blob 17 of 27, id: 11, sources: 1, size: 30x31, npix 619, brick X: 387,417, Y: 187,218, one pixel: 401 187 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74177, 32.78421), pm (-9.6, -6.3), parallax 1.220 with NanoMaggies: g=16.2, r=15, z=14.5 Reset brightness to NanoMaggies: g=15.4, r=14.6, z=14.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74980, 32.78490), pm (-8.0, -3.6), parallax 0.541 with NanoMaggies: g=16.6, r=16.1, z=16 Reset brightness to NanoMaggies: g=16.6, r=16.1, z=16 Blob 4 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 953 MB, VmSize: 724 MB, VmRSS: 147 MB, VmData: 186 MB, maxrss: 0.15088 MB Blob 18 of 27, id: 2, sources: 1, size: 35x27, npix 588, brick X: 336,371, Y: 51,78, one pixel: 346 51 Blob 15 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 672 MB, VmSize: 666 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10204 MB Blob 19 of 27, id: 12, sources: 1, size: 29x34, npix 579, brick X: 490,519, Y: 370,404, one pixel: 504 370 Measuring 1 iterative sources Blob 11 finished, total: Wall: 1.25 s, CPU: 1.25 s, VmPeak: 948 MB, VmSize: 721 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149472 MB Blob 20 of 27, id: 4, sources: 1, size: 26x28, npix 443, brick X: 42,68, Y: 96,124, one pixel: 56 96 Blob 12 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 949 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.152032 MB Blob 6 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152956 MB Blob 21 of 27, id: 21, sources: 1, size: 25x25, npix 412, brick X: 151,176, Y: 480,505, one pixel: 162 480 Blob 22 of 27, id: 25, sources: 1, size: 25x24, npix 387, brick X: 131,156, Y: 495,519, one pixel: 142 495 Blob 14 finished, total: Wall: 1.55 s, CPU: 1.55 s, VmPeak: 956 MB, VmSize: 729 MB, VmRSS: 154 MB, VmData: 191 MB, maxrss: 0.157752 MB Blob 23 of 27, id: 23, sources: 1, size: 23x24, npix 349, brick X: 177,200, Y: 486,510, one pixel: 186 486 Blob 18 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 672 MB, VmSize: 666 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10204 MB Blob 24 of 27, id: 7, sources: 1, size: 23x22, npix 312, brick X: 384,407, Y: 136,158, one pixel: 392 136 Blob 9 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 955 MB, VmSize: 729 MB, VmRSS: 153 MB, VmData: 191 MB, maxrss: 0.157108 MB Blob 16 finished, total: Wall: 1.83 s, CPU: 1.82 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152672 MB Blob 25 of 27, id: 14, sources: 1, size: 23x21, npix 302, brick X: 175,198, Y: 427,448, one pixel: 184 427 Blob 26 of 27, id: 6, sources: 1, size: 21x22, npix 291, brick X: 132,153, Y: 105,127, one pixel: 141 105 Blob 21 finished, total: Wall: 0.32 s, CPU: 0.31 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152956 MB Blob 27 of 27, id: 22, sources: 1, size: 20x20, npix 228, brick X: 209,229, Y: 485,505, one pixel: 218 485 Measuring 1 iterative sources Blob 23 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 672 MB, VmSize: 666 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10204 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 2.16 s, CPU: 2.16 s, VmPeak: 951 MB, VmSize: 724 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150412 MB Blob 13 finished, total: Wall: 2.15 s, CPU: 2.15 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 129 MB, VmData: 171 MB, maxrss: 0.131932 MB Blob 8 finished, total: Wall: 2.25 s, CPU: 2.25 s, VmPeak: 950 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151468 MB Blob 24 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 955 MB, VmSize: 729 MB, VmRSS: 153 MB, VmData: 191 MB, maxrss: 0.157108 MB Blob 25 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152672 MB Blob 22 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 956 MB, VmSize: 729 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158428 MB Blob 5 finished, total: Wall: 2.45 s, CPU: 2.44 s, VmPeak: 674 MB, VmSize: 669 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.1044 MB Blob 10 finished, total: Wall: 2.46 s, CPU: 2.46 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.14508 MB Blob 17 finished, total: Wall: 2.19 s, CPU: 2.19 s, VmPeak: 953 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152968 MB Blob 27 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 672 MB, VmSize: 666 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.10204 MB Blob 20 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 949 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152216 MB Blob 26 finished, total: Wall: 0.87 s, CPU: 0.87 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 185 MB, maxrss: 0.152956 MB Blob 19 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 948 MB, VmSize: 721 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149472 MB Measuring 3 iterative sources Blob 3 finished, total: Wall: 6.04 s, CPU: 6.03 s, VmPeak: 953 MB, VmSize: 722 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150524 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.79220, 32.77436), pm (-7.2, -5.2), parallax 0.860 with NanoMaggies: g=10.1, r=8.71, z=7.79 Reset brightness to NanoMaggies: g=10.1, r=8.71, z=7.79 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.77923, 32.73476), pm (-11.1, -5.1), parallax 2.024 with NanoMaggies: g=10.3, r=9.3, z=8.83 Reset brightness to NanoMaggies: g=10.3, r=9.3, z=8.83 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.69373, 32.77859), pm (-5.8, -4.9), parallax 0.365 with NanoMaggies: g=16.8, r=16, z=15.6 Reset brightness to NanoMaggies: g=16.5, r=16.1, z=15.9 Measuring 2 iterative sources Blob 2 finished, total: Wall: 15.20 s, CPU: 15.19 s, VmPeak: 951 MB, VmSize: 725 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.153912 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.83895, ee1=0.10649, ee2=-0.327029 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74377, 32.79835), pm (-6.9, -3.3), parallax 0.515 with NanoMaggies: g=17.6, r=17, z=16.7 Reset brightness to NanoMaggies: g=17.6, r=17, z=16.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74345, 32.80108), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -4.04e+05), r=(flux -5.33e+05), z=(flux -1.25e+06) Reset brightness to NanoMaggies: g=20.9, r=19.7, z=18.9 Measuring 7 iterative sources Blob 1 finished, total: Wall: 53.15 s, CPU: 53.15 s, VmPeak: 949 MB, VmSize: 802 MB, VmRSS: 235 MB, VmData: 263 MB, maxrss: 0.345252 MB Old catalog: 124 New catalog: 115 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/blobs-custom-343717p32793.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/all-models-custom-343717p32793.fits Stage fitblobs : Wall: 53.88 s, CPU: 0.58 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 281 MB, VmData: 341 MB, maxrss: 0.319704 MB Stage fitblobs finished: 2020-07-16T06:01:31.172376 Resources for stage fitblobs : 106.440 s worker CPU, 106.571 s worker Wall, Wall: 53.886 s, Cores in use: 1.99, Total efficiency (on 16 cores): 12.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-16T06:01:31.200662 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-resid.jpg Stage coadds : Wall: 2.71 s, CPU: 1.15 s, VmPeak: 1190 MB, VmSize: 1091 MB, VmRSS: 316 MB, VmData: 370 MB, maxrss: 0.323568 MB Stage coadds finished: 2020-07-16T06:01:33.913851 Resources for stage coadds : 11.083 s worker CPU, 11.531 s worker Wall, Wall: 2.716 s, Cores in use: 4.50, Total efficiency (on 16 cores): 28.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-16T06:01:34.049338 Cut to 1 unWISE tiles Reading WISE tile 3437p333 band 1 Reading WISE tile 3437p333 band 2 Reading WISE tile 3437p333 band 3 Reading WISE tile 3437p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.29 s, CPU: 0.87 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 155 MB, VmData: 193 MB, maxrss: 0.210224 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.41 s, CPU: 1.31 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 154 MB, VmData: 192 MB, maxrss: 0.196564 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.18 s, CPU: 0.43 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 152 MB, VmData: 193 MB, maxrss: 0.2159 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.18 s, CPU: 0.41 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.21072 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.34 s, CPU: 0.98 s, VmPeak: 1190 MB, VmSize: 1054 MB, VmRSS: 279 MB, VmData: 333 MB, maxrss: 0.323568 MB Stage wise_forced finished: 2020-07-16T06:01:37.384952 Resources for stage wise_forced : 6.163 s worker CPU, 5.268 s worker Wall, Wall: 3.338 s, Cores in use: 2.14, Total efficiency (on 16 cores): 13.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-16T06:01:37.523196 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor-i/cus/tractor-custom-343717p32793.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/tractor-custom-343717p32793.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/brick-custom-343717p32793.sha256sum Stage writecat : Wall: 1.29 s, CPU: 0.91 s, VmPeak: 1199 MB, VmSize: 1071 MB, VmRSS: 294 MB, VmData: 346 MB, maxrss: 0.432148 MB Stage writecat finished: 2020-07-16T06:01:38.813809 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.292 s, Cores in use: 0.70, Total efficiency (on 16 cores): 4.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p All done: 143.493 s worker CPU, 237.067 s worker Wall, Wall: 82.462 s, Cores in use: 1.91, Total efficiency (on 16 cores): 11.9 % Finished galaxy PGC069996 in 1.418 minutes. Started working on galaxy PGC069996 at Sat Jul 18 21:40:46 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-18T21:40:46.937778 legacypipe git version: DR9.5.5-6-g531bd718 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.71766499999995', '32.7937009', '--width', '533', '--height', '533', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.71766499999995 32.7937009 Starting process 63466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 63467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 63468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 63469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05902 MB Starting process 63470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059024 MB Starting process 63471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059024 MB Starting process 63472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 63473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 63474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 63475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 63476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 63477 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 63478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 63479 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 63480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 63481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 63482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 63483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 63484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 63485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 63486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 63487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 63488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 63489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 63490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 63491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 63492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 63493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 63494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 63495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 63496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 63497 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058916 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-18T21:40:47.528279 Keeping 13 CCDs: c4d_181017_013846_ooi_z_ls9.fits.fz c4d_181017_013846_ooi_z_ls9-S30 z exptime 221.0 propid 2014B-0404 seeing 1.69 MJD 58408.069 object DECaLS_40043_z c4d_180919_022543_ooi_z_ls9.fits.fz c4d_180919_022543_ooi_z_ls9-S30 z exptime 250.0 propid 2014B-0404 seeing 1.57 MJD 58380.101 object DECaLS_40043_z c4d_181110_011957_ooi_g_ls9.fits.fz c4d_181110_011957_ooi_g_ls9-S30 g exptime 149.0 propid 2014B-0404 seeing 2.11 MJD 58432.056 object DECaLS_40043_g c4d_181105_005716_ooi_r_ls9.fits.fz c4d_181105_005716_ooi_r_ls9-S30 r exptime 74.0 propid 2014B-0404 seeing 1.32 MJD 58427.040 object DECaLS_40043_r c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N15 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N15 z exptime 115.0 propid 2014B-0404 seeing 1.04 MJD 58378.137 object DECaLS_8283_z c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N21 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N21 z exptime 115.0 propid 2014B-0404 seeing 1.01 MJD 58378.137 object DECaLS_8283_z c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-S31 z exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-S31 g exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 58393.080 object DECaLS_24171_g c4d_171025_011731_ooi_z_ls9.fits.fz c4d_171025_011731_ooi_z_ls9-N20 z exptime 195.0 propid 2014B-0404 seeing 1.44 MJD 58051.054 object DECaLS_24155_z c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-S31 r exptime 133.0 propid 2014B-0404 seeing 1.64 MJD 58426.052 object DECaLS_24171_r c4d_181002_022242_ooi_r_ls9.fits.fz c4d_181002_022242_ooi_r_ls9-N20 r exptime 88.0 propid 2014B-0404 seeing 1.38 MJD 58393.099 object DECaLS_24155_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 6.40 s, CPU: 0.99 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 201 MB, VmData: 235 MB, maxrss: 0.237096 MB Stage tims finished: 2020-07-18T21:40:53.929368 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.637 s worker CPU, 58.742 s worker Wall, Wall: 6.404 s, Cores in use: 1.35, Total efficiency (on 32 cores): 4.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-18T21:40:56.971379 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02874.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02746.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/reference-custom-343717p32793.fits Stage refs : Wall: 4.82 s, CPU: 4.35 s, VmPeak: 1056 MB, VmSize: 1051 MB, VmRSS: 254 MB, VmData: 286 MB, maxrss: 0.260576 MB Stage refs finished: 2020-07-18T21:41:01.796108 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.827 s, Cores in use: 0.90, Total efficiency (on 32 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-18T21:41:02.282211 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-pre-custom-343717p32793.jpg Image c4d_181003_020336_ooi_g_ls9-N21 g : masking 13059 positive outlier pixels and 0 negative outlier pixels Image c4d_181110_011957_ooi_g_ls9-S30 g : masking 1223 positive outlier pixels and 214 negative outlier pixels Image c4d_181002_015438_ooi_g_ls9-S31 g : masking 748 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_005716_ooi_r_ls9-S30 r : masking 453 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_011503_ooi_r_ls9-S31 r : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_022242_ooi_r_ls9-N20 r : masking 1177 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_031748_ooi_z_ls9-N21 z : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_013846_ooi_z_ls9-S30 z : masking 1189 positive outlier pixels and 0 negative outlier pixels Image c4d_171025_011731_ooi_z_ls9-N20 z : masking 289 positive outlier pixels and 0 negative outlier pixels Image c4d_180919_022543_ooi_z_ls9-S30 z : masking 1264 positive outlier pixels and 176 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-post-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-pos-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-neg-custom-343717p32793.jpg Stage outliers : Wall: 2.60 s, CPU: 1.69 s, VmPeak: 1190 MB, VmSize: 1126 MB, VmRSS: 309 MB, VmData: 341 MB, maxrss: 0.31604 MB Stage outliers finished: 2020-07-18T21:41:04.884915 Resources for stage outliers : 4.416 s worker CPU, 4.913 s worker Wall, Wall: 2.606 s, Cores in use: 2.34, Total efficiency (on 32 cores): 7.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-18T21:41:05.345483 Stage halos : Wall: 0.93 s, CPU: 0.43 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 301 MB, VmData: 333 MB, maxrss: 0.31604 MB Stage halos finished: 2020-07-18T21:41:06.278920 Resources for stage halos : 4.600 s worker CPU, 4.751 s worker Wall, Wall: 0.938 s, Cores in use: 5.37, Total efficiency (on 32 cores): 16.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-18T21:41:06.645985 PSF sigmas in coadd pixels: ['3.42', '2.61', '2.59', '2.70'] Using average PSF sigma 2.8300878852731586 Gaussian PSF norm 0.09967704297870258 vs pixelized 0.09604344 average tim pixel scale / coadd scale: 1.0014639224035964 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.14', '2.67', '2.25'] Using average PSF sigma 2.351146556471552 Gaussian PSF norm 0.11998179824112186 vs pixelized 0.10424567 average tim pixel scale / coadd scale: 1.0014268483447608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.75', '2.55', '1.69', '1.63', '2.52', '2.34'] Using average PSF sigma 2.248088969960469 Gaussian PSF norm 0.1254820407658682 vs pixelized 0.10650161 average tim pixel scale / coadd scale: 1.0014075031841727 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.61 s, CPU: 0.55 s, VmPeak: 1190 MB, VmSize: 1126 MB, VmRSS: 310 MB, VmData: 341 MB, maxrss: 0.317768 MB Stage fit_on_coadds finished: 2020-07-18T21:41:07.256435 Resources for stage fit_on_coadds : 1.005 s worker CPU, 1.006 s worker Wall, Wall: 0.613 s, Cores in use: 2.53, Total efficiency (on 32 cores): 7.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-18T21:41:07.434261 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 1545 potential peaks Of 1545 potential peaks: 1453 in veto map, 26 cut by saddle test, 0 cut by aper test, 66 kept SED z : 66 new peaks Found 475 potential peaks Of 475 potential peaks: 429 in veto map, 24 cut by saddle test, 0 cut by aper test, 22 kept SED r : 22 new peaks Found 138 potential peaks Of 138 potential peaks: 109 in veto map, 26 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 228 potential peaks Of 228 potential peaks: 193 in veto map, 32 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 254 potential peaks Of 254 potential peaks: 222 in veto map, 31 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 95 new sources Median coadd sky for g : 9.1153255e-05 Median coadd sky for r : 9.681531e-05 Median coadd sky for z : 0.00069602486 Stage srcs : Wall: 3.01 s, CPU: 2.86 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 303 MB, VmData: 333 MB, maxrss: 0.317768 MB Stage srcs finished: 2020-07-18T21:41:10.440047 Resources for stage srcs : 0.383 s worker CPU, 0.383 s worker Wall, Wall: 3.009 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-18T21:41:10.530888 Blob 1 of 27, id: 1, sources: 59, size: 533x502, npix 117109, brick X: 0,533, Y: 31,533, one pixel: 185 31 Blob 2 of 27, id: 0, sources: 21, size: 533x160, npix 33364, brick X: 0,533, Y: 0,160, one pixel: 0 0 Blob 3 of 27, id: 15, sources: 5, size: 63x90, npix 3260, brick X: 74,137, Y: 443,533, one pixel: 105 443 Blob 4 of 27, id: 5, sources: 3, size: 25x66, npix 1289, brick X: 0,25, Y: 100,166, one pixel: 6 100 Blob 5 of 27, id: 18, sources: 1, size: 38x42, npix 1127, brick X: 264,302, Y: 450,492, one pixel: 281 450 Blob 6 of 27, id: 13, sources: 1, size: 44x34, npix 1073, brick X: 83,127, Y: 394,428, one pixel: 93 394 Blob 7 of 27, id: 19, sources: 2, size: 43x40, npix 962, brick X: 305,348, Y: 474,514, one pixel: 318 474 Blob 8 of 27, id: 3, sources: 2, size: 43x35, npix 954, brick X: 95,138, Y: 86,121, one pixel: 126 86 Blob 9 of 27, id: 24, sources: 2, size: 29x42, npix 841, brick X: 276,305, Y: 491,533, one pixel: 287 491 Blob 10 of 27, id: 17, sources: 2, size: 36x34, npix 823, brick X: 497,533, Y: 443,477, one pixel: 511 443 Blob 11 of 27, id: 20, sources: 2, size: 34x43, npix 793, brick X: 376,410, Y: 476,519, one pixel: 385 476 Blob 12 of 27, id: 9, sources: 1, size: 32x36, npix 782, brick X: 13,45, Y: 166,202, one pixel: 27 166 Blob 13 of 27, id: 16, sources: 1, size: 36x31, npix 744, brick X: 375,411, Y: 443,474, one pixel: 386 443 Blob 14 of 27, id: 8, sources: 1, size: 32x34, npix 711, brick X: 500,532, Y: 149,183, one pixel: 515 149 Blob 15 of 27, id: 10, sources: 1, size: 30x32, npix 667, brick X: 420,450, Y: 185,217, one pixel: 431 185 Blob 16 of 27, id: 26, sources: 2, size: 45x20, npix 647, brick X: 187,232, Y: 513,533, one pixel: 218 513 Blob 17 of 27, id: 11, sources: 1, size: 30x31, npix 619, brick X: 387,417, Y: 187,218, one pixel: 401 187 Blob 18 of 27, id: 2, sources: 1, size: 35x27, npix 588, brick X: 336,371, Y: 51,78, one pixel: 346 51 Blob 19 of 27, id: 12, sources: 1, size: 29x34, npix 579, brick X: 490,519, Y: 370,404, one pixel: 504 370 Blob 20 of 27, id: 4, sources: 1, size: 26x28, npix 443, brick X: 42,68, Y: 96,124, one pixel: 56 96 Blob 21 of 27, id: 21, sources: 1, size: 25x25, npix 412, brick X: 151,176, Y: 480,505, one pixel: 162 480 Blob 22 of 27, id: 25, sources: 1, size: 25x24, npix 387, brick X: 131,156, Y: 495,519, one pixel: 142 495 Blob 23 of 27, id: 23, sources: 1, size: 23x24, npix 349, brick X: 177,200, Y: 486,510, one pixel: 186 486 Blob 24 of 27, id: 7, sources: 1, size: 23x22, npix 312, brick X: 384,407, Y: 136,158, one pixel: 392 136 Blob 25 of 27, id: 14, sources: 1, size: 23x21, npix 302, brick X: 175,198, Y: 427,448, one pixel: 184 427 Blob 26 of 27, id: 6, sources: 1, size: 21x22, npix 291, brick X: 132,153, Y: 105,127, one pixel: 141 105 Blob 27 of 27, id: 22, sources: 1, size: 20x20, npix 228, brick X: 209,229, Y: 485,505, one pixel: 218 485 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74177, 32.78421), pm (-9.6, -6.3), parallax 1.220 with NanoMaggies: g=16.2, r=15, z=14.5 Reset brightness to NanoMaggies: g=15.4, r=14.6, z=14.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74980, 32.78490), pm (-8.0, -3.6), parallax 0.541 with NanoMaggies: g=16.6, r=16.1, z=16 Reset brightness to NanoMaggies: g=16.6, r=16.1, z=16 Blob 4 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 691 MB, VmSize: 691 MB, VmRSS: 122 MB, VmData: 169 MB, maxrss: 0.124436 MB Blob 21 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 949 MB, VmSize: 723 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151192 MB Blob 27 finished, total: Wall: 0.41 s, CPU: 0.40 s, VmPeak: 956 MB, VmSize: 723 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151452 MB Blob 23 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 670 MB, VmSize: 666 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.100444 MB Blob 24 finished, total: Wall: 0.49 s, CPU: 0.48 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149512 MB Blob 25 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 128 MB, VmData: 171 MB, maxrss: 0.130648 MB Blob 22 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144276 MB Blob 15 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 678 MB, VmSize: 678 MB, VmRSS: 110 MB, VmData: 156 MB, maxrss: 0.112784 MB Blob 11 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 950 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151256 MB Blob 18 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 691 MB, VmSize: 691 MB, VmRSS: 116 MB, VmData: 169 MB, maxrss: 0.11874 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 26 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 955 MB, VmSize: 724 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149516 MB Blob 20 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 685 MB, VmSize: 664 MB, VmRSS: 100 MB, VmData: 142 MB, maxrss: 0.120292 MB Blob 14 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 672 MB, VmSize: 670 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.104676 MB Blob 6 finished, total: Wall: 1.33 s, CPU: 1.32 s, VmPeak: 953 MB, VmSize: 721 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149784 MB Blob 12 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 948 MB, VmSize: 721 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.1486 MB Blob 9 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 670 MB, VmSize: 666 MB, VmRSS: 98 MB, VmData: 144 MB, maxrss: 0.099876 MB Blob 7 finished, total: Wall: 1.43 s, CPU: 1.43 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144284 MB Blob 13 finished, total: Wall: 1.61 s, CPU: 1.61 s, VmPeak: 673 MB, VmSize: 668 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.10328 MB Blob 16 finished, total: Wall: 1.65 s, CPU: 1.65 s, VmPeak: 678 MB, VmSize: 678 MB, VmRSS: 109 MB, VmData: 156 MB, maxrss: 0.111864 MB Measuring 1 iterative sources Blob 19 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 949 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.15146 MB Blob 8 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 951 MB, VmSize: 729 MB, VmRSS: 154 MB, VmData: 191 MB, maxrss: 0.158076 MB Blob 10 finished, total: Wall: 1.98 s, CPU: 1.98 s, VmPeak: 672 MB, VmSize: 669 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.104092 MB Blob 17 finished, total: Wall: 1.98 s, CPU: 1.98 s, VmPeak: 671 MB, VmSize: 668 MB, VmRSS: 101 MB, VmData: 146 MB, maxrss: 0.10354 MB Blob 5 finished, total: Wall: 2.06 s, CPU: 2.05 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 103 MB, VmData: 148 MB, maxrss: 0.105244 MB Measuring 3 iterative sources Blob 3 finished, total: Wall: 5.47 s, CPU: 5.47 s, VmPeak: 672 MB, VmSize: 669 MB, VmRSS: 102 MB, VmData: 146 MB, maxrss: 0.104584 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.79220, 32.77436), pm (-7.2, -5.2), parallax 0.860 with NanoMaggies: g=10.1, r=8.71, z=7.79 Reset brightness to NanoMaggies: g=10.1, r=8.71, z=7.79 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.77923, 32.73476), pm (-11.1, -5.1), parallax 2.024 with NanoMaggies: g=10.3, r=9.3, z=8.83 Reset brightness to NanoMaggies: g=10.3, r=9.3, z=8.83 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.69373, 32.77859), pm (-5.8, -4.9), parallax 0.365 with NanoMaggies: g=16.8, r=16, z=15.6 Reset brightness to NanoMaggies: g=16.5, r=16.1, z=15.9 Measuring 2 iterative sources Blob 2 finished, total: Wall: 14.52 s, CPU: 14.52 s, VmPeak: 951 MB, VmSize: 724 MB, VmRSS: 150 MB, VmData: 186 MB, maxrss: 0.1536 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.83887, ee1=0.106378, ee2=-0.326963 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74377, 32.79835), pm (-6.9, -3.3), parallax 0.515 with NanoMaggies: g=17.6, r=17, z=16.7 Reset brightness to NanoMaggies: g=17.6, r=17, z=16.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74345, 32.80108), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -4.04e+05), r=(flux -5.33e+05), z=(flux -1.25e+06) Reset brightness to NanoMaggies: g=20.9, r=19.7, z=18.9 Measuring 7 iterative sources Blob 1 finished, total: Wall: 54.25 s, CPU: 54.24 s, VmPeak: 956 MB, VmSize: 801 MB, VmRSS: 235 MB, VmData: 263 MB, maxrss: 0.345104 MB Old catalog: 124 New catalog: 115 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/blobs-custom-343717p32793.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/all-models-custom-343717p32793.fits Stage fitblobs : Wall: 55.56 s, CPU: 0.76 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 312 MB, VmData: 342 MB, maxrss: 0.319028 MB Stage fitblobs finished: 2020-07-18T21:42:06.086354 Resources for stage fitblobs : 101.736 s worker CPU, 101.814 s worker Wall, Wall: 55.558 s, Cores in use: 1.84, Total efficiency (on 32 cores): 5.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-18T21:42:06.759873 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-resid.jpg Stage coadds : Wall: 3.18 s, CPU: 1.26 s, VmPeak: 1190 MB, VmSize: 1092 MB, VmRSS: 342 MB, VmData: 372 MB, maxrss: 0.35016 MB Stage coadds finished: 2020-07-18T21:42:09.943085 Resources for stage coadds : 27.815 s worker CPU, 28.495 s worker Wall, Wall: 3.187 s, Cores in use: 9.12, Total efficiency (on 32 cores): 28.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-18T21:42:09.980424 Cut to 1 unWISE tiles Reading WISE tile 3437p333 band 1 Reading WISE tile 3437p333 band 2 Reading WISE tile 3437p333 band 3 Reading WISE tile 3437p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.23 s, CPU: 0.63 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 150 MB, VmData: 189 MB, maxrss: 0.212264 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.42 s, CPU: 1.35 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 151 MB, VmData: 192 MB, maxrss: 0.193076 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.45 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 152 MB, VmData: 192 MB, maxrss: 0.207476 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.38 s, VmPeak: 1068 MB, VmSize: 1004 MB, VmRSS: 151 MB, VmData: 193 MB, maxrss: 0.212004 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.75 s, CPU: 0.91 s, VmPeak: 1190 MB, VmSize: 1058 MB, VmRSS: 308 MB, VmData: 338 MB, maxrss: 0.35016 MB Stage wise_forced finished: 2020-07-18T21:42:12.725821 Resources for stage wise_forced : 6.003 s worker CPU, 5.073 s worker Wall, Wall: 2.748 s, Cores in use: 2.52, Total efficiency (on 32 cores): 7.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-18T21:42:12.786222 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor-i/cus/tractor-custom-343717p32793.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/tractor-custom-343717p32793.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/brick-custom-343717p32793.sha256sum Stage writecat : Wall: 1.22 s, CPU: 1.05 s, VmPeak: 1202 MB, VmSize: 1074 MB, VmRSS: 322 MB, VmData: 350 MB, maxrss: 0.460956 MB Stage writecat finished: 2020-07-18T21:42:14.005652 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.222 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p All done: 153.607 s worker CPU, 205.189 s worker Wall, Wall: 86.635 s, Cores in use: 1.95, Total efficiency (on 32 cores): 6.1 % Finished galaxy PGC069996 in 1.480 minutes. Started working on galaxy PGC069996 at Mon Jul 20 17:00:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 24 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-20T17:00:01.886190 legacypipe git version: DR9.5.5-15-ga4c3fd1e Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.71766499999995', '32.7937009', '--width', '533', '--height', '533', '--pixscale', '0.262', '--threads', '24', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 24 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.71766499999995 32.7937009 Starting process 18603 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 18604 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 18605 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 18606 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059028 MB Starting process 18607 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059032 MB Starting process 18608 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059032 MB Starting process 18609 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18610 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18611 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18612 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18613 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18614 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18615 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18616 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18617 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18618 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 18619 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 18620 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 18621 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 18622 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 18623 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 18624 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 18625 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 18626 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-20T17:00:02.590549 Keeping 13 CCDs: c4d_181017_013846_ooi_z_ls9.fits.fz c4d_181017_013846_ooi_z_ls9-S30 z exptime 221.0 propid 2014B-0404 seeing 1.69 MJD 58408.069 object DECaLS_40043_z c4d_180919_022543_ooi_z_ls9.fits.fz c4d_180919_022543_ooi_z_ls9-S30 z exptime 250.0 propid 2014B-0404 seeing 1.57 MJD 58380.101 object DECaLS_40043_z c4d_181110_011957_ooi_g_ls9.fits.fz c4d_181110_011957_ooi_g_ls9-S30 g exptime 149.0 propid 2014B-0404 seeing 2.11 MJD 58432.056 object DECaLS_40043_g c4d_181105_005716_ooi_r_ls9.fits.fz c4d_181105_005716_ooi_r_ls9-S30 r exptime 74.0 propid 2014B-0404 seeing 1.32 MJD 58427.040 object DECaLS_40043_r c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N15 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N15 z exptime 115.0 propid 2014B-0404 seeing 1.04 MJD 58378.137 object DECaLS_8283_z c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N21 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N21 z exptime 115.0 propid 2014B-0404 seeing 1.01 MJD 58378.137 object DECaLS_8283_z c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-S31 z exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-S31 g exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 58393.080 object DECaLS_24171_g c4d_171025_011731_ooi_z_ls9.fits.fz c4d_171025_011731_ooi_z_ls9-N20 z exptime 195.0 propid 2014B-0404 seeing 1.44 MJD 58051.054 object DECaLS_24155_z c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-S31 r exptime 133.0 propid 2014B-0404 seeing 1.64 MJD 58426.052 object DECaLS_24171_r c4d_181002_022242_ooi_r_ls9.fits.fz c4d_181002_022242_ooi_r_ls9-N20 r exptime 88.0 propid 2014B-0404 seeing 1.38 MJD 58393.099 object DECaLS_24155_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 7.40 s, CPU: 1.02 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 201 MB, VmData: 235 MB, maxrss: 0.205932 MB Stage tims finished: 2020-07-20T17:00:09.986716 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.240 s worker CPU, 61.571 s worker Wall, Wall: 7.399 s, Cores in use: 1.12, Total efficiency (on 24 cores): 4.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Running stage refs Running stage refs at 2020-07-20T17:00:12.917071 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02874.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02746.fits Matched 6 large galaxies to Gaia stars. Matched 1 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/reference-custom-343717p32793.fits Stage refs : Wall: 4.88 s, CPU: 4.41 s, VmPeak: 1056 MB, VmSize: 1051 MB, VmRSS: 255 MB, VmData: 287 MB, maxrss: 0.261024 MB Stage refs finished: 2020-07-20T17:00:17.794758 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.880 s, Cores in use: 0.90, Total efficiency (on 24 cores): 3.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-20T17:00:18.643583 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-pre-custom-343717p32793.jpg Image c4d_181003_020336_ooi_g_ls9-N21 g : masking 13059 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_015438_ooi_g_ls9-S31 g : masking 748 positive outlier pixels and 0 negative outlier pixels Image c4d_181110_011957_ooi_g_ls9-S30 g : masking 1223 positive outlier pixels and 214 negative outlier pixels Image c4d_181105_005716_ooi_r_ls9-S30 r : masking 453 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_022242_ooi_r_ls9-N20 r : masking 1177 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_011503_ooi_r_ls9-S31 r : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_031748_ooi_z_ls9-N21 z : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_013846_ooi_z_ls9-S30 z : masking 1189 positive outlier pixels and 0 negative outlier pixels Image c4d_180919_022543_ooi_z_ls9-S30 z : masking 1264 positive outlier pixels and 176 negative outlier pixels Image c4d_171025_011731_ooi_z_ls9-N20 z : masking 289 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-post-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-pos-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-neg-custom-343717p32793.jpg Stage outliers : Wall: 2.64 s, CPU: 1.68 s, VmPeak: 1190 MB, VmSize: 1126 MB, VmRSS: 305 MB, VmData: 334 MB, maxrss: 0.312168 MB Stage outliers finished: 2020-07-20T17:00:21.280570 Resources for stage outliers : 3.976 s worker CPU, 4.333 s worker Wall, Wall: 2.640 s, Cores in use: 2.14, Total efficiency (on 24 cores): 8.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Running stage halos timing_worker caught KeyboardInterrupt during get() timing_worker caught KeyboardInterrupt during get() ctrl-c timing_worker caught KeyboardInterrupt during get() ctrl-c ctrl-c timing_worker caught KeyboardInterrupt during get() timing_worker caught KeyboardInterrupt during get() ctrl-c ctrl-c timing_worker caught KeyboardInterrupt during get() ctrl-c Running stage halos at 2020-07-20T17:00:22.145168 timing_worker caught KeyboardInterrupt during get() ctrl-c timing_worker caught KeyboardInterrupt during get() ctrl-c timing_worker caught KeyboardInterrupt during get() ctrl-c timing_worker caught KeyboardInterrupt during get() ctrl-c timing_worker caught KeyboardInterrupt during get() ctrl-c Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 114, in decam_halo_model moffat(rads*pixscale, alpha, beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Process PoolWorker-15: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 114, in decam_halo_model moffat(rads*pixscale, alpha, beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 114, in decam_halo_model moffat(rads*pixscale, alpha, beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Process PoolWorker-21: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 114, in decam_halo_model moffat(rads*pixscale, alpha, beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 78, in decam_halo_model np.arange(xlo, xhi+1)[np.newaxis,:] - x) KeyboardInterrupt Process PoolWorker-13: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 78, in decam_halo_model np.arange(xlo, xhi+1)[np.newaxis,:] - x) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 114, in decam_halo_model moffat(rads*pixscale, alpha, beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Process PoolWorker-7: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 114, in decam_halo_model moffat(rads*pixscale, alpha, beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 127, in decam_halo_model moffat(rads*pixscale, inner_alpha, inner_beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Process PoolWorker-6: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 127, in decam_halo_model moffat(rads*pixscale, inner_alpha, inner_beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 122, in decam_halo_model * pixscale**2) KeyboardInterrupt Process PoolWorker-1: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 122, in decam_halo_model * pixscale**2) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 127, in decam_halo_model moffat(rads*pixscale, inner_alpha, inner_beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Process PoolWorker-24: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 127, in decam_halo_model moffat(rads*pixscale, inner_alpha, inner_beta) * pixscale**2) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 35, in moffat return (beta-1.)/(np.pi * alpha**2)*(1. + (rr/alpha)**2)**(-beta) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 991, in read_psf_model I, = np.nonzero((T.expnum == self.expnum) * KeyboardInterrupt Process PoolWorker-5: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 991, in read_psf_model I, = np.nonzero((T.expnum == self.expnum) * KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 999, in read_psf_model self.plprocid, data=T, old_calibs_ok=old_calibs_ok): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 1801, in validate_procdate_plver if not os.path.exists(fn): File "/opt/conda/lib/python3.7/genericpath.py", line 19, in exists os.stat(path) KeyboardInterrupt Process PoolWorker-8: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 999, in read_psf_model self.plprocid, data=T, old_calibs_ok=old_calibs_ok): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 1801, in validate_procdate_plver if not os.path.exists(fn): File "/opt/conda/lib/python3.7/genericpath.py", line 19, in exists os.stat(path) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 999, in read_psf_model self.plprocid, data=T, old_calibs_ok=old_calibs_ok): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 1801, in validate_procdate_plver if not os.path.exists(fn): File "/opt/conda/lib/python3.7/genericpath.py", line 19, in exists os.stat(path) KeyboardInterrupt Process PoolWorker-18: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 999, in read_psf_model self.plprocid, data=T, old_calibs_ok=old_calibs_ok): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 1801, in validate_procdate_plver if not os.path.exists(fn): File "/opt/conda/lib/python3.7/genericpath.py", line 19, in exists os.stat(path) KeyboardInterrupt Error reading from FITS object file: /global/cfs/cdirs/cosmo/work/legacysurvey/dr9/calib/psfex/decam/CP/V4.8.2a/CP20181001/c4d_181002_015438_ooi_g_ls9-psfex.fits extension: 1 type: BINARY_TBL rows: 61 column info: psf_samp f8 psfaxis3 i8 polname1 S7 polscal2 f8 psfnaxis i8 loaded i8 chi2 f8 polzero1 f8 polgrp1 i8 psfaxis2 i8 accepted i8 poldeg1 i8 polnaxis i8 polzero2 f8 polngrp i8 polscal1 f8 psf_fwhm f8 psfaxis1 i8 polgrp2 i8 polname2 S7 psf_mask f4 array[63,63,6] legpipev S20 plver S7 plprocid S7 imgdsum i8 procdate S19 expnum i8 ccdname S3 psf_patch_ver S7 moffat_alpha f8 moffat_beta f8 sum_diff f8 fit_original f8 failure b1 dataorfn /global/cfs/cdirs/cosmo/work/legacysurvey/dr9/calib/psfex/decam/CP/V4.8.2a/CP20181001/c4d_181002_015438_ooi_g_ls9-psfex.fits Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 990, in read_psf_model T = fits_table(fn) File "/usr/local/lib/python/astrometry/util/fits.py", line 734, in fits_table dd = data.read(rows=rows, columns=columns, lower=True) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 715, in read upper=upper, lower=lower, trim_strings=trim_strings) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 780, in _read_all array = self._maybe_decode_fits_ascii_strings_to_unicode_py3(array) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 1552, in _maybe_decode_fits_ascii_strings_to_unicode_py3 array = array.astype(new_dt, copy=False) KeyboardInterrupt Process PoolWorker-22: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 990, in read_psf_model T = fits_table(fn) File "/usr/local/lib/python/astrometry/util/fits.py", line 734, in fits_table dd = data.read(rows=rows, columns=columns, lower=True) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 715, in read upper=upper, lower=lower, trim_strings=trim_strings) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 780, in _read_all array = self._maybe_decode_fits_ascii_strings_to_unicode_py3(array) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 1552, in _maybe_decode_fits_ascii_strings_to_unicode_py3 array = array.astype(new_dt, copy=False) KeyboardInterrupt Error reading from FITS object file: /global/cfs/cdirs/cosmo/work/legacysurvey/dr9/calib/psfex/decam/CP/V4.8.2a/CP20181001/c4d_181002_022242_ooi_r_ls9-psfex.fits extension: 1 type: BINARY_TBL rows: 61 column info: psfaxis2 i8 polzero1 f8 polname1 S7 chi2 f8 polngrp i8 psfaxis3 i8 psfaxis1 i8 polscal2 f8 accepted i8 polzero2 f8 psfnaxis i8 psf_samp f8 polname2 S7 polnaxis i8 polgrp1 i8 psf_fwhm f8 polgrp2 i8 loaded i8 polscal1 f8 poldeg1 i8 psf_mask f4 array[63,63,6] legpipev S20 plver S7 plprocid S7 imgdsum i8 procdate S19 expnum i8 ccdname S3 psf_patch_ver S7 moffat_alpha f8 moffat_beta f8 sum_diff f8 fit_original f8 failure b1 dataorfn /global/cfs/cdirs/cosmo/work/legacysurvey/dr9/calib/psfex/decam/CP/V4.8.2a/CP20181001/c4d_181002_022242_ooi_r_ls9-psfex.fits Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 990, in read_psf_model T = fits_table(fn) File "/usr/local/lib/python/astrometry/util/fits.py", line 734, in fits_table dd = data.read(rows=rows, columns=columns, lower=True) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 715, in read upper=upper, lower=lower, trim_strings=trim_strings) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 780, in _read_all array = self._maybe_decode_fits_ascii_strings_to_unicode_py3(array) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 1537, in _maybe_decode_fits_ascii_strings_to_unicode_py3 for _dt in array.dtype.descr: File "/opt/conda/lib/python3.7/site-packages/numpy/core/_internal.py", line 129, in _array_descr result.append(tup) KeyboardInterrupt Process PoolWorker-2: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 47, in decam_halo_model psf = imobj.read_psf_model(0,0, pixPsf=True) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/image.py", line 990, in read_psf_model T = fits_table(fn) File "/usr/local/lib/python/astrometry/util/fits.py", line 734, in fits_table dd = data.read(rows=rows, columns=columns, lower=True) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 715, in read upper=upper, lower=lower, trim_strings=trim_strings) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 780, in _read_all array = self._maybe_decode_fits_ascii_strings_to_unicode_py3(array) File "/opt/conda/lib/python3.7/site-packages/fitsio/hdu/table.py", line 1537, in _maybe_decode_fits_ascii_strings_to_unicode_py3 for _dt in array.dtype.descr: File "/opt/conda/lib/python3.7/site-packages/numpy/core/_internal.py", line 129, in _array_descr result.append(tup) KeyboardInterrupt Traceback (most recent call last): File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 122, in decam_halo_model * pixscale**2) KeyboardInterrupt Process PoolWorker-17: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/usr/local/lib/python/astrometry/util/timingpool.py", line 261, in timing_worker success,val = (True, func(*args, **kwds)) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 44, in mapstar return list(map(*args)) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 20, in subtract_one return subtract_one_real(X) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 32, in subtract_one_real tim.imobj.pixscale, tim.band, tim.imobj, moffat) File "/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/halos.py", line 122, in decam_halo_model * pixscale**2) KeyboardInterrupt Process ForkPoolWorker-28: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-25: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-33: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-26: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-44: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-37: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-48: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-32: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-45: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-43: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-31: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-47: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-42: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-46: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-34: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-39: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-41: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-35: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-29: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-30: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-27: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-38: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-40: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Process ForkPoolWorker-36: Traceback (most recent call last): File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 297, in _bootstrap self.run() File "/opt/conda/lib/python3.7/multiprocessing/process.py", line 99, in run self._target(*self._args, **self._kwargs) File "/opt/conda/lib/python3.7/multiprocessing/pool.py", line 110, in worker task = get() File "/opt/conda/lib/python3.7/multiprocessing/queues.py", line 351, in get with self._rlock: File "/opt/conda/lib/python3.7/multiprocessing/synchronize.py", line 95, in __enter__ return self._semlock.__enter__() KeyboardInterrupt Started working on galaxy PGC069996 at Mon Jul 20 17:06:28 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-20T17:06:28.998809 legacypipe git version: DR9.5.5-15-ga4c3fd1e Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.71766499999995', '32.7937009', '--width', '533', '--height', '533', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.71766499999995 32.7937009 Starting process 18944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058932 MB Starting process 18945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058932 MB Starting process 18946 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059024 MB Starting process 18947 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059156 MB Starting process 18949 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB Starting process 18950 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB Starting process 18951 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058964 MB Starting process 18952 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058944 MB Starting process 18953 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058944 MB Starting process 18954 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058944 MB Starting process 18955 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 18956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 18957 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 18958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 18959 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 18960 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 18961 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 18962 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 18963 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 18964 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 18965 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 18966 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 18967 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 18968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 18969 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 18970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 18971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 18972 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 18973 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB Starting process 18974 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058924 MB Starting process 18975 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058924 MB Starting process 18976 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058924 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p and forcing stage outliers Runstage refs Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p and forcing stage refs Runstage tims Ignoring pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p and forcing stage tims Running stage tims Running stage tims at 2020-07-20T17:06:29.590062 Keeping 13 CCDs: c4d_181017_013846_ooi_z_ls9.fits.fz c4d_181017_013846_ooi_z_ls9-S30 z exptime 221.0 propid 2014B-0404 seeing 1.69 MJD 58408.069 object DECaLS_40043_z c4d_180919_022543_ooi_z_ls9.fits.fz c4d_180919_022543_ooi_z_ls9-S30 z exptime 250.0 propid 2014B-0404 seeing 1.57 MJD 58380.101 object DECaLS_40043_z c4d_181110_011957_ooi_g_ls9.fits.fz c4d_181110_011957_ooi_g_ls9-S30 g exptime 149.0 propid 2014B-0404 seeing 2.11 MJD 58432.056 object DECaLS_40043_g c4d_181105_005716_ooi_r_ls9.fits.fz c4d_181105_005716_ooi_r_ls9-S30 r exptime 74.0 propid 2014B-0404 seeing 1.32 MJD 58427.040 object DECaLS_40043_r c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N15 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N15 z exptime 115.0 propid 2014B-0404 seeing 1.04 MJD 58378.137 object DECaLS_8283_z c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N21 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N21 z exptime 115.0 propid 2014B-0404 seeing 1.01 MJD 58378.137 object DECaLS_8283_z c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-S31 z exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-S31 g exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 58393.080 object DECaLS_24171_g c4d_171025_011731_ooi_z_ls9.fits.fz c4d_171025_011731_ooi_z_ls9-N20 z exptime 195.0 propid 2014B-0404 seeing 1.44 MJD 58051.054 object DECaLS_24155_z c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-S31 r exptime 133.0 propid 2014B-0404 seeing 1.64 MJD 58426.052 object DECaLS_24171_r c4d_181002_022242_ooi_r_ls9.fits.fz c4d_181002_022242_ooi_r_ls9-N20 r exptime 88.0 propid 2014B-0404 seeing 1.38 MJD 58393.099 object DECaLS_24155_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 6.43 s, CPU: 0.94 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 201 MB, VmData: 235 MB, maxrss: 0.205596 MB Stage tims finished: 2020-07-20T17:06:36.017740 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.407 s worker CPU, 61.397 s worker Wall, Wall: 6.431 s, Cores in use: 1.30, Total efficiency (on 32 cores): 4.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-20T17:06:36.318650 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02874.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02746.fits Matched 6 large galaxies to Gaia stars. Matched 1 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/reference-custom-343717p32793.fits Stage refs : Wall: 4.83 s, CPU: 4.31 s, VmPeak: 1056 MB, VmSize: 1051 MB, VmRSS: 255 MB, VmData: 286 MB, maxrss: 0.260892 MB Stage refs finished: 2020-07-20T17:06:41.152688 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.837 s, Cores in use: 0.89, Total efficiency (on 32 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-20T17:06:41.281037 Stage outliers : Wall: 0.42 s, CPU: 0.41 s, VmPeak: 1056 MB, VmSize: 1052 MB, VmRSS: 257 MB, VmData: 288 MB, maxrss: 0.26314 MB Stage outliers finished: 2020-07-20T17:06:41.705765 Resources for stage outliers : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.427 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-20T17:06:42.296182 Stage halos : Wall: 1.02 s, CPU: 0.55 s, VmPeak: 1056 MB, VmSize: 1052 MB, VmRSS: 273 MB, VmData: 304 MB, maxrss: 0.279448 MB Stage halos finished: 2020-07-20T17:06:43.317037 Resources for stage halos : 4.185 s worker CPU, 4.609 s worker Wall, Wall: 1.024 s, Cores in use: 4.63, Total efficiency (on 32 cores): 14.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-20T17:06:43.396892 PSF sigmas in coadd pixels: ['3.42', '2.61', '2.59', '2.70'] Using average PSF sigma 2.8300878852731586 Gaussian PSF norm 0.09967704297870258 vs pixelized 0.09604344 average tim pixel scale / coadd scale: 1.0014639224035964 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.14', '2.67', '2.25'] Using average PSF sigma 2.351146556471552 Gaussian PSF norm 0.11998179824112186 vs pixelized 0.10424567 average tim pixel scale / coadd scale: 1.0014268483447608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.75', '2.55', '1.69', '1.63', '2.52', '2.34'] Using average PSF sigma 2.248088969960469 Gaussian PSF norm 0.1254820407658682 vs pixelized 0.10650161 average tim pixel scale / coadd scale: 1.0014075031841727 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.64 s, CPU: 0.54 s, VmPeak: 1180 MB, VmSize: 1057 MB, VmRSS: 296 MB, VmData: 324 MB, maxrss: 0.309224 MB Stage fit_on_coadds finished: 2020-07-20T17:06:44.040063 Resources for stage fit_on_coadds : 1.014 s worker CPU, 1.232 s worker Wall, Wall: 0.646 s, Cores in use: 2.41, Total efficiency (on 32 cores): 7.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-20T17:06:44.086500 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 1522 potential peaks Of 1522 potential peaks: 1430 in veto map, 26 cut by saddle test, 0 cut by aper test, 66 kept SED z : 66 new peaks Found 475 potential peaks Of 475 potential peaks: 429 in veto map, 24 cut by saddle test, 0 cut by aper test, 22 kept SED r : 22 new peaks Found 138 potential peaks Of 138 potential peaks: 109 in veto map, 26 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 228 potential peaks Of 228 potential peaks: 193 in veto map, 32 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 260 potential peaks Of 260 potential peaks: 228 in veto map, 31 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 95 new sources Median coadd sky for g : 9.1153284e-05 Median coadd sky for r : 9.681531e-05 Median coadd sky for z : 0.00069602457 Stage srcs : Wall: 3.26 s, CPU: 3.14 s, VmPeak: 1180 MB, VmSize: 1057 MB, VmRSS: 265 MB, VmData: 324 MB, maxrss: 0.309224 MB Stage srcs finished: 2020-07-20T17:06:47.341920 Resources for stage srcs : 0.329 s worker CPU, 0.329 s worker Wall, Wall: 3.258 s, Cores in use: 1.06, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-20T17:06:49.671645 Blob 1 of 27, id: 1, sources: 59, size: 533x502, npix 117109, brick X: 0,533, Y: 31,533, one pixel: 185 31 Blob 2 of 27, id: 0, sources: 21, size: 533x160, npix 33364, brick X: 0,533, Y: 0,160, one pixel: 0 0 Blob 3 of 27, id: 15, sources: 5, size: 63x90, npix 3260, brick X: 74,137, Y: 443,533, one pixel: 105 443 Blob 4 of 27, id: 5, sources: 3, size: 25x66, npix 1289, brick X: 0,25, Y: 100,166, one pixel: 6 100 Blob 5 of 27, id: 18, sources: 1, size: 38x42, npix 1127, brick X: 264,302, Y: 450,492, one pixel: 281 450 Blob 6 of 27, id: 13, sources: 1, size: 44x34, npix 1073, brick X: 83,127, Y: 394,428, one pixel: 93 394 Blob 7 of 27, id: 19, sources: 2, size: 43x40, npix 962, brick X: 305,348, Y: 474,514, one pixel: 318 474 Blob 8 of 27, id: 3, sources: 2, size: 43x35, npix 954, brick X: 95,138, Y: 86,121, one pixel: 126 86 Blob 9 of 27, id: 24, sources: 2, size: 29x42, npix 841, brick X: 276,305, Y: 491,533, one pixel: 287 491 Blob 10 of 27, id: 17, sources: 2, size: 36x34, npix 823, brick X: 497,533, Y: 443,477, one pixel: 511 443 Blob 11 of 27, id: 20, sources: 2, size: 34x43, npix 793, brick X: 376,410, Y: 476,519, one pixel: 385 476 Blob 12 of 27, id: 9, sources: 1, size: 32x36, npix 782, brick X: 13,45, Y: 166,202, one pixel: 27 166 Blob 13 of 27, id: 16, sources: 1, size: 36x31, npix 744, brick X: 375,411, Y: 443,474, one pixel: 386 443 Blob 14 of 27, id: 8, sources: 1, size: 32x34, npix 711, brick X: 500,532, Y: 149,183, one pixel: 515 149 Blob 15 of 27, id: 10, sources: 1, size: 30x32, npix 667, brick X: 420,450, Y: 185,217, one pixel: 431 185 Blob 16 of 27, id: 26, sources: 2, size: 45x20, npix 647, brick X: 187,232, Y: 513,533, one pixel: 218 513 Blob 17 of 27, id: 11, sources: 1, size: 30x31, npix 619, brick X: 387,417, Y: 187,218, one pixel: 401 187 Blob 18 of 27, id: 2, sources: 1, size: 35x27, npix 588, brick X: 336,371, Y: 51,78, one pixel: 346 51 Blob 19 of 27, id: 12, sources: 1, size: 29x34, npix 579, brick X: 490,519, Y: 370,404, one pixel: 504 370 Blob 20 of 27, id: 4, sources: 1, size: 26x28, npix 443, brick X: 42,68, Y: 96,124, one pixel: 56 96 Blob 21 of 27, id: 21, sources: 1, size: 25x25, npix 412, brick X: 151,176, Y: 480,505, one pixel: 162 480 Blob 22 of 27, id: 25, sources: 1, size: 25x24, npix 387, brick X: 131,156, Y: 495,519, one pixel: 142 495 Blob 23 of 27, id: 23, sources: 1, size: 23x24, npix 349, brick X: 177,200, Y: 486,510, one pixel: 186 486 Blob 24 of 27, id: 7, sources: 1, size: 23x22, npix 312, brick X: 384,407, Y: 136,158, one pixel: 392 136 Blob 25 of 27, id: 14, sources: 1, size: 23x21, npix 302, brick X: 175,198, Y: 427,448, one pixel: 184 427 Blob 26 of 27, id: 6, sources: 1, size: 21x22, npix 291, brick X: 132,153, Y: 105,127, one pixel: 141 105 Blob 27 of 27, id: 22, sources: 1, size: 20x20, npix 228, brick X: 209,229, Y: 485,505, one pixel: 218 485 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74177, 32.78421), pm (-9.6, -6.3), parallax 1.220 with NanoMaggies: g=16.2, r=15, z=14.5 Reset brightness to NanoMaggies: g=15.4, r=14.6, z=14.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74980, 32.78490), pm (-8.0, -3.6), parallax 0.541 with NanoMaggies: g=16.6, r=16.1, z=16 Reset brightness to NanoMaggies: g=16.6, r=16.1, z=16 Blob 4 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 106 MB, VmData: 164 MB, maxrss: 0.1085 MB Blob 27 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 665 MB, VmSize: 663 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.097264 MB Blob 24 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 665 MB, VmSize: 665 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099452 MB Blob 25 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 99 MB, VmData: 145 MB, maxrss: 0.101688 MB Blob 21 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 139 MB, VmData: 180 MB, maxrss: 0.14216 MB Blob 23 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.102676 MB Blob 22 finished, total: Wall: 0.51 s, CPU: 0.51 s, VmPeak: 686 MB, VmSize: 686 MB, VmRSS: 120 MB, VmData: 164 MB, maxrss: 0.123152 MB Blob 15 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143972 MB Measuring 1 iterative sources Blob 20 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 955 MB, VmSize: 723 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150156 MB Measuring 1 iterative sources Blob 26 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 951 MB, VmSize: 724 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149052 MB Blob 18 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 662 MB, VmSize: 662 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096608 MB Blob 11 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 122 MB, VmData: 166 MB, maxrss: 0.124572 MB Blob 6 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 949 MB, VmSize: 724 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149296 MB Blob 12 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.15174 MB Blob 14 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 121 MB, VmData: 166 MB, maxrss: 0.123604 MB Blob 9 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.11316 MB Blob 16 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 101 MB, VmData: 146 MB, maxrss: 0.103712 MB Blob 13 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 117 MB, VmData: 166 MB, maxrss: 0.120316 MB Blob 8 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 661 MB, VmSize: 660 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.093904 MB Blob 7 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 117 MB, VmData: 166 MB, maxrss: 0.120072 MB Measuring 1 iterative sources Blob 19 finished, total: Wall: 1.50 s, CPU: 1.50 s, VmPeak: 956 MB, VmSize: 723 MB, VmRSS: 145 MB, VmData: 185 MB, maxrss: 0.148296 MB Blob 10 finished, total: Wall: 1.64 s, CPU: 1.63 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 120 MB, VmData: 166 MB, maxrss: 0.1224 MB Blob 5 finished, total: Wall: 1.69 s, CPU: 1.69 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 186 MB, maxrss: 0.151984 MB Blob 17 finished, total: Wall: 1.76 s, CPU: 1.76 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 100 MB, VmData: 146 MB, maxrss: 0.102528 MB Measuring 3 iterative sources Blob 3 finished, total: Wall: 5.18 s, CPU: 5.18 s, VmPeak: 953 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150052 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.79220, 32.77436), pm (-7.2, -5.2), parallax 0.860 with NanoMaggies: g=10.1, r=8.71, z=7.79 Reset brightness to NanoMaggies: g=10.1, r=8.71, z=7.79 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.77923, 32.73476), pm (-11.1, -5.1), parallax 2.024 with NanoMaggies: g=10.3, r=9.3, z=8.83 Reset brightness to NanoMaggies: g=10.3, r=9.3, z=8.83 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.69373, 32.77859), pm (-5.8, -4.9), parallax 0.365 with NanoMaggies: g=16.8, r=16, z=15.6 Reset brightness to NanoMaggies: g=16.5, r=16.1, z=15.9 Measuring 2 iterative sources Blob 2 finished, total: Wall: 13.77 s, CPU: 13.75 s, VmPeak: 689 MB, VmSize: 689 MB, VmRSS: 123 MB, VmData: 167 MB, maxrss: 0.126008 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.83887, ee1=0.106378, ee2=-0.326964 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74377, 32.79835), pm (-6.9, -3.3), parallax 0.515 with NanoMaggies: g=17.6, r=17, z=16.7 Reset brightness to NanoMaggies: g=17.6, r=17, z=16.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74345, 32.80108), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -4.04e+05), r=(flux -5.33e+05), z=(flux -1.25e+06) Reset brightness to NanoMaggies: g=20.9, r=19.7, z=18.9 Measuring 7 iterative sources Blob 1 finished, total: Wall: 52.19 s, CPU: 52.16 s, VmPeak: 950 MB, VmSize: 767 MB, VmRSS: 200 MB, VmData: 229 MB, maxrss: 0.34658 MB Old catalog: 124 New catalog: 115 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/blobs-custom-343717p32793.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/all-models-custom-343717p32793.fits Stage fitblobs : Wall: 53.28 s, CPU: 0.95 s, VmPeak: 1180 MB, VmSize: 1057 MB, VmRSS: 280 MB, VmData: 340 MB, maxrss: 0.309224 MB Stage fitblobs finished: 2020-07-20T17:07:42.946917 Resources for stage fitblobs : 93.625 s worker CPU, 93.737 s worker Wall, Wall: 53.279 s, Cores in use: 1.78, Total efficiency (on 32 cores): 5.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-20T17:07:43.749424 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-resid.jpg Stage coadds : Wall: 3.06 s, CPU: 1.19 s, VmPeak: 1180 MB, VmSize: 1095 MB, VmRSS: 318 MB, VmData: 374 MB, maxrss: 0.325508 MB Stage coadds finished: 2020-07-20T17:07:46.806120 Resources for stage coadds : 20.997 s worker CPU, 23.645 s worker Wall, Wall: 3.061 s, Cores in use: 7.25, Total efficiency (on 32 cores): 22.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-20T17:07:47.050638 Cut to 1 unWISE tiles Reading WISE tile 3437p333 band 1 Reading WISE tile 3437p333 band 2 Reading WISE tile 3437p333 band 3 Reading WISE tile 3437p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.21 s, CPU: 0.57 s, VmPeak: 1064 MB, VmSize: 1000 MB, VmRSS: 149 MB, VmData: 192 MB, maxrss: 0.21076 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.38 s, CPU: 1.18 s, VmPeak: 1062 MB, VmSize: 998 MB, VmRSS: 147 MB, VmData: 189 MB, maxrss: 0.188244 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.41 s, VmPeak: 1082 MB, VmSize: 1082 MB, VmRSS: 239 MB, VmData: 270 MB, maxrss: 0.34658 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.39 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 152 MB, VmData: 194 MB, maxrss: 0.21328 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.59 s, CPU: 0.78 s, VmPeak: 1180 MB, VmSize: 1057 MB, VmRSS: 280 MB, VmData: 335 MB, maxrss: 0.325508 MB Stage wise_forced finished: 2020-07-20T17:07:49.637530 Resources for stage wise_forced : 5.475 s worker CPU, 5.181 s worker Wall, Wall: 2.590 s, Cores in use: 2.42, Total efficiency (on 32 cores): 7.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-20T17:07:49.827881 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor-i/cus/tractor-custom-343717p32793.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/tractor-custom-343717p32793.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/brick-custom-343717p32793.sha256sum Stage writecat : Wall: 1.16 s, CPU: 0.95 s, VmPeak: 1202 MB, VmSize: 1074 MB, VmRSS: 294 MB, VmData: 348 MB, maxrss: 0.432424 MB Stage writecat finished: 2020-07-20T17:07:50.984520 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.160 s, Cores in use: 0.82, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p All done: 133.041 s worker CPU, 190.139 s worker Wall, Wall: 81.435 s, Cores in use: 1.81, Total efficiency (on 32 cores): 5.6 % Finished galaxy PGC069996 in 1.395 minutes. Started working on galaxy PGC069996 at Tue Jul 21 12:17:06 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-21T12:17:06.920616 legacypipe git version: DR9.5.5-18-gbfaa200b Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '343.71766499999995', '32.7937009', '--width', '533', '--height', '533', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 343.71766499999995 32.7937009 --width 533 --height 533 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 343.71766499999995 32.7937009 Starting process 44688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 44689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058916 MB Starting process 44690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058948 MB Starting process 44691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059168 MB Starting process 44692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059172 MB Starting process 44693 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059172 MB Starting process 44694 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 44695 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 44696 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 44697 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058928 MB Starting process 44698 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058932 MB Starting process 44699 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 44700 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 44701 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 44702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 44703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 44704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 44705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 44706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 44707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 44708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 44709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Starting process 44710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB Starting process 44711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB Starting process 44712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB Starting process 44713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB Starting process 44714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB Starting process 44715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05892 MB Starting process 44716 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058924 MB Starting process 44717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.058928 MB Starting process 44718 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.058928 MB Starting process 44719 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.058928 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-21T12:17:07.207769 Keeping 13 CCDs: c4d_181017_013846_ooi_z_ls9.fits.fz c4d_181017_013846_ooi_z_ls9-S30 z exptime 221.0 propid 2014B-0404 seeing 1.69 MJD 58408.069 object DECaLS_40043_z c4d_180919_022543_ooi_z_ls9.fits.fz c4d_180919_022543_ooi_z_ls9-S30 z exptime 250.0 propid 2014B-0404 seeing 1.57 MJD 58380.101 object DECaLS_40043_z c4d_181110_011957_ooi_g_ls9.fits.fz c4d_181110_011957_ooi_g_ls9-S30 g exptime 149.0 propid 2014B-0404 seeing 2.11 MJD 58432.056 object DECaLS_40043_g c4d_181105_005716_ooi_r_ls9.fits.fz c4d_181105_005716_ooi_r_ls9-S30 r exptime 74.0 propid 2014B-0404 seeing 1.32 MJD 58427.040 object DECaLS_40043_r c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N15 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N15 z exptime 115.0 propid 2014B-0404 seeing 1.04 MJD 58378.137 object DECaLS_8283_z c4d_181003_020336_ooi_g_ls9.fits.fz c4d_181003_020336_ooi_g_ls9-N21 g exptime 200.0 propid 2014B-0404 seeing 1.60 MJD 58394.086 object DECaLS_8283_g c4d_180917_031748_ooi_z_ls9.fits.fz c4d_180917_031748_ooi_z_ls9-N21 z exptime 115.0 propid 2014B-0404 seeing 1.01 MJD 58378.137 object DECaLS_8283_z c4d_181111_002723_ooi_z_ls9.fits.fz c4d_181111_002723_ooi_z_ls9-S31 z exptime 120.0 propid 2014B-0404 seeing 1.55 MJD 58433.019 object DECaLS_24171_z c4d_181002_015438_ooi_g_ls9.fits.fz c4d_181002_015438_ooi_g_ls9-S31 g exptime 200.0 propid 2014B-0404 seeing 1.66 MJD 58393.080 object DECaLS_24171_g c4d_171025_011731_ooi_z_ls9.fits.fz c4d_171025_011731_ooi_z_ls9-N20 z exptime 195.0 propid 2014B-0404 seeing 1.44 MJD 58051.054 object DECaLS_24155_z c4d_181104_011503_ooi_r_ls9.fits.fz c4d_181104_011503_ooi_r_ls9-S31 r exptime 133.0 propid 2014B-0404 seeing 1.64 MJD 58426.052 object DECaLS_24171_r c4d_181002_022242_ooi_r_ls9.fits.fz c4d_181002_022242_ooi_r_ls9-N20 r exptime 88.0 propid 2014B-0404 seeing 1.38 MJD 58393.099 object DECaLS_24155_r The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 6.22 s, CPU: 0.72 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 200 MB, VmData: 234 MB, maxrss: 0.20506 MB Stage tims finished: 2020-07-21T12:17:13.431063 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181003T020336_oi[N21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952089e-z-20171025T011731_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181105T005716_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180919T022543_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538ac0-g-20181110T011957_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95361c2-r-20181002T022242_oi[N20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9536981-g-20181002T015438_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.566 s worker CPU, 65.025 s worker Wall, Wall: 6.226 s, Cores in use: 1.33, Total efficiency (on 32 cores): 4.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T031748_oi[N15,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9531bff-z-20181017T013846_oi[S30,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9533129-z-20181111T002723_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T011503_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-21T12:17:13.539870 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03002.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02874.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02746.fits Matched 6 large galaxies to Gaia stars. Matched 1 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/reference-custom-343717p32793.fits Stage refs : Wall: 4.62 s, CPU: 3.96 s, VmPeak: 1056 MB, VmSize: 1051 MB, VmRSS: 255 MB, VmData: 286 MB, maxrss: 0.260836 MB Stage refs finished: 2020-07-21T12:17:18.159506 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 4.622 s, Cores in use: 0.86, Total efficiency (on 32 cores): 2.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-21T12:17:18.212958 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-pre-custom-343717p32793.jpg Image c4d_181003_020336_ooi_g_ls9-N21 g : masking 13059 positive outlier pixels and 0 negative outlier pixels Image c4d_181002_015438_ooi_g_ls9-S31 g : masking 748 positive outlier pixels and 0 negative outlier pixels Image c4d_181110_011957_ooi_g_ls9-S30 g : masking 1223 positive outlier pixels and 214 negative outlier pixels Image c4d_181002_022242_ooi_r_ls9-N20 r : masking 1177 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_005716_ooi_r_ls9-S30 r : masking 453 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_011503_ooi_r_ls9-S31 r : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_180917_031748_ooi_z_ls9-N21 z : masking 285 positive outlier pixels and 0 negative outlier pixels Image c4d_180919_022543_ooi_z_ls9-S30 z : masking 1264 positive outlier pixels and 176 negative outlier pixels Image c4d_181017_013846_ooi_z_ls9-S30 z : masking 1189 positive outlier pixels and 0 negative outlier pixels Image c4d_171025_011731_ooi_z_ls9-N20 z : masking 289 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outlier-mask-custom-343717p32793.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-post-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-pos-custom-343717p32793.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/outliers-masked-neg-custom-343717p32793.jpg Stage outliers : Wall: 2.32 s, CPU: 1.32 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 304 MB, VmData: 333 MB, maxrss: 0.315424 MB Stage outliers finished: 2020-07-21T12:17:20.532958 Resources for stage outliers : 4.334 s worker CPU, 4.900 s worker Wall, Wall: 2.324 s, Cores in use: 2.44, Total efficiency (on 32 cores): 7.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-21T12:17:20.585787 Stage halos : Wall: 0.66 s, CPU: 0.17 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 282 MB, VmData: 334 MB, maxrss: 0.315424 MB Stage halos finished: 2020-07-21T12:17:21.241053 Resources for stage halos : 4.514 s worker CPU, 4.842 s worker Wall, Wall: 0.659 s, Cores in use: 7.11, Total efficiency (on 32 cores): 22.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-21T12:17:21.689596 PSF sigmas in coadd pixels: ['3.42', '2.61', '2.59', '2.70'] Using average PSF sigma 2.8300878852731586 Gaussian PSF norm 0.09967704297870258 vs pixelized 0.09604344 average tim pixel scale / coadd scale: 1.0014639224035964 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.14', '2.67', '2.25'] Using average PSF sigma 2.351146556471552 Gaussian PSF norm 0.11998179824112186 vs pixelized 0.10424567 average tim pixel scale / coadd scale: 1.0014268483447608 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.75', '2.55', '1.69', '1.63', '2.52', '2.34'] Using average PSF sigma 2.248088969960469 Gaussian PSF norm 0.1254820407658682 vs pixelized 0.10650161 average tim pixel scale / coadd scale: 1.0014075031841727 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.55 s, CPU: 0.56 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 306 MB, VmData: 334 MB, maxrss: 0.316136 MB Stage fit_on_coadds finished: 2020-07-21T12:17:23.235902 Resources for stage fit_on_coadds : 1.175 s worker CPU, 1.175 s worker Wall, Wall: 1.549 s, Cores in use: 1.12, Total efficiency (on 32 cores): 3.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-21T12:17:23.342819 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 1545 potential peaks Of 1545 potential peaks: 1453 in veto map, 26 cut by saddle test, 0 cut by aper test, 66 kept SED z : 66 new peaks Found 475 potential peaks Of 475 potential peaks: 429 in veto map, 24 cut by saddle test, 0 cut by aper test, 22 kept SED r : 22 new peaks Found 138 potential peaks Of 138 potential peaks: 109 in veto map, 26 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 228 potential peaks Of 228 potential peaks: 193 in veto map, 32 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 254 potential peaks Of 254 potential peaks: 222 in veto map, 31 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 95 new sources Median coadd sky for g : 9.1153284e-05 Median coadd sky for r : 9.681531e-05 Median coadd sky for z : 0.00069602474 Stage srcs : Wall: 2.67 s, CPU: 2.56 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 273 MB, VmData: 334 MB, maxrss: 0.316136 MB Stage srcs finished: 2020-07-21T12:17:26.015845 Resources for stage srcs : 0.333 s worker CPU, 0.333 s worker Wall, Wall: 2.676 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-21T12:17:28.669227 Blob 1 of 27, id: 1, sources: 59, size: 533x502, npix 117109, brick X: 0,533, Y: 31,533, one pixel: 185 31 Blob 2 of 27, id: 0, sources: 21, size: 533x160, npix 33364, brick X: 0,533, Y: 0,160, one pixel: 0 0 Blob 3 of 27, id: 15, sources: 5, size: 63x90, npix 3260, brick X: 74,137, Y: 443,533, one pixel: 105 443 Blob 4 of 27, id: 5, sources: 3, size: 25x66, npix 1289, brick X: 0,25, Y: 100,166, one pixel: 6 100 Blob 5 of 27, id: 18, sources: 1, size: 38x42, npix 1127, brick X: 264,302, Y: 450,492, one pixel: 281 450 Blob 6 of 27, id: 13, sources: 1, size: 44x34, npix 1073, brick X: 83,127, Y: 394,428, one pixel: 93 394 Blob 7 of 27, id: 19, sources: 2, size: 43x40, npix 962, brick X: 305,348, Y: 474,514, one pixel: 318 474 Blob 8 of 27, id: 3, sources: 2, size: 43x35, npix 954, brick X: 95,138, Y: 86,121, one pixel: 126 86 Blob 9 of 27, id: 24, sources: 2, size: 29x42, npix 841, brick X: 276,305, Y: 491,533, one pixel: 287 491 Blob 10 of 27, id: 17, sources: 2, size: 36x34, npix 823, brick X: 497,533, Y: 443,477, one pixel: 511 443 Blob 11 of 27, id: 20, sources: 2, size: 34x43, npix 793, brick X: 376,410, Y: 476,519, one pixel: 385 476 Blob 12 of 27, id: 9, sources: 1, size: 32x36, npix 782, brick X: 13,45, Y: 166,202, one pixel: 27 166 Blob 13 of 27, id: 16, sources: 1, size: 36x31, npix 744, brick X: 375,411, Y: 443,474, one pixel: 386 443 Blob 14 of 27, id: 8, sources: 1, size: 32x34, npix 711, brick X: 500,532, Y: 149,183, one pixel: 515 149 Blob 15 of 27, id: 10, sources: 1, size: 30x32, npix 667, brick X: 420,450, Y: 185,217, one pixel: 431 185 Blob 16 of 27, id: 26, sources: 2, size: 45x20, npix 647, brick X: 187,232, Y: 513,533, one pixel: 218 513 Blob 17 of 27, id: 11, sources: 1, size: 30x31, npix 619, brick X: 387,417, Y: 187,218, one pixel: 401 187 Blob 18 of 27, id: 2, sources: 1, size: 35x27, npix 588, brick X: 336,371, Y: 51,78, one pixel: 346 51 Blob 19 of 27, id: 12, sources: 1, size: 29x34, npix 579, brick X: 490,519, Y: 370,404, one pixel: 504 370 Blob 20 of 27, id: 4, sources: 1, size: 26x28, npix 443, brick X: 42,68, Y: 96,124, one pixel: 56 96 Blob 21 of 27, id: 21, sources: 1, size: 25x25, npix 412, brick X: 151,176, Y: 480,505, one pixel: 162 480 Blob 22 of 27, id: 25, sources: 1, size: 25x24, npix 387, brick X: 131,156, Y: 495,519, one pixel: 142 495 Blob 23 of 27, id: 23, sources: 1, size: 23x24, npix 349, brick X: 177,200, Y: 486,510, one pixel: 186 486 Blob 24 of 27, id: 7, sources: 1, size: 23x22, npix 312, brick X: 384,407, Y: 136,158, one pixel: 392 136 Blob 25 of 27, id: 14, sources: 1, size: 23x21, npix 302, brick X: 175,198, Y: 427,448, one pixel: 184 427 Blob 26 of 27, id: 6, sources: 1, size: 21x22, npix 291, brick X: 132,153, Y: 105,127, one pixel: 141 105 Blob 27 of 27, id: 22, sources: 1, size: 20x20, npix 228, brick X: 209,229, Y: 485,505, one pixel: 218 485 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74177, 32.78421), pm (-9.6, -6.3), parallax 1.220 with NanoMaggies: g=16.2, r=15, z=14.5 Reset brightness to NanoMaggies: g=15.4, r=14.6, z=14.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74980, 32.78490), pm (-8.0, -3.6), parallax 0.541 with NanoMaggies: g=16.6, r=16.1, z=16 Reset brightness to NanoMaggies: g=16.6, r=16.1, z=16 Blob 4 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 126 MB, VmData: 173 MB, maxrss: 0.128636 MB Blob 21 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 955 MB, VmSize: 723 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.15062 MB Blob 23 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 951 MB, VmSize: 723 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151288 MB Blob 27 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 666 MB, VmSize: 665 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099284 MB Blob 24 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 958 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144088 MB Blob 25 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 675 MB, VmSize: 669 MB, VmRSS: 101 MB, VmData: 146 MB, maxrss: 0.10296 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 15 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 951 MB, VmSize: 724 MB, VmRSS: 146 MB, VmData: 185 MB, maxrss: 0.149064 MB Blob 18 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 133 MB, VmData: 176 MB, maxrss: 0.136048 MB Blob 22 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 672 MB, VmSize: 669 MB, VmRSS: 102 MB, VmData: 147 MB, maxrss: 0.103968 MB Blob 26 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 669 MB, VmSize: 667 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102376 MB Blob 14 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 673 MB, VmSize: 660 MB, VmRSS: 93 MB, VmData: 138 MB, maxrss: 0.103356 MB Blob 12 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 672 MB, VmSize: 666 MB, VmRSS: 99 MB, VmData: 144 MB, maxrss: 0.10094 MB Blob 20 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 102 MB, VmData: 148 MB, maxrss: 0.104916 MB Blob 11 finished, total: Wall: 1.14 s, CPU: 1.14 s, VmPeak: 700 MB, VmSize: 700 MB, VmRSS: 129 MB, VmData: 177 MB, maxrss: 0.132444 MB Blob 6 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 953 MB, VmSize: 721 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15002 MB Blob 9 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 689 MB, VmSize: 675 MB, VmRSS: 110 MB, VmData: 152 MB, maxrss: 0.120192 MB Blob 7 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 948 MB, VmSize: 721 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.14746 MB Blob 16 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 100 MB, VmData: 145 MB, maxrss: 0.102032 MB Blob 19 finished, total: Wall: 1.40 s, CPU: 1.40 s, VmPeak: 949 MB, VmSize: 724 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150568 MB Blob 13 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 692 MB, VmSize: 692 MB, VmRSS: 118 MB, VmData: 170 MB, maxrss: 0.120336 MB Measuring 1 iterative sources Blob 17 finished, total: Wall: 1.92 s, CPU: 1.92 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 186 MB, maxrss: 0.151556 MB Blob 10 finished, total: Wall: 1.94 s, CPU: 1.94 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144128 MB Blob 5 finished, total: Wall: 1.98 s, CPU: 1.98 s, VmPeak: 956 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151976 MB Blob 8 finished, total: Wall: 2.03 s, CPU: 2.03 s, VmPeak: 688 MB, VmSize: 688 MB, VmRSS: 115 MB, VmData: 165 MB, maxrss: 0.11774 MB Measuring 3 iterative sources Blob 3 finished, total: Wall: 5.71 s, CPU: 5.71 s, VmPeak: 950 MB, VmSize: 724 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151608 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.79220, 32.77436), pm (-7.2, -5.2), parallax 0.860 with NanoMaggies: g=10.1, r=8.71, z=7.79 Reset brightness to NanoMaggies: g=10.1, r=8.71, z=7.79 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.77923, 32.73476), pm (-11.1, -5.1), parallax 2.024 with NanoMaggies: g=10.3, r=9.3, z=8.83 Reset brightness to NanoMaggies: g=10.3, r=9.3, z=8.83 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.69373, 32.77859), pm (-5.8, -4.9), parallax 0.365 with NanoMaggies: g=16.8, r=16, z=15.6 Reset brightness to NanoMaggies: g=16.5, r=16.1, z=15.9 Measuring 2 iterative sources Blob 2 finished, total: Wall: 14.45 s, CPU: 14.44 s, VmPeak: 949 MB, VmSize: 724 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.152692 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.83895, ee1=0.10649, ee2=-0.327029 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74377, 32.79835), pm (-6.9, -3.3), parallax 0.515 with NanoMaggies: g=17.6, r=17, z=16.7 Reset brightness to NanoMaggies: g=17.6, r=17, z=16.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (343.74345, 32.80108), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -4.04e+05), r=(flux -5.33e+05), z=(flux -1.25e+06) Reset brightness to NanoMaggies: g=20.9, r=19.7, z=18.9 Measuring 7 iterative sources Blob 1 finished, total: Wall: 85.10 s, CPU: 85.10 s, VmPeak: 943 MB, VmSize: 852 MB, VmRSS: 310 MB, VmData: 330 MB, maxrss: 0.399112 MB Old catalog: 124 New catalog: 114 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/blobs-custom-343717p32793.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/metrics/cus/all-models-custom-343717p32793.fits Stage fitblobs : Wall: 91.65 s, CPU: 0.55 s, VmPeak: 1190 MB, VmSize: 1062 MB, VmRSS: 281 MB, VmData: 342 MB, maxrss: 0.316136 MB Stage fitblobs finished: 2020-07-21T12:19:00.324015 Resources for stage fitblobs : 131.933 s worker CPU, 131.993 s worker Wall, Wall: 91.658 s, Cores in use: 1.45, Total efficiency (on 32 cores): 4.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-21T12:19:00.419217 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-resid.jpg Stage coadds : Wall: 2.87 s, CPU: 0.96 s, VmPeak: 1190 MB, VmSize: 1094 MB, VmRSS: 319 MB, VmData: 375 MB, maxrss: 0.32666 MB Stage coadds finished: 2020-07-21T12:19:03.285005 Resources for stage coadds : 29.427 s worker CPU, 30.155 s worker Wall, Wall: 2.870 s, Cores in use: 10.59, Total efficiency (on 32 cores): 33.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-21T12:19:03.314391 Cut to 1 unWISE tiles Reading WISE tile 3437p333 band 1 Reading WISE tile 3437p333 band 2 Reading WISE tile 3437p333 band 3 Reading WISE tile 3437p333 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.24 s, CPU: 0.65 s, VmPeak: 1007 MB, VmSize: 1007 MB, VmRSS: 151 MB, VmData: 192 MB, maxrss: 0.207752 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.42 s, CPU: 1.31 s, VmPeak: 1004 MB, VmSize: 1004 MB, VmRSS: 151 MB, VmData: 189 MB, maxrss: 0.193088 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.41 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 152 MB, VmData: 192 MB, maxrss: 0.207356 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/343/3437p333/unwise-3437p333-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.39 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 150 MB, VmData: 190 MB, maxrss: 0.210528 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/tmp-legacysurvey-custom-343717p32793-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.26 s, CPU: 0.63 s, VmPeak: 1190 MB, VmSize: 1055 MB, VmRSS: 280 MB, VmData: 335 MB, maxrss: 0.32666 MB Stage wise_forced finished: 2020-07-21T12:19:05.573276 Resources for stage wise_forced : 5.933 s worker CPU, 5.292 s worker Wall, Wall: 2.262 s, Cores in use: 2.90, Total efficiency (on 32 cores): 9.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-21T12:19:05.604657 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/coadd/cus/custom-343717p32793/legacysurvey-custom-343717p32793-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor-i/cus/tractor-custom-343717p32793.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/tractor-custom-343717p32793.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/tractor/cus/brick-custom-343717p32793.sha256sum Stage writecat : Wall: 0.89 s, CPU: 0.75 s, VmPeak: 1202 MB, VmSize: 1074 MB, VmRSS: 296 MB, VmData: 350 MB, maxrss: 0.434684 MB Stage writecat finished: 2020-07-21T12:19:06.499426 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.898 s, Cores in use: 0.83, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/343/PGC069996/PGC069996-largegalaxy-writecat.p All done: 185.223 s worker CPU, 243.725 s worker Wall, Wall: 119.327 s, Cores in use: 1.66, Total efficiency (on 32 cores): 5.2 % Finished galaxy PGC069996 in 2.021 minutes.