Started working on galaxy PGC1068366_GROUP at Sat Jun 6 20:21:16 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.3975878324414 -3.6673268288901526 --width 271 --height 271 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-06T20:21:18.232979 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.3975878324414', '-3.6673268288901526', '--width', '271', '--height', '271', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.3975878324414 -3.6673268288901526 --width 271 --height 271 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.3975878324414 -3.6673268288901526 Starting process 19776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 19777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 19778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057464 MB Starting process 19779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-06T20:21:25.063532 Keeping 16 CCDs: c4d_170316_021755_ooi_z_ls9.fits.fz c4d_170316_021755_ooi_z_ls9-S28 z exptime 95.0 propid 2014B-0404 seeing 0.99 MJD 57828.094 object DECaLS_7107_z c4d_170302_042930_ooi_r_ls9.fits.fz c4d_170302_042930_ooi_r_ls9-S28 r exptime 40.0 propid 2014B-0404 seeing 0.83 MJD 57814.186 object DECaLS_7107_r c4d_170305_040338_ooi_g_ls9.fits.fz c4d_170305_040338_ooi_g_ls9-S28 g exptime 127.0 propid 2014B-0404 seeing 1.08 MJD 57817.167 object DECaLS_7107_g c4d_160302_025532_ooi_g_ls9.fits.fz c4d_160302_025532_ooi_g_ls9-N25 g exptime 64.0 propid 2014B-0404 seeing 1.32 MJD 57449.121 object DECaLS_7106_g c4d_190204_064118_ooi_g_ls9.fits.fz c4d_190204_064118_ooi_g_ls9-N25 g exptime 150.0 propid 2014B-0404 seeing 1.64 MJD 58518.279 object DECaLS_7106_g c4d_170301_044515_ooi_r_ls9.fits.fz c4d_170301_044515_ooi_r_ls9-N25 r exptime 53.0 propid 2014B-0404 seeing 1.23 MJD 57813.197 object DECaLS_7106_r c4d_150330_000929_ooi_z_ls9.fits.fz c4d_150330_000929_ooi_z_ls9-N25 z exptime 120.0 propid 2014B-0404 seeing 1.01 MJD 57111.005 object DECaLS_7106_z c4d_170330_043034_ooi_r_ls9.fits.fz c4d_170330_043034_ooi_r_ls9-S27 r exptime 54.0 propid 2014B-0404 seeing 1.43 MJD 57842.187 object DECaLS_22979_r c4d_170327_024437_ooi_g_ls9.fits.fz c4d_170327_024437_ooi_g_ls9-S27 g exptime 85.0 propid 2014B-0404 seeing 1.21 MJD 57839.113 object DECaLS_22979_g c4d_170110_050839_ooi_z_ls9.fits.fz c4d_170110_050839_ooi_z_ls9-S27 z exptime 113.0 propid 2014B-0404 seeing 0.91 MJD 57763.212 object DECaLS_22979_z c4d_180518_011637_ooi_g_ls9.fits.fz c4d_180518_011637_ooi_g_ls9-S29 g exptime 113.0 propid 2014B-0404 seeing 1.24 MJD 58256.053 object DECaLS_38851_g c4d_181215_064851_ooi_r_ls9.fits.fz c4d_181215_064851_ooi_r_ls9-S29 r exptime 50.0 propid 2014B-0404 seeing 1.19 MJD 58467.284 object DECaLS_38851_r c4d_170316_044209_ooi_z_ls9.fits.fz c4d_170316_044209_ooi_z_ls9-S29 z exptime 135.0 propid 2014B-0404 seeing 1.16 MJD 57828.194 object DECaLS_38851_z c4d_181215_064728_ooi_r_ls9.fits.fz c4d_181215_064728_ooi_r_ls9-N24 r exptime 54.0 propid 2014B-0404 seeing 1.10 MJD 58467.283 object DECaLS_38867_r c4d_170316_022050_ooi_z_ls9.fits.fz c4d_170316_022050_ooi_z_ls9-N24 z exptime 146.0 propid 2014B-0404 seeing 1.12 MJD 57828.096 object DECaLS_38867_z c4d_180518_022704_ooi_g_ls9.fits.fz c4d_180518_022704_ooi_g_ls9-N24 g exptime 159.0 propid 2014B-0404 seeing 1.32 MJD 58256.102 object DECaLS_38867_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021529_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T042800_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160302T025336_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190204T064118_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T044331_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T000639_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f8db-g-20170305T040043_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T042849_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510fe0-g-20170327T024221_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9540ae5-z-20170110T050553_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180518T011637_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064851_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T043902_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064728_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021732_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T022704_oi[N24,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 113.70 s, CPU: 7.39 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 181 MB, VmData: 214 MB, maxrss: 0.454604 MB Stage tims finished: 2020-06-06T20:23:18.766000 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T042800_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T044331_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510fe0-g-20170327T024221_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T043902_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160302T025336_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T000639_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9540ae5-z-20170110T050553_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064728_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f8db-g-20170305T040043_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180518T011637_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021732_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021529_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190204T064118_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T042849_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064851_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T022704_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 5.453 s worker CPU, 386.352 s worker Wall, Wall: 113.704 s, Cores in use: 0.11, Total efficiency (on 4 cores): 2.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-06T20:23:18.800441 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06651.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06524.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06523.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06395.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/reference-custom-167397m03667.fits Stage refs : Wall: 7.41 s, CPU: 6.92 s, VmPeak: 1027 MB, VmSize: 1010 MB, VmRSS: 195 MB, VmData: 228 MB, maxrss: 0.454604 MB Stage refs finished: 2020-06-06T20:23:26.205955 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.406 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-06T20:23:26.207411 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outlier-mask-custom-167397m03667.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-pre-custom-167397m03667.jpg Image c4d_170305_040338_ooi_g_ls9-S28 g : masking 0 positive outlier pixels and 94 negative outlier pixels Image c4d_180518_011637_ooi_g_ls9-S29 g : masking 147 positive outlier pixels and 0 negative outlier pixels Image c4d_170327_024437_ooi_g_ls9-S27 g : masking 472 positive outlier pixels and 0 negative outlier pixels Image c4d_181215_064851_ooi_r_ls9-S29 r : masking 82 positive outlier pixels and 0 negative outlier pixels Image c4d_181215_064728_ooi_r_ls9-N24 r : masking 0 positive outlier pixels and 91 negative outlier pixels Image c4d_170316_021755_ooi_z_ls9-S28 z : masking 0 positive outlier pixels and 216 negative outlier pixels Image c4d_150330_000929_ooi_z_ls9-N25 z : masking 3220 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outlier-mask-custom-167397m03667.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-post-custom-167397m03667.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-masked-pos-custom-167397m03667.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-masked-neg-custom-167397m03667.jpg Stage outliers : Wall: 5.58 s, CPU: 5.21 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage outliers finished: 2020-06-06T20:23:31.785680 Resources for stage outliers : 1.554 s worker CPU, 1.564 s worker Wall, Wall: 5.579 s, Cores in use: 1.21, Total efficiency (on 4 cores): 30.3 % Stage outliers finished Running stage halos Running stage halos at 2020-06-06T20:23:31.787412 Stage halos : Wall: 13.56 s, CPU: 5.62 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage halos finished: 2020-06-06T20:23:45.342709 Resources for stage halos : 0.192 s worker CPU, 26.061 s worker Wall, Wall: 13.556 s, Cores in use: 0.43, Total efficiency (on 4 cores): 10.7 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-06T20:23:45.344523 PSF sigmas in coadd pixels: ['1.75', '2.14', '2.67', '1.96', '2.01', '2.15'] Using average PSF sigma 2.1142804966178157 Gaussian PSF norm 0.13342354159022002 vs pixelized 0.11419962 average tim pixel scale / coadd scale: 1.0010789520416465 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.35', '2.00', '2.33', '1.93', '1.79'] Using average PSF sigma 1.8807972558998034 Gaussian PSF norm 0.14998681590425839 vs pixelized 0.128373 average tim pixel scale / coadd scale: 1.001213894950809 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.60', '1.64', '1.47', '1.89', '1.81'] Using average PSF sigma 1.6823301184644204 Gaussian PSF norm 0.16768099713471557 vs pixelized 0.14845239 average tim pixel scale / coadd scale: 1.0011243973396546 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.32 s, CPU: 0.27 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 213 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage fit_on_coadds finished: 2020-06-06T20:23:45.663798 Resources for stage fit_on_coadds : 0.328 s worker CPU, 0.351 s worker Wall, Wall: 0.320 s, Cores in use: 1.88, Total efficiency (on 4 cores): 47.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-06T20:23:45.666826 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 70 potential peaks Of 70 potential peaks: 38 in veto map, 7 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 87 potential peaks Of 87 potential peaks: 74 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 79 potential peaks Of 79 potential peaks: 63 in veto map, 12 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 96 potential peaks Of 96 potential peaks: 81 in veto map, 12 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 110 potential peaks Of 110 potential peaks: 95 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 37 new sources Median coadd sky for g : 7.746036e-05 Median coadd sky for r : 0.00021613661 Median coadd sky for z : 0.000454909 Stage srcs : Wall: 6.61 s, CPU: 6.56 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage srcs finished: 2020-06-06T20:23:52.281720 Resources for stage srcs : 0.117 s worker CPU, 0.117 s worker Wall, Wall: 6.616 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-06T20:23:52.294804 Blob 1 of 11, id: 3, sources: 27, size: 257x222, npix 32142, brick X: 10,267, Y: 35,257, one pixel: 113 35 Blob 2 of 11, id: 1, sources: 2, size: 49x68, npix 1587, brick X: 218,267, Y: 13,81, one pixel: 235 13 Blob 3 of 11, id: 6, sources: 1, size: 37x35, npix 673, brick X: 175,212, Y: 188,223, one pixel: 183 188 Blob 4 of 11, id: 2, sources: 1, size: 29x29, npix 576, brick X: 26,55, Y: 28,57, one pixel: 41 28 Blob 5 of 11, id: 5, sources: 2, size: 22x34, npix 485, brick X: 249,271, Y: 97,131, one pixel: 259 97 Blob 4 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148668 MB Blob 6 of 11, id: 4, sources: 1, size: 26x27, npix 456, brick X: 6,32, Y: 61,88, one pixel: 17 61 Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146716 MB Blob 7 of 11, id: 0, sources: 1, size: 24x23, npix 338, brick X: 96,120, Y: 3,26, one pixel: 107 3 Measuring 2 iterative sources Blob 5 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148668 MB Blob 8 of 11, id: 7, sources: 1, size: 22x22, npix 292, brick X: 200,222, Y: 222,244, one pixel: 209 222 Blob 6 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146716 MB Blob 9 of 11, id: 9, sources: 1, size: 16x19, npix 187, brick X: 0,16, Y: 251,270, one pixel: 5 251 Blob 2 finished, total: Wall: 2.71 s, CPU: 2.70 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148736 MB Blob 10 of 11, id: 8, sources: 1, size: 18x18, npix 180, brick X: 223,241, Y: 232,250, one pixel: 231 232 Blob 8 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146716 MB Blob 7 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148668 MB Blob 11 of 11, id: 10, sources: 1, size: 18x18, npix 180, brick X: 236,254, Y: 252,270, one pixel: 244 252 Blob 10 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146716 MB Blob 9 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148736 MB Blob 11 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 962 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148668 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.10971, ee1=-0.0876457, ee2=0.31881 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.359918, ee1=0.230074, ee2=0.111991 Measuring 23 iterative sources Blob 1 finished, total: Wall: 76.35 s, CPU: 76.35 s, VmPeak: 967 MB, VmSize: 720 MB, VmRSS: 151 MB, VmData: 183 MB, maxrss: 0.175392 MB Old catalog: 40 New catalog: 59 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/blobs-custom-167397m03667.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/all-models-custom-167397m03667.fits Stage fitblobs : Wall: 81.63 s, CPU: 5.22 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage fitblobs finished: 2020-06-06T20:25:13.920389 Resources for stage fitblobs : 85.578 s worker CPU, 85.784 s worker Wall, Wall: 81.627 s, Cores in use: 1.11, Total efficiency (on 4 cores): 27.8 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-06T20:25:13.922750 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-resid.jpg Stage coadds : Wall: 8.05 s, CPU: 6.99 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 214 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage coadds finished: 2020-06-06T20:25:21.973439 Resources for stage coadds : 3.435 s worker CPU, 3.526 s worker Wall, Wall: 8.052 s, Cores in use: 1.30, Total efficiency (on 4 cores): 32.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-06T20:25:21.975042 Cut to 1 unWISE tiles Reading WISE tile 1678m031 band 1 Reading WISE tile 1678m031 band 2 Reading WISE tile 1678m031 band 3 Reading WISE tile 1678m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.12 s, CPU: 0.12 s, VmPeak: 967 MB, VmSize: 804 MB, VmRSS: 158 MB, VmData: 183 MB, maxrss: 0.223 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 967 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.210912 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 962 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.20734 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 962 MB, VmSize: 798 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.191524 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 10.49 s, CPU: 6.41 s, VmPeak: 1027 MB, VmSize: 1020 MB, VmRSS: 215 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage wise_forced finished: 2020-06-06T20:25:32.462618 Resources for stage wise_forced : 3.564 s worker CPU, 12.471 s worker Wall, Wall: 10.489 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-06T20:25:32.464521 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor-i/cus/tractor-custom-167397m03667.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor/cus/tractor-custom-167397m03667.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor/cus/brick-custom-167397m03667.sha256sum Stage writecat : Wall: 4.81 s, CPU: 4.64 s, VmPeak: 1152 MB, VmSize: 1024 MB, VmRSS: 217 MB, VmData: 241 MB, maxrss: 0.454604 MB Stage writecat finished: 2020-06-06T20:25:37.273808 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.810 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.1 % Stage writecat finished All done: 100.222 s worker CPU, 516.227 s worker Wall, Wall: 252.214 s, Cores in use: 0.62, Total efficiency (on 4 cores): 15.4 % Finished galaxy PGC1068366_GROUP in 4.348 minutes. Started working on galaxy PGC1068366_GROUP at Thu Jul 23 05:13:24 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.3975878324414 -3.6673268288901526 --width 271 --height 271 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-23T05:13:25.992423 legacypipe git version: DR9.5.5-21-g66b1aacb Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.3975878324414', '-3.6673268288901526', '--width', '271', '--height', '271', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.3975878324414 -3.6673268288901526 --width 271 --height 271 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.3975878324414 -3.6673268288901526 Starting process 18067 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 18068 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 18069 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 18070 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB Starting process 18071 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059164 MB Starting process 18072 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059164 MB Starting process 18073 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18074 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18075 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18076 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 18078 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18079 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18077 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18080 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 18081 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 18082 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-23T05:13:26.545479 Keeping 16 CCDs: c4d_170316_021755_ooi_z_ls9.fits.fz c4d_170316_021755_ooi_z_ls9-S28 z exptime 95.0 propid 2014B-0404 seeing 0.99 MJD 57828.094 object DECaLS_7107_z c4d_170302_042930_ooi_r_ls9.fits.fz c4d_170302_042930_ooi_r_ls9-S28 r exptime 40.0 propid 2014B-0404 seeing 0.83 MJD 57814.186 object DECaLS_7107_r c4d_170305_040338_ooi_g_ls9.fits.fz c4d_170305_040338_ooi_g_ls9-S28 g exptime 127.0 propid 2014B-0404 seeing 1.08 MJD 57817.167 object DECaLS_7107_g c4d_160302_025532_ooi_g_ls9.fits.fz c4d_160302_025532_ooi_g_ls9-N25 g exptime 64.0 propid 2014B-0404 seeing 1.32 MJD 57449.121 object DECaLS_7106_g c4d_190204_064118_ooi_g_ls9.fits.fz c4d_190204_064118_ooi_g_ls9-N25 g exptime 150.0 propid 2014B-0404 seeing 1.64 MJD 58518.279 object DECaLS_7106_g c4d_170301_044515_ooi_r_ls9.fits.fz c4d_170301_044515_ooi_r_ls9-N25 r exptime 53.0 propid 2014B-0404 seeing 1.23 MJD 57813.197 object DECaLS_7106_r c4d_150330_000929_ooi_z_ls9.fits.fz c4d_150330_000929_ooi_z_ls9-N25 z exptime 120.0 propid 2014B-0404 seeing 1.01 MJD 57111.005 object DECaLS_7106_z c4d_170330_043034_ooi_r_ls9.fits.fz c4d_170330_043034_ooi_r_ls9-S27 r exptime 54.0 propid 2014B-0404 seeing 1.43 MJD 57842.187 object DECaLS_22979_r c4d_170327_024437_ooi_g_ls9.fits.fz c4d_170327_024437_ooi_g_ls9-S27 g exptime 85.0 propid 2014B-0404 seeing 1.21 MJD 57839.113 object DECaLS_22979_g c4d_170110_050839_ooi_z_ls9.fits.fz c4d_170110_050839_ooi_z_ls9-S27 z exptime 113.0 propid 2014B-0404 seeing 0.91 MJD 57763.212 object DECaLS_22979_z c4d_180518_011637_ooi_g_ls9.fits.fz c4d_180518_011637_ooi_g_ls9-S29 g exptime 113.0 propid 2014B-0404 seeing 1.24 MJD 58256.053 object DECaLS_38851_g c4d_181215_064851_ooi_r_ls9.fits.fz c4d_181215_064851_ooi_r_ls9-S29 r exptime 50.0 propid 2014B-0404 seeing 1.19 MJD 58467.284 object DECaLS_38851_r c4d_170316_044209_ooi_z_ls9.fits.fz c4d_170316_044209_ooi_z_ls9-S29 z exptime 135.0 propid 2014B-0404 seeing 1.16 MJD 57828.194 object DECaLS_38851_z c4d_181215_064728_ooi_r_ls9.fits.fz c4d_181215_064728_ooi_r_ls9-N24 r exptime 54.0 propid 2014B-0404 seeing 1.10 MJD 58467.283 object DECaLS_38867_r c4d_170316_022050_ooi_z_ls9.fits.fz c4d_170316_022050_ooi_z_ls9-N24 z exptime 146.0 propid 2014B-0404 seeing 1.12 MJD 57828.096 object DECaLS_38867_z c4d_180518_022704_ooi_g_ls9.fits.fz c4d_180518_022704_ooi_g_ls9-N24 g exptime 159.0 propid 2014B-0404 seeing 1.32 MJD 58256.102 object DECaLS_38867_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510fe0-g-20170327T024221_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T042800_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064851_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9540ae5-z-20170110T050553_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180518T011637_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064728_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021529_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021732_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T000639_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T043902_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T042849_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190204T064118_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160302T025336_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f8db-g-20170305T040043_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T044331_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T022704_oi[N24,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 18.17 s, CPU: 0.83 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 182 MB, VmData: 216 MB, maxrss: 0.185956 MB Stage tims finished: 2020-07-23T05:13:44.716369 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510fe0-g-20170327T024221_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T042800_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064851_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9540ae5-z-20170110T050553_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180518T011637_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064728_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021529_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T000639_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T042849_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190204T064118_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160302T025336_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T044331_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T022704_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 10.256 s worker CPU, 231.631 s worker Wall, Wall: 18.173 s, Cores in use: 0.61, Total efficiency (on 16 cores): 3.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021732_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T043902_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f8db-g-20170305T040043_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-23T05:13:44.750722 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06651.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06524.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06523.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06395.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/reference-custom-167397m03667.fits Stage refs : Wall: 2.49 s, CPU: 1.63 s, VmPeak: 1031 MB, VmSize: 1014 MB, VmRSS: 197 MB, VmData: 231 MB, maxrss: 0.202076 MB Stage refs finished: 2020-07-23T05:13:47.245622 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.496 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-23T05:13:47.674695 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outlier-mask-custom-167397m03667.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-pre-custom-167397m03667.jpg Image c4d_180518_011637_ooi_g_ls9-S29 g : masking 147 positive outlier pixels and 0 negative outlier pixels Image c4d_170305_040338_ooi_g_ls9-S28 g : masking 0 positive outlier pixels and 94 negative outlier pixels Image c4d_170327_024437_ooi_g_ls9-S27 g : masking 472 positive outlier pixels and 0 negative outlier pixels Image c4d_181215_064851_ooi_r_ls9-S29 r : masking 82 positive outlier pixels and 0 negative outlier pixels Image c4d_181215_064728_ooi_r_ls9-N24 r : masking 0 positive outlier pixels and 91 negative outlier pixels Image c4d_170316_021755_ooi_z_ls9-S28 z : masking 0 positive outlier pixels and 216 negative outlier pixels Image c4d_150330_000929_ooi_z_ls9-N25 z : masking 3220 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outlier-mask-custom-167397m03667.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-post-custom-167397m03667.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-masked-pos-custom-167397m03667.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-masked-neg-custom-167397m03667.jpg Stage outliers : Wall: 1.02 s, CPU: 0.78 s, VmPeak: 1031 MB, VmSize: 1024 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.223024 MB Stage outliers finished: 2020-07-23T05:13:48.696219 Resources for stage outliers : 1.364 s worker CPU, 1.364 s worker Wall, Wall: 1.023 s, Cores in use: 2.09, Total efficiency (on 16 cores): 13.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-23T05:13:48.731871 Stage halos : Wall: 0.34 s, CPU: 0.29 s, VmPeak: 1031 MB, VmSize: 1024 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.223464 MB Stage halos finished: 2020-07-23T05:13:49.067153 Resources for stage halos : 0.238 s worker CPU, 0.655 s worker Wall, Wall: 0.337 s, Cores in use: 1.56, Total efficiency (on 16 cores): 9.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-23T05:13:49.265331 PSF sigmas in coadd pixels: ['1.75', '2.14', '2.67', '1.96', '2.01', '2.15'] Using average PSF sigma 2.1142804966178157 Gaussian PSF norm 0.13342354159022002 vs pixelized 0.11419961 average tim pixel scale / coadd scale: 1.0010789520416465 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.35', '2.00', '2.33', '1.93', '1.79'] Using average PSF sigma 1.8807972558998034 Gaussian PSF norm 0.14998681590425839 vs pixelized 0.128373 average tim pixel scale / coadd scale: 1.001213894950809 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.60', '1.64', '1.47', '1.89', '1.81'] Using average PSF sigma 1.6823301184644204 Gaussian PSF norm 0.16768099713471557 vs pixelized 0.14845237 average tim pixel scale / coadd scale: 1.0011243973396546 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 1031 MB, VmSize: 1024 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.226296 MB Stage fit_on_coadds finished: 2020-07-23T05:13:49.516403 Resources for stage fit_on_coadds : 0.347 s worker CPU, 0.347 s worker Wall, Wall: 0.253 s, Cores in use: 2.31, Total efficiency (on 16 cores): 14.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-23T05:13:49.531036 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 70 potential peaks Of 70 potential peaks: 38 in veto map, 7 cut by saddle test, 0 cut by aper test, 25 kept SED z : 25 new peaks Found 87 potential peaks Of 87 potential peaks: 74 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED r : 4 new peaks Found 79 potential peaks Of 79 potential peaks: 63 in veto map, 12 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 96 potential peaks Of 96 potential peaks: 81 in veto map, 12 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 110 potential peaks Of 110 potential peaks: 95 in veto map, 14 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 37 new sources Median coadd sky for g : 7.746037e-05 Median coadd sky for r : 0.00021613663 Median coadd sky for z : 0.0004549092 Stage srcs : Wall: 0.59 s, CPU: 0.56 s, VmPeak: 1031 MB, VmSize: 1024 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.226732 MB Stage srcs finished: 2020-07-23T05:13:50.119601 Resources for stage srcs : 0.076 s worker CPU, 0.076 s worker Wall, Wall: 0.590 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-23T05:13:50.131945 Blob 1 of 11, id: 3, sources: 27, size: 257x222, npix 32142, brick X: 10,267, Y: 35,257, one pixel: 113 35 Blob 2 of 11, id: 1, sources: 2, size: 49x68, npix 1587, brick X: 218,267, Y: 13,81, one pixel: 235 13 Blob 3 of 11, id: 6, sources: 1, size: 37x35, npix 673, brick X: 175,212, Y: 188,223, one pixel: 183 188 Blob 4 of 11, id: 2, sources: 1, size: 29x29, npix 576, brick X: 26,55, Y: 28,57, one pixel: 41 28 Blob 5 of 11, id: 5, sources: 2, size: 22x34, npix 485, brick X: 249,271, Y: 97,131, one pixel: 259 97 Blob 6 of 11, id: 4, sources: 1, size: 26x27, npix 456, brick X: 6,32, Y: 61,88, one pixel: 17 61 Blob 7 of 11, id: 0, sources: 1, size: 24x23, npix 338, brick X: 96,120, Y: 3,26, one pixel: 107 3 Blob 8 of 11, id: 7, sources: 1, size: 22x22, npix 292, brick X: 200,222, Y: 222,244, one pixel: 209 222 Blob 9 of 11, id: 9, sources: 1, size: 16x19, npix 187, brick X: 0,16, Y: 251,270, one pixel: 5 251 Blob 10 of 11, id: 8, sources: 1, size: 18x18, npix 180, brick X: 223,241, Y: 232,250, one pixel: 231 232 Blob 11 of 11, id: 10, sources: 1, size: 18x18, npix 180, brick X: 236,254, Y: 252,270, one pixel: 244 252 Blob 10 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 951 MB, VmSize: 719 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143572 MB Blob 11 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144656 MB Blob 9 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 952 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14612 MB Blob 8 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 951 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145152 MB Blob 4 finished, total: Wall: 0.71 s, CPU: 0.71 s, VmPeak: 956 MB, VmSize: 718 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145104 MB Blob 7 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146444 MB Blob 6 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144688 MB Blob 5 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144916 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 953 MB, VmSize: 720 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14466 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 1.82 s, CPU: 1.82 s, VmPeak: 951 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147156 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.10971, ee1=-0.0876458, ee2=0.31881 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.359917, ee1=0.230074, ee2=0.111991 Measuring 23 iterative sources Blob 1 finished, total: Wall: 67.32 s, CPU: 67.31 s, VmPeak: 952 MB, VmSize: 725 MB, VmRSS: 155 MB, VmData: 187 MB, maxrss: 0.176916 MB Old catalog: 40 New catalog: 59 T_dup: tabledata object with 1 rows and 62 columns: a_g_val () shape (1,) dtype float32 astrometric_excess_noise () shape (1,) dtype float32 astrometric_excess_noise_sig () shape (1,) dtype float32 astrometric_n_good_obs_al () shape (1,) dtype int16 astrometric_n_obs_al () shape (1,) dtype int16 astrometric_params_solved () shape (1,) dtype uint8 astrometric_sigma5d_max () shape (1,) dtype float32 astrometric_weight_al () shape (1,) dtype float32 ba () shape (1,) dtype float32 dec () shape (1,) dtype float64 dec_ivar () shape (1,) dtype float32 decam_mag_g () shape (1,) dtype float32 decam_mag_r () shape (1,) dtype float32 decam_mag_z () shape (1,) dtype float32 donotfit () shape (1,) dtype bool duplicated_source () shape (1,) dtype bool e_bp_min_rp_val () shape (1,) dtype float32 freezeparams () shape (1,) dtype bool hmag () shape (1,) dtype float32 ibx () shape (1,) dtype int32 iby () shape (1,) dtype int32 in_bounds () shape (1,) dtype bool isbright () shape (1,) dtype bool iscluster () shape (1,) dtype bool isgaia () shape (1,) dtype bool isgalaxy () shape (1,) dtype uint8 islargegalaxy () shape (1,) dtype bool ismedium () shape (1,) dtype bool istycho () shape (1,) dtype bool jmag () shape (1,) dtype float32 keep_radius () shape (1,) dtype float32 kmag () shape (1,) dtype float32 mag () shape (1,) dtype float32 mask_mag () shape (1,) dtype float32 pa () shape (1,) dtype float32 parallax () shape (1,) dtype float32 parallax_ivar () shape (1,) dtype float32 phot_bp_mean_flux_over_error () shape (1,) dtype float32 phot_bp_mean_mag () shape (1,) dtype float32 phot_bp_n_obs () shape (1,) dtype int16 phot_bp_rp_excess_factor () shape (1,) dtype float32 phot_g_mean_flux_over_error () shape (1,) dtype float32 phot_g_mean_mag () shape (1,) dtype float32 phot_g_n_obs () shape (1,) dtype int16 phot_rp_mean_flux_over_error () shape (1,) dtype float32 phot_rp_mean_mag () shape (1,) dtype float32 phot_rp_n_obs () shape (1,) dtype int16 phot_variable_flag () shape (1,) dtype bool pmdec () shape (1,) dtype float32 pmdec_ivar () shape (1,) dtype float32 pmra () shape (1,) dtype float32 pmra_ivar () shape (1,) dtype float32 pointsource () shape (1,) dtype bool ra () shape (1,) dtype float64 ra_ivar () shape (1,) dtype float32 radius () shape (1,) dtype float32 radius_pix () shape (1,) dtype int64 ref_cat () shape (1,) dtype ) shape (1,) dtype float32 ref_id () shape (1,) dtype int64 source_id () shape (1,) dtype int64 zguess () shape (1,) dtype float32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/blobs-custom-167397m03667.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/all-models-custom-167397m03667.fits Stage fitblobs : Wall: 67.72 s, CPU: 0.38 s, VmPeak: 1031 MB, VmSize: 1024 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.227208 MB Stage fitblobs finished: 2020-07-23T05:14:57.847511 Resources for stage fitblobs : 74.408 s worker CPU, 74.460 s worker Wall, Wall: 67.717 s, Cores in use: 1.10, Total efficiency (on 16 cores): 6.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-23T05:14:57.862466 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-resid.jpg Stage coadds : Wall: 1.93 s, CPU: 0.70 s, VmPeak: 1031 MB, VmSize: 1024 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.2279 MB Stage coadds finished: 2020-07-23T05:14:59.795431 Resources for stage coadds : 8.161 s worker CPU, 11.191 s worker Wall, Wall: 1.934 s, Cores in use: 4.58, Total efficiency (on 16 cores): 28.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-23T05:14:59.826113 Cut to 1 unWISE tiles Reading WISE tile 1678m031 band 1 Reading WISE tile 1678m031 band 2 Reading WISE tile 1678m031 band 3 Reading WISE tile 1678m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.13 s, CPU: 0.13 s, VmPeak: 951 MB, VmSize: 799 MB, VmRSS: 148 MB, VmData: 176 MB, maxrss: 0.192296 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 952 MB, VmSize: 797 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.210208 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 952 MB, VmSize: 809 MB, VmRSS: 162 MB, VmData: 186 MB, maxrss: 0.226524 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 958 MB, VmSize: 793 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.203672 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.73 s, CPU: 0.88 s, VmPeak: 1031 MB, VmSize: 1024 MB, VmRSS: 223 MB, VmData: 250 MB, maxrss: 0.228608 MB Stage wise_forced finished: 2020-07-23T05:15:02.554557 Resources for stage wise_forced : 3.427 s worker CPU, 5.099 s worker Wall, Wall: 2.730 s, Cores in use: 1.58, Total efficiency (on 16 cores): 9.9 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-23T05:15:02.577721 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor-i/cus/tractor-custom-167397m03667.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor/cus/tractor-custom-167397m03667.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor/cus/brick-custom-167397m03667.sha256sum Stage writecat : Wall: 2.09 s, CPU: 1.21 s, VmPeak: 1157 MB, VmSize: 1029 MB, VmRSS: 225 MB, VmData: 250 MB, maxrss: 0.361484 MB Stage writecat finished: 2020-07-23T05:15:04.672780 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.097 s, Cores in use: 0.58, Total efficiency (on 16 cores): 3.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-writecat.p All done: 98.282 s worker CPU, 324.829 s worker Wall, Wall: 98.150 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 % Finished galaxy PGC1068366_GROUP in 1.677 minutes. Started working on galaxy PGC1068366_GROUP at Mon Aug 10 10:57:13 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39721080944244 -3.667018059960913 --width 287 --height 287 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T10:57:14.179242 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '167.39721080944244', '-3.667018059960913', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 167.39721080944244 -3.667018059960913 --width 287 --height 287 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 167.39721080944244 -3.667018059960913 Starting process 22486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 22487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 22488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 22489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 22490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB Starting process 22491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 22492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 22493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T10:57:14.759841 Keeping 16 CCDs: c4d_170316_021755_ooi_z_ls9-S28 z expnum 630697 exptime 95.0 propid 2014B-0404 seeing 0.99 MJD 57828.094 object DECaLS_7107_z decam/CP/V4.8.2/CP20170315/c4d_170316_021755_ooi_z_ls9.fits.fz c4d_170302_042930_ooi_r_ls9-S28 r expnum 624919 exptime 40.0 propid 2014B-0404 seeing 0.83 MJD 57814.186 object DECaLS_7107_r decam/CP/V4.8.2/CP20170301/c4d_170302_042930_ooi_r_ls9.fits.fz c4d_170305_040338_ooi_g_ls9-S28 g expnum 626035 exptime 127.0 propid 2014B-0404 seeing 1.08 MJD 57817.167 object DECaLS_7107_g decam/CP/V4.8.2/CP20170304/c4d_170305_040338_ooi_g_ls9.fits.fz c4d_160302_025532_ooi_g_ls9-N25 g expnum 522073 exptime 64.0 propid 2014B-0404 seeing 1.32 MJD 57449.121 object DECaLS_7106_g decam/CP/V4.8.2a/CP20160301/c4d_160302_025532_ooi_g_ls9.fits.fz c4d_190204_064118_ooi_g_ls9-N25 g expnum 819550 exptime 150.0 propid 2014B-0404 seeing 1.64 MJD 58518.279 object DECaLS_7106_g decam/CP/V4.8.2a/CP20190203/c4d_190204_064118_ooi_g_ls9.fits.fz c4d_170301_044515_ooi_r_ls9-N25 r expnum 624530 exptime 53.0 propid 2014B-0404 seeing 1.23 MJD 57813.197 object DECaLS_7106_r decam/CP/V4.8.2/CP20170228/c4d_170301_044515_ooi_r_ls9.fits.fz c4d_150330_000929_ooi_z_ls9-N25 z expnum 426032 exptime 120.0 propid 2014B-0404 seeing 1.01 MJD 57111.005 object DECaLS_7106_z decam/CP/V4.8.2a/CP20150329/c4d_150330_000929_ooi_z_ls9.fits.fz c4d_170330_043034_ooi_r_ls9-S27 r expnum 635228 exptime 54.0 propid 2014B-0404 seeing 1.43 MJD 57842.187 object DECaLS_22979_r decam/CP/V4.8.2/CP20170329/c4d_170330_043034_ooi_r_ls9.fits.fz c4d_170327_024437_ooi_g_ls9-S27 g expnum 634010 exptime 85.0 propid 2014B-0404 seeing 1.21 MJD 57839.113 object DECaLS_22979_g decam/CP/V4.8.2/CP20170326/c4d_170327_024437_ooi_g_ls9.fits.fz c4d_170110_050839_ooi_z_ls9-S27 z expnum 608234 exptime 113.0 propid 2014B-0404 seeing 0.91 MJD 57763.212 object DECaLS_22979_z decam/CP/V4.8.2a/CP20170109/c4d_170110_050839_ooi_z_ls9.fits.fz c4d_180518_011637_ooi_g_ls9-S29 g expnum 747308 exptime 113.0 propid 2014B-0404 seeing 1.24 MJD 58256.053 object DECaLS_38851_g decam/CP/V4.8.2a/CP20180517/c4d_180518_011637_ooi_g_ls9.fits.fz c4d_181215_064851_ooi_r_ls9-S29 r expnum 803332 exptime 50.0 propid 2014B-0404 seeing 1.19 MJD 58467.284 object DECaLS_38851_r decam/CP/V4.8.2a/CP20181214/c4d_181215_064851_ooi_r_ls9.fits.fz c4d_170316_044209_ooi_z_ls9-S29 z expnum 630743 exptime 135.0 propid 2014B-0404 seeing 1.16 MJD 57828.194 object DECaLS_38851_z decam/CP/V4.8.2/CP20170315/c4d_170316_044209_ooi_z_ls9.fits.fz c4d_181215_064728_ooi_r_ls9-N24 r expnum 803331 exptime 54.0 propid 2014B-0404 seeing 1.10 MJD 58467.283 object DECaLS_38867_r decam/CP/V4.8.2a/CP20181214/c4d_181215_064728_ooi_r_ls9.fits.fz c4d_170316_022050_ooi_z_ls9-N24 z expnum 630698 exptime 146.0 propid 2014B-0404 seeing 1.12 MJD 57828.096 object DECaLS_38867_z decam/CP/V4.8.2/CP20170315/c4d_170316_022050_ooi_z_ls9.fits.fz c4d_180518_022704_ooi_g_ls9-N24 g expnum 747332 exptime 159.0 propid 2014B-0404 seeing 1.32 MJD 58256.102 object DECaLS_38867_g decam/CP/V4.8.2a/CP20180517/c4d_180518_022704_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T042800_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190204T064118_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021529_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T042849_oi[S27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T000639_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9540ae5-z-20170110T050553_oi[S27,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510fe0-g-20170327T024221_oi[S27,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180518T011637_oi[S29,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064851_oi[S29,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T043902_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f8db-g-20170305T040043_oi[S28,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064728_oi[N24,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021732_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160302T025336_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T044331_oi[N25,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T022704_oi[N24,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 124.19 s, CPU: 0.96 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 184 MB, VmData: 217 MB, maxrss: 0.188064 MB Stage tims finished: 2020-08-10T10:59:18.949659 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950d81b-r-20170302T042800_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064851_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957d412-z-20150330T000639_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f4f7-z-20170316T043902_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950f8db-g-20170305T040043_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951519f-r-20170330T042849_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9540ae5-z-20170110T050553_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539067-r-20181215T064728_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190204T064118_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530903-g-20180518T011637_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021732_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950c76c-r-20170301T044331_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_950ea1d-z-20170316T021529_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510fe0-g-20170327T024221_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530e3b-g-20180518T022704_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.933 s worker CPU, 582.196 s worker Wall, Wall: 124.191 s, Cores in use: 0.06, Total efficiency (on 8 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956aefa-g-20160302T025336_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T10:59:18.982491 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06651.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06524.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06523.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06395.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/reference-custom-167397m03667.fits Stage refs : Wall: 9.16 s, CPU: 1.60 s, VmPeak: 1037 MB, VmSize: 1021 MB, VmRSS: 200 MB, VmData: 232 MB, maxrss: 0.204344 MB Stage refs finished: 2020-08-10T10:59:28.137608 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.156 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T10:59:28.385376 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outlier-mask-custom-167397m03667.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-pre-custom-167397m03667.jpg Image c4d_180518_011637_ooi_g_ls9-S29 g : masking 156 positive outlier pixels and 0 negative outlier pixels Image c4d_160302_025532_ooi_g_ls9-N25 g : masking 65 positive outlier pixels and 45 negative outlier pixels Image c4d_180518_022704_ooi_g_ls9-N24 g : masking 97 positive outlier pixels and 0 negative outlier pixels Image c4d_170327_024437_ooi_g_ls9-S27 g : masking 470 positive outlier pixels and 0 negative outlier pixels Image c4d_170301_044515_ooi_r_ls9-N25 r : masking 0 positive outlier pixels and 48 negative outlier pixels Image c4d_181215_064728_ooi_r_ls9-N24 r : masking 68 positive outlier pixels and 0 negative outlier pixels Image c4d_150330_000929_ooi_z_ls9-N25 z : masking 4584 positive outlier pixels and 0 negative outlier pixels Image c4d_170316_021755_ooi_z_ls9-S28 z : masking 0 positive outlier pixels and 201 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outlier-mask-custom-167397m03667.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-post-custom-167397m03667.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-masked-pos-custom-167397m03667.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/outliers-masked-neg-custom-167397m03667.jpg Stage outliers : Wall: 1.45 s, CPU: 1.17 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 220 MB, VmData: 250 MB, maxrss: 0.225512 MB Stage outliers finished: 2020-08-10T10:59:29.837363 Resources for stage outliers : 1.538 s worker CPU, 1.538 s worker Wall, Wall: 1.453 s, Cores in use: 1.86, Total efficiency (on 8 cores): 23.3 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T10:59:29.873209 Stage halos : Wall: 2.76 s, CPU: 0.85 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 220 MB, VmData: 250 MB, maxrss: 0.22568 MB Stage halos finished: 2020-08-10T10:59:32.634146 Resources for stage halos : 0.201 s worker CPU, 3.592 s worker Wall, Wall: 2.762 s, Cores in use: 0.38, Total efficiency (on 8 cores): 4.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T10:59:32.670696 PSF sigmas in coadd pixels: ['1.75', '2.14', '2.67', '1.96', '2.01', '2.15'] Using average PSF sigma 2.1142804966178157 Gaussian PSF norm 0.13342354159022002 vs pixelized 0.114189506 average tim pixel scale / coadd scale: 1.0010789520416465 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.35', '2.00', '2.33', '1.93', '1.79'] Using average PSF sigma 1.8807972558998034 Gaussian PSF norm 0.14998681590425839 vs pixelized 0.1283672 average tim pixel scale / coadd scale: 1.001213894950809 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.60', '1.64', '1.47', '1.89', '1.81'] Using average PSF sigma 1.6823301184644204 Gaussian PSF norm 0.16768099713471557 vs pixelized 0.14846008 average tim pixel scale / coadd scale: 1.0011243973396546 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.29 s, CPU: 0.26 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.228408 MB Stage fit_on_coadds finished: 2020-08-10T10:59:32.962873 Resources for stage fit_on_coadds : 0.355 s worker CPU, 0.362 s worker Wall, Wall: 0.293 s, Cores in use: 2.09, Total efficiency (on 8 cores): 26.1 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T10:59:32.974126 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 70 potential peaks Of 70 potential peaks: 40 in veto map, 6 cut by saddle test, 0 cut by aper test, 24 kept SED z : 24 new peaks Found 85 potential peaks Of 85 potential peaks: 71 in veto map, 11 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 83 potential peaks Of 83 potential peaks: 65 in veto map, 12 cut by saddle test, 0 cut by aper test, 6 kept SED g : 6 new peaks Found 97 potential peaks Of 97 potential peaks: 79 in veto map, 12 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 113 potential peaks Of 113 potential peaks: 98 in veto map, 12 cut by saddle test, 0 cut by aper test, 3 kept SED Red : 3 new peaks Adding 42 new sources Median coadd sky for g : 5.698721e-05 Median coadd sky for r : 0.00018266887 Median coadd sky for z : 0.00040946648 Stage srcs : Wall: 0.84 s, CPU: 0.79 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.228844 MB Stage srcs finished: 2020-08-10T10:59:33.809330 Resources for stage srcs : 0.123 s worker CPU, 0.123 s worker Wall, Wall: 0.836 s, Cores in use: 1.09, Total efficiency (on 8 cores): 13.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T10:59:33.822708 Blob 1 of 15, id: 4, sources: 27, size: 257x222, npix 32129, brick X: 13,270, Y: 39,261, one pixel: 115 39 Blob 2 of 15, id: 1, sources: 2, size: 49x69, npix 1574, brick X: 221,270, Y: 16,85, one pixel: 239 16 Blob 3 of 15, id: 6, sources: 3, size: 30x49, npix 730, brick X: 251,281, Y: 101,150, one pixel: 261 101 Blob 4 of 15, id: 9, sources: 1, size: 37x36, npix 686, brick X: 178,215, Y: 191,227, one pixel: 186 191 Blob 5 of 15, id: 3, sources: 1, size: 29x29, npix 569, brick X: 29,58, Y: 32,61, one pixel: 42 32 Blob 6 of 15, id: 5, sources: 1, size: 27x27, npix 448, brick X: 8,35, Y: 65,92, one pixel: 19 65 Blob 7 of 15, id: 0, sources: 1, size: 24x23, npix 338, brick X: 99,123, Y: 7,30, one pixel: 109 7 Blob 8 of 15, id: 14, sources: 1, size: 22x20, npix 301, brick X: 62,84, Y: 267,287, one pixel: 71 267 Blob 9 of 15, id: 10, sources: 1, size: 22x22, npix 291, brick X: 203,225, Y: 226,248, one pixel: 212 226 Blob 8 finished, total: Wall: 0.43 s, CPU: 0.28 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145668 MB Blob 10 of 15, id: 12, sources: 1, size: 19x20, npix 234, brick X: 0,19, Y: 254,274, one pixel: 7 254 Blob 7 finished, total: Wall: 0.75 s, CPU: 0.74 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145396 MB Blob 11 of 15, id: 8, sources: 1, size: 16x22, npix 232, brick X: 271,287, Y: 178,200, one pixel: 280 178 Blob 5 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 974 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144172 MB Blob 12 of 15, id: 7, sources: 1, size: 16x22, npix 225, brick X: 0,16, Y: 172,194, one pixel: 6 172 Blob 3 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144824 MB Blob 13 of 15, id: 2, sources: 1, size: 19x20, npix 209, brick X: 261,280, Y: 24,44, one pixel: 269 24 Blob 10 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145396 MB Blob 14 of 15, id: 11, sources: 1, size: 19x18, npix 180, brick X: 225,244, Y: 236,254, one pixel: 234 236 Blob 6 finished, total: Wall: 1.11 s, CPU: 0.88 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146504 MB Measuring 1 iterative sources Blob 15 of 15, id: 13, sources: 1, size: 18x18, npix 180, brick X: 239,257, Y: 256,274, one pixel: 247 256 Blob 9 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145668 MB Blob 14 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146636 MB Blob 4 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 955 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146248 MB Blob 12 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146536 MB Blob 13 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145396 MB Blob 15 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 973 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145668 MB Blob 11 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 974 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144172 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 2.17 s, CPU: 2.17 s, VmPeak: 972 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14736 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.71203, ee1=-0.0186019, ee2=0.615078 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.45787, ee1=0.247148, ee2=0.111829 Measuring 16 iterative sources Blob 1 finished, total: Wall: 45.42 s, CPU: 45.27 s, VmPeak: 951 MB, VmSize: 727 MB, VmRSS: 152 MB, VmData: 182 MB, maxrss: 0.17226 MB Old catalog: 45 New catalog: 54 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/blobs-custom-167397m03667.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/metrics/cus/all-models-custom-167397m03667.fits Stage fitblobs : Wall: 45.98 s, CPU: 0.54 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.229376 MB Stage fitblobs finished: 2020-08-10T11:00:19.804589 Resources for stage fitblobs : 55.408 s worker CPU, 56.011 s worker Wall, Wall: 45.983 s, Cores in use: 1.22, Total efficiency (on 8 cores): 15.2 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T11:00:19.818941 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-resid.jpg Stage coadds : Wall: 1.72 s, CPU: 0.67 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.229892 MB Stage coadds finished: 2020-08-10T11:00:21.539462 Resources for stage coadds : 4.500 s worker CPU, 5.318 s worker Wall, Wall: 1.721 s, Cores in use: 3.00, Total efficiency (on 8 cores): 37.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T11:00:21.552944 Cut to 1 unWISE tiles Reading WISE tile 1678m031 band 2 Reading WISE tile 1678m031 band 1 Reading WISE tile 1678m031 band 3 Reading WISE tile 1678m031 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 973 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.191916 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 951 MB, VmSize: 813 MB, VmRSS: 160 MB, VmData: 184 MB, maxrss: 0.224808 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 972 MB, VmSize: 801 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.206592 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/167/1678m031/unwise-1678m031-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.207192 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/tmp-legacysurvey-custom-167397m03667-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.64 s, CPU: 0.84 s, VmPeak: 1037 MB, VmSize: 1031 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.230596 MB Stage wise_forced finished: 2020-08-10T11:00:24.192772 Resources for stage wise_forced : 3.536 s worker CPU, 4.707 s worker Wall, Wall: 2.641 s, Cores in use: 1.66, Total efficiency (on 8 cores): 20.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T11:00:24.290195 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/coadd/cus/custom-167397m03667/legacysurvey-custom-167397m03667-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor-i/cus/tractor-custom-167397m03667.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor/cus/tractor-custom-167397m03667.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/tractor/cus/brick-custom-167397m03667.sha256sum Stage writecat : Wall: 1.05 s, CPU: 0.70 s, VmPeak: 1163 MB, VmSize: 1035 MB, VmRSS: 227 MB, VmData: 251 MB, maxrss: 0.363584 MB Stage writecat finished: 2020-08-10T11:00:25.335537 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.046 s, Cores in use: 0.67, Total efficiency (on 8 cores): 8.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/167/PGC1068366_GROUP/PGC1068366_GROUP-largegalaxy-writecat.p All done: 72.595 s worker CPU, 653.849 s worker Wall, Wall: 190.673 s, Cores in use: 0.43, Total efficiency (on 8 cores): 5.3 % Finished galaxy PGC1068366_GROUP in 3.209 minutes.