Started working on galaxy PGC309558 at Sun Jun 7 08:07:33 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.444542 -65.85613889999999 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T08:07:34.100312 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '58.444542', '-65.85613889999999', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.444542 -65.85613889999999 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 58.444542 -65.85613889999999 Starting process 18633 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0573 MB Starting process 18634 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 18635 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 18636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T08:07:40.544555 Keeping 11 CCDs: c4d_140203_023001_ooi_r_ls9.fits.fz c4d_140203_023001_ooi_r_ls9-S17 r exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 56691.103 object DES survey hex 577-663 tiling 1 c4d_140203_022803_ooi_g_ls9.fits.fz c4d_140203_022803_ooi_g_ls9-S17 g exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 56691.101 object DES survey hex 577-663 tiling 1 c4d_140203_022403_ooi_g_ls9.fits.fz c4d_140203_022403_ooi_g_ls9-N7 g exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 56691.098 object DES survey hex 577-663 tiling 2 c4d_140208_020856_ooi_z_ls9.fits.fz c4d_140208_020856_ooi_z_ls9-N7 z exptime 90.0 propid 2012B-0001 seeing 0.77 MJD 56696.088 object DES survey hex 577-663 tiling 2 c4d_140203_022604_ooi_r_ls9.fits.fz c4d_140203_022604_ooi_r_ls9-N7 r exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56691.100 object DES survey hex 577-663 tiling 2 c4d_140208_022005_ooi_z_ls9.fits.fz c4d_140208_022005_ooi_z_ls9-N11 z exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 56696.096 object DES survey hex 577-663 tiling 4 c4d_140204_023223_ooi_g_ls9.fits.fz c4d_140204_023223_ooi_g_ls9-N11 g exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 56692.104 object DES survey hex 577-663 tiling 4 c4d_140206_022842_ooi_z_ls9.fits.fz c4d_140206_022842_ooi_z_ls9-S9 z exptime 90.0 propid 2012B-0001 seeing 0.81 MJD 56694.102 object DES survey hex 610-653 tiling 3 c4d_140204_023422_ooi_g_ls9.fits.fz c4d_140204_023422_ooi_g_ls9-S9 g exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56692.106 object DES survey hex 610-653 tiling 3 c4d_140203_023001_ooi_r_ls9.fits.fz c4d_140203_023001_ooi_r_ls9-S18 r exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56691.103 object DES survey hex 577-663 tiling 1 c4d_140203_022803_ooi_g_ls9.fits.fz c4d_140203_022803_ooi_g_ls9-S18 g exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56691.101 object DES survey hex 577-663 tiling 1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T020632_oi[N7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022140_oi[N7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S17,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022341_oi[N7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T021743_oi[N11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023001_oi[N11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023159_oi[S9,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9613d50-z-20140206T022619_oi[S9,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022739_oi[S18,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S18,noinherit][2046,4094][real]: DES sur Stage tims : Wall: 65.29 s, CPU: 7.79 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.454636 MB Stage tims finished: 2020-06-07T08:08:45.837630 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022341_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023159_oi[S9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022140_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9613d50-z-20140206T022619_oi[S9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T021743_oi[N11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022739_oi[S18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T020632_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023001_oi[N11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Resources for stage tims : 3.680 s worker CPU, 188.271 s worker Wall, Wall: 65.294 s, Cores in use: 0.18, Total efficiency (on 4 cores): 4.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T08:08:45.853279 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11754.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11686.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11687.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/reference-custom-058444m65856.fits Stage refs : Wall: 12.49 s, CPU: 11.90 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 196 MB, VmData: 228 MB, maxrss: 0.454636 MB Stage refs finished: 2020-06-07T08:08:58.341655 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.489 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T08:08:58.342924 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outlier-mask-custom-058444m65856.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-pre-custom-058444m65856.jpg Image c4d_140203_022403_ooi_g_ls9-N7 g : masking 0 positive outlier pixels and 44 negative outlier pixels Image c4d_140204_023223_ooi_g_ls9-N11 g : masking 335 positive outlier pixels and 344 negative outlier pixels Image c4d_140204_023422_ooi_g_ls9-S9 g : masking 348 positive outlier pixels and 0 negative outlier pixels Image c4d_140208_022005_ooi_z_ls9-N11 z : masking 117 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outlier-mask-custom-058444m65856.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-post-custom-058444m65856.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-masked-pos-custom-058444m65856.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-masked-neg-custom-058444m65856.jpg Stage outliers : Wall: 9.48 s, CPU: 9.30 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.454636 MB Stage outliers finished: 2020-06-07T08:09:07.824405 Resources for stage outliers : 0.491 s worker CPU, 0.491 s worker Wall, Wall: 9.482 s, Cores in use: 1.03, Total efficiency (on 4 cores): 25.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T08:09:07.825829 Stage halos : Wall: 14.41 s, CPU: 11.08 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.454636 MB Stage halos finished: 2020-06-07T08:09:22.240623 Resources for stage halos : 0.171 s worker CPU, 10.318 s worker Wall, Wall: 14.416 s, Cores in use: 0.78, Total efficiency (on 4 cores): 19.5 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T08:09:22.242336 PSF sigmas in coadd pixels: ['1.89', '1.63', '1.52', '1.77'] Using average PSF sigma 1.7027273624673978 Gaussian PSF norm 0.1656723195926673 vs pixelized 0.14153184 average tim pixel scale / coadd scale: 1.0011365043109581 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.71', '1.64'] Using average PSF sigma 1.677185985957135 Gaussian PSF norm 0.16819529505721012 vs pixelized 0.14229093 average tim pixel scale / coadd scale: 1.0011580489213288 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.26', '1.34', '1.32'] Using average PSF sigma 1.3061191417307303 Gaussian PSF norm 0.2159793718359231 vs pixelized 0.1776473 average tim pixel scale / coadd scale: 1.0010944648276132 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.12 s, CPU: 0.11 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.454636 MB Stage fit_on_coadds finished: 2020-06-07T08:09:22.366065 Resources for stage fit_on_coadds : 0.090 s worker CPU, 0.090 s worker Wall, Wall: 0.125 s, Cores in use: 1.59, Total efficiency (on 4 cores): 39.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T08:09:22.368093 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 53 potential peaks Of 53 potential peaks: 31 in veto map, 4 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 40217 potential peaks Of 40217 potential peaks: 40211 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 82 potential peaks Of 82 potential peaks: 68 in veto map, 8 cut by saddle test, 0 cut by aper test, 6 kept SED g : 6 new peaks Found 471 potential peaks Of 471 potential peaks: 466 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 721 potential peaks Of 721 potential peaks: 716 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 26 new sources Median coadd sky for g : 0.00036468563 Median coadd sky for r : 0.00025229022 Median coadd sky for z : 0.0006510188 Stage srcs : Wall: 12.72 s, CPU: 11.78 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 208 MB, VmData: 237 MB, maxrss: 0.454636 MB Stage srcs finished: 2020-06-07T08:09:35.087206 Resources for stage srcs : 1.013 s worker CPU, 1.019 s worker Wall, Wall: 12.720 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.1 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T08:09:35.099416 Blob 1 of 4, id: 0, sources: 25, size: 257x257, npix 55182, brick X: 0,257, Y: 0,257, one pixel: 46 0 Blob 2 of 4, id: 3, sources: 2, size: 39x44, npix 1076, brick X: 218,257, Y: 36,80, one pixel: 228 36 Blob 3 of 4, id: 1, sources: 2, size: 28x45, npix 763, brick X: 183,211, Y: 7,52, one pixel: 194 7 Blob 4 of 4, id: 2, sources: 1, size: 16x22, npix 235, brick X: 241,257, Y: 9,31, one pixel: 250 9 Blob 4 finished, total: Wall: 1.35 s, CPU: 1.35 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148968 MB Blob 3 finished, total: Wall: 1.63 s, CPU: 1.63 s, VmPeak: 956 MB, VmSize: 718 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145564 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 2.86 s, CPU: 2.86 s, VmPeak: 955 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148524 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (58.45336, -65.87228), pm (-13.9, 12.1), parallax 2.601 with NanoMaggies: g=16.5, r=15.3, z=14.6 Reset brightness to NanoMaggies: g=16.5, r=15.3, z=14.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (58.42128, -65.84512), pm (2.9, -0.6), parallax 0.181 with NanoMaggies: g=15.7, r=15.9, z=14.8 Reset brightness to NanoMaggies: g=16.5, r=15.9, z=15.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.29022, ee1=-0.0790089, ee2=0.0357809 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (58.41510, -65.85625), pm (6.1, 6.8), parallax 0.691 with NanoMaggies: g=18.2, r=17.4, z=17 Reset brightness to NanoMaggies: g=18.2, r=17.4, z=17 Measuring 8 iterative sources Blob 1 finished, total: Wall: 20.05 s, CPU: 20.05 s, VmPeak: 950 MB, VmSize: 714 MB, VmRSS: 145 MB, VmData: 177 MB, maxrss: 0.17238 MB Old catalog: 31 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/blobs-custom-058444m65856.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/all-models-custom-058444m65856.fits Stage fitblobs : Wall: 28.25 s, CPU: 8.14 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.454636 MB Stage fitblobs finished: 2020-06-07T08:10:03.353609 Resources for stage fitblobs : 25.988 s worker CPU, 26.006 s worker Wall, Wall: 28.255 s, Cores in use: 1.21, Total efficiency (on 4 cores): 30.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T08:10:03.355410 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-resid.jpg Stage coadds : Wall: 12.42 s, CPU: 10.82 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.454636 MB Stage coadds finished: 2020-06-07T08:10:15.770525 Resources for stage coadds : 3.297 s worker CPU, 3.385 s worker Wall, Wall: 12.416 s, Cores in use: 1.14, Total efficiency (on 4 cores): 28.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T08:10:15.771806 Cut to 2 unWISE tiles Reading WISE tile 0593m667 band 1 Reading WISE tile 0593m667 band 3 Reading WISE tile 0593m667 band 2 Reading WISE tile 0593m667 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 955 MB, VmSize: 801 MB, VmRSS: 152 MB, VmData: 180 MB, maxrss: 0.18974 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 956 MB, VmSize: 795 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20778 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 950 MB, VmSize: 800 MB, VmRSS: 155 MB, VmData: 179 MB, maxrss: 0.219364 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 1 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 956 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210096 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 24.46 s, CPU: 7.98 s, VmPeak: 1028 MB, VmSize: 1028 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.454636 MB Stage wise_forced finished: 2020-06-07T08:10:40.235915 Resources for stage wise_forced : 5.702 s worker CPU, 41.731 s worker Wall, Wall: 24.465 s, Cores in use: 0.56, Total efficiency (on 4 cores): 14.0 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T08:10:40.237464 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/tractor-i/cus/tractor-custom-058444m65856.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/tractor/cus/tractor-custom-058444m65856.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/tractor/cus/brick-custom-058444m65856.sha256sum Stage writecat : Wall: 12.57 s, CPU: 11.58 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 214 MB, VmData: 238 MB, maxrss: 0.454636 MB Stage writecat finished: 2020-06-07T08:10:52.807912 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.571 s, Cores in use: 0.92, Total efficiency (on 4 cores): 23.0 % Stage writecat finished All done: 40.433 s worker CPU, 271.312 s worker Wall, Wall: 192.268 s, Cores in use: 0.68, Total efficiency (on 4 cores): 17.0 % Finished galaxy PGC309558 in 3.333 minutes. Started working on galaxy PGC309558 at Sat Jul 18 19:48:31 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.444542 -65.85613889999999 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-18T19:48:32.505724 legacypipe git version: DR9.5.5-6-g531bd718 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '58.444542', '-65.85613889999999', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.444542 -65.85613889999999 --width 257 --height 257 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 58.444542 -65.85613889999999 Starting process 5552 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB Starting process 5553 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB Starting process 5554 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 5555 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB Starting process 5556 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB Starting process 5557 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB Starting process 5558 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 5559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 5560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 5561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 5562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 5563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 5564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 5565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 5566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 5567 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 5568 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 5569 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 5570 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 5571 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 5572 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 5573 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 5574 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 5575 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 5576 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 5577 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 5578 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 5579 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 5580 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 5581 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 5582 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 5583 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-18T19:48:33.092452 Keeping 11 CCDs: c4d_140203_023001_ooi_r_ls9.fits.fz c4d_140203_023001_ooi_r_ls9-S17 r exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 56691.103 object DES survey hex 577-663 tiling 1 c4d_140203_022803_ooi_g_ls9.fits.fz c4d_140203_022803_ooi_g_ls9-S17 g exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 56691.101 object DES survey hex 577-663 tiling 1 c4d_140203_022403_ooi_g_ls9.fits.fz c4d_140203_022403_ooi_g_ls9-N7 g exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 56691.098 object DES survey hex 577-663 tiling 2 c4d_140208_020856_ooi_z_ls9.fits.fz c4d_140208_020856_ooi_z_ls9-N7 z exptime 90.0 propid 2012B-0001 seeing 0.77 MJD 56696.088 object DES survey hex 577-663 tiling 2 c4d_140203_022604_ooi_r_ls9.fits.fz c4d_140203_022604_ooi_r_ls9-N7 r exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 56691.100 object DES survey hex 577-663 tiling 2 c4d_140208_022005_ooi_z_ls9.fits.fz c4d_140208_022005_ooi_z_ls9-N11 z exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 56696.096 object DES survey hex 577-663 tiling 4 c4d_140204_023223_ooi_g_ls9.fits.fz c4d_140204_023223_ooi_g_ls9-N11 g exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 56692.104 object DES survey hex 577-663 tiling 4 c4d_140206_022842_ooi_z_ls9.fits.fz c4d_140206_022842_ooi_z_ls9-S9 z exptime 90.0 propid 2012B-0001 seeing 0.81 MJD 56694.102 object DES survey hex 610-653 tiling 3 c4d_140204_023422_ooi_g_ls9.fits.fz c4d_140204_023422_ooi_g_ls9-S9 g exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 56692.106 object DES survey hex 610-653 tiling 3 c4d_140203_023001_ooi_r_ls9.fits.fz c4d_140203_023001_ooi_r_ls9-S18 r exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 56691.103 object DES survey hex 577-663 tiling 1 c4d_140203_022803_ooi_g_ls9.fits.fz c4d_140203_022803_ooi_g_ls9-S18 g exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56691.101 object DES survey hex 577-663 tiling 1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022341_oi[N7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T020632_oi[N7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023001_oi[N11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022739_oi[S18,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S18,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S17,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022140_oi[N7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023159_oi[S9,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9613d50-z-20140206T022619_oi[S9,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T021743_oi[N11,noinherit][2046,4094][real]: DES sur Stage tims : Wall: 4.30 s, CPU: 0.96 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 173 MB, VmData: 206 MB, maxrss: 0.176792 MB Stage tims finished: 2020-07-18T19:48:37.391910 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022341_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_961349b-r-20140203T022739_oi[S18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022541_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140203T022140_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023159_oi[S9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9613d50-z-20140206T022619_oi[S9,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T021743_oi[N11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Resources for stage tims : 5.452 s worker CPU, 29.363 s worker Wall, Wall: 4.303 s, Cores in use: 1.49, Total efficiency (on 32 cores): 4.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9614461-z-20140208T020632_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612a42-g-20140204T023001_oi[N11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Running stage refs at 2020-07-18T19:48:40.878989 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11754.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11686.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11687.fits Matched 6 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/reference-custom-058444m65856.fits Stage refs : Wall: 6.26 s, CPU: 2.43 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 198 MB, VmData: 231 MB, maxrss: 0.202644 MB Stage refs finished: 2020-07-18T19:48:47.143807 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 6.268 s, Cores in use: 0.39, Total efficiency (on 32 cores): 1.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-18T19:48:47.181815 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outlier-mask-custom-058444m65856.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-pre-custom-058444m65856.jpg Image c4d_140203_022403_ooi_g_ls9-N7 g : masking 0 positive outlier pixels and 44 negative outlier pixels Image c4d_140204_023223_ooi_g_ls9-N11 g : masking 335 positive outlier pixels and 344 negative outlier pixels Image c4d_140204_023422_ooi_g_ls9-S9 g : masking 348 positive outlier pixels and 0 negative outlier pixels Image c4d_140208_022005_ooi_z_ls9-N11 z : masking 117 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outlier-mask-custom-058444m65856.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-post-custom-058444m65856.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-masked-pos-custom-058444m65856.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/outliers-masked-neg-custom-058444m65856.jpg Stage outliers : Wall: 1.04 s, CPU: 0.74 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 209 MB, VmData: 240 MB, maxrss: 0.214284 MB Stage outliers finished: 2020-07-18T19:48:48.226118 Resources for stage outliers : 0.603 s worker CPU, 0.796 s worker Wall, Wall: 1.047 s, Cores in use: 1.28, Total efficiency (on 32 cores): 4.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-18T19:48:48.245727 Stage halos : Wall: 0.52 s, CPU: 0.39 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 209 MB, VmData: 241 MB, maxrss: 0.214524 MB Stage halos finished: 2020-07-18T19:48:48.763239 Resources for stage halos : 0.320 s worker CPU, 0.567 s worker Wall, Wall: 0.520 s, Cores in use: 1.36, Total efficiency (on 32 cores): 4.3 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-18T19:48:48.813807 PSF sigmas in coadd pixels: ['1.89', '1.63', '1.52', '1.77'] Using average PSF sigma 1.7027273624673978 Gaussian PSF norm 0.1656723195926673 vs pixelized 0.14153184 average tim pixel scale / coadd scale: 1.0011365043109581 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.71', '1.64'] Using average PSF sigma 1.677185985957135 Gaussian PSF norm 0.16819529505721012 vs pixelized 0.14229093 average tim pixel scale / coadd scale: 1.0011580489213288 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.26', '1.34', '1.32'] Using average PSF sigma 1.3061191417307303 Gaussian PSF norm 0.2159793718359231 vs pixelized 0.1776473 average tim pixel scale / coadd scale: 1.0010944648276132 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.15 s, CPU: 0.10 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 211 MB, VmData: 241 MB, maxrss: 0.2162 MB Stage fit_on_coadds finished: 2020-07-18T19:48:48.962213 Resources for stage fit_on_coadds : 0.083 s worker CPU, 0.083 s worker Wall, Wall: 0.151 s, Cores in use: 1.21, Total efficiency (on 32 cores): 3.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-18T19:48:48.974257 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 53 potential peaks Of 53 potential peaks: 31 in veto map, 4 cut by saddle test, 0 cut by aper test, 18 kept SED z : 18 new peaks Found 40216 potential peaks Of 40216 potential peaks: 40210 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 82 potential peaks Of 82 potential peaks: 68 in veto map, 8 cut by saddle test, 0 cut by aper test, 6 kept SED g : 6 new peaks Found 470 potential peaks Of 470 potential peaks: 465 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 722 potential peaks Of 722 potential peaks: 716 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 27 new sources Median coadd sky for g : 0.0003700693 Median coadd sky for r : 0.00039072882 Median coadd sky for z : 0.0006930009 Stage srcs : Wall: 1.66 s, CPU: 0.69 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 212 MB, VmData: 241 MB, maxrss: 0.216584 MB Stage srcs finished: 2020-07-18T19:48:50.638701 Resources for stage srcs : 1.027 s worker CPU, 1.032 s worker Wall, Wall: 1.667 s, Cores in use: 1.03, Total efficiency (on 32 cores): 3.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-18T19:48:50.651926 Blob 1 of 5, id: 0, sources: 25, size: 257x257, npix 55033, brick X: 0,257, Y: 0,257, one pixel: 46 0 Blob 2 of 5, id: 4, sources: 2, size: 39x44, npix 1072, brick X: 218,257, Y: 36,80, one pixel: 228 36 Blob 3 of 5, id: 1, sources: 2, size: 28x45, npix 753, brick X: 183,211, Y: 7,52, one pixel: 194 7 Blob 4 of 5, id: 2, sources: 1, size: 16x22, npix 235, brick X: 241,257, Y: 9,31, one pixel: 250 9 Blob 5 of 5, id: 3, sources: 1, size: 18x17, npix 162, brick X: 9,27, Y: 18,35, one pixel: 17 18 Blob 5 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 105 MB, VmData: 165 MB, maxrss: 0.10748 MB Blob 4 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 952 MB, VmSize: 718 MB, VmRSS: 141 MB, VmData: 180 MB, maxrss: 0.144132 MB Blob 3 finished, total: Wall: 1.20 s, CPU: 1.20 s, VmPeak: 947 MB, VmSize: 719 MB, VmRSS: 140 MB, VmData: 180 MB, maxrss: 0.143392 MB Measuring 2 iterative sources Blob 2 finished, total: Wall: 2.23 s, CPU: 2.23 s, VmPeak: 661 MB, VmSize: 661 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.093788 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (58.45336, -65.87228), pm (-13.9, 12.1), parallax 2.601 with NanoMaggies: g=16.5, r=15.3, z=14.6 Reset brightness to NanoMaggies: g=16.5, r=15.3, z=14.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (58.42128, -65.84512), pm (2.9, -0.6), parallax 0.181 with NanoMaggies: g=15.7, r=15.9, z=14.9 Reset brightness to NanoMaggies: g=16.5, r=15.9, z=15.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.29037, ee1=-0.0792252, ee2=0.0360295 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (58.41510, -65.85625), pm (6.1, 6.8), parallax 0.691 with NanoMaggies: g=18.2, r=17.4, z=17 Reset brightness to NanoMaggies: g=18.2, r=17.4, z=17 Measuring 8 iterative sources Blob 1 finished, total: Wall: 19.38 s, CPU: 19.38 s, VmPeak: 712 MB, VmSize: 687 MB, VmRSS: 126 MB, VmData: 165 MB, maxrss: 0.152072 MB Old catalog: 32 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/blobs-custom-058444m65856.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/metrics/cus/all-models-custom-058444m65856.fits Stage fitblobs : Wall: 22.76 s, CPU: 0.51 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.218884 MB Stage fitblobs finished: 2020-07-18T19:49:13.411842 Resources for stage fitblobs : 23.794 s worker CPU, 23.806 s worker Wall, Wall: 22.763 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-18T19:49:15.827320 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-resid.jpg Stage coadds : Wall: 10.64 s, CPU: 0.75 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 214 MB, VmData: 242 MB, maxrss: 0.219528 MB Stage coadds finished: 2020-07-18T19:49:26.463408 Resources for stage coadds : 29.078 s worker CPU, 29.759 s worker Wall, Wall: 10.639 s, Cores in use: 2.80, Total efficiency (on 32 cores): 8.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-18T19:49:26.477115 Cut to 2 unWISE tiles Reading WISE tile 0593m667 band 1 Reading WISE tile 0593m667 band 2 Reading WISE tile 0593m667 band 3 Reading WISE tile 0593m667 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0593m667/unwise-0593m667-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 0594m652 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 946 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 179 MB, maxrss: 0.183824 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 948 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 173 MB, maxrss: 0.204596 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 947 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 174 MB, maxrss: 0.204952 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/059/0594m652/unwise-0594m652-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 794 MB, VmSize: 794 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.19716 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/tmp-legacysurvey-custom-058444m65856-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.17 s, CPU: 0.59 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 215 MB, VmData: 242 MB, maxrss: 0.220232 MB Stage wise_forced finished: 2020-07-18T19:49:29.650823 Resources for stage wise_forced : 6.169 s worker CPU, 8.304 s worker Wall, Wall: 3.176 s, Cores in use: 2.13, Total efficiency (on 32 cores): 6.7 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-18T19:49:29.666210 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/coadd/cus/custom-058444m65856/legacysurvey-custom-058444m65856-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/tractor-i/cus/tractor-custom-058444m65856.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/tractor/cus/tractor-custom-058444m65856.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/tractor/cus/brick-custom-058444m65856.sha256sum Stage writecat : Wall: 0.82 s, CPU: 0.67 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 217 MB, VmData: 242 MB, maxrss: 0.353104 MB Stage writecat finished: 2020-07-18T19:49:30.482150 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.819 s, Cores in use: 0.83, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC309558/PGC309558-largegalaxy-writecat.p All done: 66.533 s worker CPU, 93.717 s worker Wall, Wall: 57.412 s, Cores in use: 1.30, Total efficiency (on 32 cores): 4.1 % Finished galaxy PGC309558 in 0.992 minutes.