Started working on galaxy PGC1764627 at Thu Jun 4 09:31:13 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.5084635 26.1491057 --width 235 --height 235 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T09:31:14.816967 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.5084635', '26.1491057', '--width', '235', '--height', '235', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.5084635 26.1491057 --width 235 --height 235 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 128.5084635 26.1491057 Starting process 5938 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 5939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 5940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.0574 MB Starting process 5941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB Starting process 5942 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057384 MB Starting process 5943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057388 MB Starting process 5944 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057388 MB Starting process 5945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057388 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T09:31:17.787469 Keeping 17 CCDs: c4d_190305_013245_ooi_g_ls9.fits.fz c4d_190305_013245_ooi_g_ls9-N18 g exptime 151.0 propid 2014B-0404 seeing 1.40 MJD 58547.064 object DECaLS_42568_g c4d_160109_054711_ooi_r_ls9.fits.fz c4d_160109_054711_ooi_r_ls9-N18 r exptime 76.0 propid 2014B-0404 seeing 1.50 MJD 57396.240 object DECaLS_42568_r c4d_150411_001329_ooi_r_ls9.fits.fz c4d_150411_001329_ooi_r_ls9-N24 r exptime 73.0 propid 2014B-0404 seeing 1.08 MJD 57123.008 object DECaLS_26696_r c4d_150411_001535_ooi_g_ls9.fits.fz c4d_150411_001535_ooi_g_ls9-N24 g exptime 96.0 propid 2014B-0404 seeing 1.25 MJD 57123.009 object DECaLS_26696_g c4d_190103_045022_ooi_g_ls9.fits.fz c4d_190103_045022_ooi_g_ls9-N24 g exptime 200.0 propid 2014B-0404 seeing 1.53 MJD 58486.202 object DECaLS_26696_g c4d_150416_234003_ooi_z_ls9.fits.fz c4d_150416_234003_ooi_z_ls9-N24 z exptime 132.0 propid 2014B-0404 seeing 1.09 MJD 57128.984 object DECaLS_26696_z c4d_181209_072513_ooi_r_ls9.fits.fz c4d_181209_072513_ooi_r_ls9-S26 r exptime 75.0 propid 2014B-0404 seeing 1.33 MJD 58461.309 object DECaLS_10807_r c4d_181209_072657_ooi_g_ls9.fits.fz c4d_181209_072657_ooi_g_ls9-S26 g exptime 162.0 propid 2014B-0404 seeing 1.61 MJD 58461.310 object DECaLS_10807_g c4d_150411_001713_ooi_r_ls9.fits.fz c4d_150411_001713_ooi_r_ls9-S25 r exptime 69.0 propid 2014B-0404 seeing 1.18 MJD 57123.011 object DECaLS_26679_r c4d_150411_001909_ooi_g_ls9.fits.fz c4d_150411_001909_ooi_g_ls9-S25 g exptime 89.0 propid 2014B-0404 seeing 1.49 MJD 57123.012 object DECaLS_26679_g c4d_141228_070233_ooi_r_ls9.fits.fz c4d_141228_070233_ooi_r_ls9-S26 r exptime 67.0 propid 2014B-0404 seeing 1.50 MJD 57019.292 object DECaLS_10807_r c4d_141231_053000_ooi_z_ls9.fits.fz c4d_141231_053000_ooi_z_ls9-S26 z exptime 120.0 propid 2014B-0404 seeing 0.97 MJD 57022.227 object DECaLS_10807_z c4d_190303_025503_ooi_g_ls9.fits.fz c4d_190303_025503_ooi_g_ls9-S25 g exptime 126.0 propid 2014B-0404 seeing 1.35 MJD 58545.122 object DECaLS_26679_g c4d_141228_070745_ooi_g_ls9.fits.fz c4d_141228_070745_ooi_g_ls9-S26 g exptime 79.0 propid 2014B-0404 seeing 1.68 MJD 57019.295 object DECaLS_10807_g c4d_150416_234241_ooi_z_ls9.fits.fz c4d_150416_234241_ooi_z_ls9-S25 z exptime 129.0 propid 2014B-0404 seeing 1.00 MJD 57128.986 object DECaLS_26679_z c4d_160112_061019_ooi_z_ls9.fits.fz c4d_160112_061019_ooi_z_ls9-N18 z exptime 167.0 propid 2014B-0404 seeing 1.45 MJD 57399.255 object DECaLS_42568_z c4d_160109_054931_ooi_g_ls9.fits.fz c4d_160109_054931_ooi_g_ls9-N18 g exptime 112.0 propid 2014B-0404 seeing 1.68 MJD 57396.241 object DECaLS_42568_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538963-r-20181209T072513_oi[S26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bbb4-r-20160109T054504_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568fa4-z-20150416T233703_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9558610-g-20150411T001310_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190103T045022_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a368-g-20190305T013245_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95391af-g-20181209T072657_oi[S26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95555f8-r-20150411T001127_oi[N24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9558610-g-20150411T001651_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95555f8-r-20150411T001513_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95506eb-r-20141228T070036_oi[S26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a046-g-20190303T025503_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568fa4-z-20150416T233944_oi[S25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95613b5-z-20141231T052710_oi[S26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160112T060644_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95775a2-g-20160109T054649_oi[N18,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9552e01-g-20141228T070530_oi[S26,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 58.06 s, CPU: 2.92 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.44844 MB Stage tims finished: 2020-06-04T09:32:15.843050 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9538963-r-20181209T072513_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95555f8-r-20150411T001513_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a368-g-20190305T013245_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95506eb-r-20141228T070036_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568fa4-z-20150416T233703_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a046-g-20190303T025503_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95555f8-r-20150411T001127_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95613b5-z-20141231T052710_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9558610-g-20150411T001310_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568fa4-z-20150416T233944_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9539c88-g-20190103T045022_oi[N24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9553d83-z-20160112T060644_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95391af-g-20181209T072657_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9552e01-g-20141228T070530_oi[S26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 7.164 s worker CPU, 295.993 s worker Wall, Wall: 58.057 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_957bbb4-r-20160109T054504_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9558610-g-20150411T001651_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95775a2-g-20160109T054649_oi[N18,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-04T09:32:15.874476 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03309.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03565.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03438.fits Matched 7 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/reference-custom-128508p26149.fits Stage refs : Wall: 4.73 s, CPU: 3.92 s, VmPeak: 1028 MB, VmSize: 1017 MB, VmRSS: 199 MB, VmData: 233 MB, maxrss: 0.44844 MB Stage refs finished: 2020-06-04T09:32:20.603546 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.730 s, Cores in use: 0.83, Total efficiency (on 8 cores): 10.4 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T09:32:20.605417 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/outlier-mask-custom-128508p26149.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/outliers-pre-custom-128508p26149.jpg Image c4d_150411_001535_ooi_g_ls9-N24 g : masking 922 positive outlier pixels and 0 negative outlier pixels Image c4d_150411_001909_ooi_g_ls9-S25 g : masking 201 positive outlier pixels and 0 negative outlier pixels Image c4d_141228_070745_ooi_g_ls9-S26 g : masking 355 positive outlier pixels and 0 negative outlier pixels Image c4d_150411_001713_ooi_r_ls9-S25 r : masking 188 positive outlier pixels and 0 negative outlier pixels Image c4d_150411_001329_ooi_r_ls9-N24 r : masking 135 positive outlier pixels and 0 negative outlier pixels Image c4d_150416_234241_ooi_z_ls9-S25 z : masking 595 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/outlier-mask-custom-128508p26149.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/outliers-post-custom-128508p26149.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/outliers-masked-pos-custom-128508p26149.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/outliers-masked-neg-custom-128508p26149.jpg Stage outliers : Wall: 3.16 s, CPU: 2.97 s, VmPeak: 1028 MB, VmSize: 1027 MB, VmRSS: 215 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage outliers finished: 2020-06-04T09:32:23.768334 Resources for stage outliers : 1.122 s worker CPU, 1.122 s worker Wall, Wall: 3.164 s, Cores in use: 1.29, Total efficiency (on 8 cores): 16.2 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T09:32:23.770211 Stage halos : Wall: 5.92 s, CPU: 2.71 s, VmPeak: 1028 MB, VmSize: 1027 MB, VmRSS: 215 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage halos finished: 2020-06-04T09:32:29.686611 Resources for stage halos : 0.402 s worker CPU, 12.324 s worker Wall, Wall: 5.918 s, Cores in use: 0.53, Total efficiency (on 8 cores): 6.6 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T09:32:29.688865 PSF sigmas in coadd pixels: ['2.27', '2.03', '2.48', '2.62', '2.42', '2.19', '2.73', '2.73'] Using average PSF sigma 2.4343422591463955 Gaussian PSF norm 0.11588131895339769 vs pixelized 0.10227594 average tim pixel scale / coadd scale: 1.0012751696222526 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.44', '1.75', '2.16', '1.92', '2.43'] Using average PSF sigma 2.1396321257997983 Gaussian PSF norm 0.131842660414547 vs pixelized 0.10887347 average tim pixel scale / coadd scale: 1.0012851971137615 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.77', '1.57', '1.63', '2.36'] Using average PSF sigma 1.830790816914785 Gaussian PSF norm 0.15408357370355347 vs pixelized 0.12950201 average tim pixel scale / coadd scale: 1.0012133600846118 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.20 s, CPU: 0.19 s, VmPeak: 1028 MB, VmSize: 1027 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage fit_on_coadds finished: 2020-06-04T09:32:29.886878 Resources for stage fit_on_coadds : 0.265 s worker CPU, 0.269 s worker Wall, Wall: 0.199 s, Cores in use: 2.29, Total efficiency (on 8 cores): 28.7 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T09:32:29.890188 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 43 potential peaks Of 43 potential peaks: 34 in veto map, 5 cut by saddle test, 0 cut by aper test, 4 kept SED z : 4 new peaks Found 53 potential peaks Of 53 potential peaks: 44 in veto map, 6 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 60 potential peaks Of 60 potential peaks: 51 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 82 potential peaks Of 82 potential peaks: 72 in veto map, 10 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 95 potential peaks Of 95 potential peaks: 85 in veto map, 8 cut by saddle test, 1 cut by aper test, 1 kept SED Red : 1 new peaks Adding 10 new sources Median coadd sky for g : 0.0003123749 Median coadd sky for r : 0.0007761564 Median coadd sky for z : 0.0015801471 Stage srcs : Wall: 3.43 s, CPU: 3.41 s, VmPeak: 1028 MB, VmSize: 1027 MB, VmRSS: 217 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage srcs finished: 2020-06-04T09:32:33.321326 Resources for stage srcs : 0.063 s worker CPU, 0.063 s worker Wall, Wall: 3.432 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/PGC1764627-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T09:32:33.953447 Blob 1 of 5, id: 0, sources: 8, size: 235x203, npix 30705, brick X: 0,235, Y: 0,203, one pixel: 48 0 Blob 2 of 5, id: 4, sources: 1, size: 38x25, npix 600, brick X: 53,91, Y: 210,235, one pixel: 67 210 Blob 3 of 5, id: 3, sources: 1, size: 32x26, npix 599, brick X: 194,226, Y: 209,235, one pixel: 204 209 Blob 4 of 5, id: 1, sources: 1, size: 25x24, npix 356, brick X: 147,172, Y: 4,28, one pixel: 158 4 Blob 5 of 5, id: 2, sources: 1, size: 22x24, npix 327, brick X: 213,235, Y: 7,31, one pixel: 223 7 Blob 4 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146044 MB Blob 5 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 959 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.14674 MB Blob 2 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 953 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147912 MB Blob 3 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 956 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148256 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.490632, ee1=0.0491966, ee2=0.0592549 Measuring 4 iterative sources Blob 1 finished, total: Wall: 12.71 s, CPU: 12.70 s, VmPeak: 957 MB, VmSize: 722 MB, VmRSS: 154 MB, VmData: 185 MB, maxrss: 0.157512 MB Old catalog: 16 New catalog: 15 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/blobs-custom-128508p26149.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/metrics/cus/all-models-custom-128508p26149.fits Stage fitblobs : Wall: 19.26 s, CPU: 6.46 s, VmPeak: 1028 MB, VmSize: 1027 MB, VmRSS: 219 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage fitblobs finished: 2020-06-04T09:32:53.210764 Resources for stage fitblobs : 15.287 s worker CPU, 15.350 s worker Wall, Wall: 19.258 s, Cores in use: 1.13, Total efficiency (on 8 cores): 14.1 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T09:32:53.212658 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/tmp-legacysurvey-custom-128508p26149-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/tmp-legacysurvey-custom-128508p26149-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/tmp-legacysurvey-custom-128508p26149-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/tmp-legacysurvey-custom-128508p26149-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-resid.jpg Stage coadds : Wall: 5.46 s, CPU: 4.82 s, VmPeak: 1028 MB, VmSize: 1027 MB, VmRSS: 219 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage coadds finished: 2020-06-04T09:32:58.677663 Resources for stage coadds : 3.488 s worker CPU, 3.750 s worker Wall, Wall: 5.466 s, Cores in use: 1.52, Total efficiency (on 8 cores): 19.0 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T09:32:58.679256 Cut to 1 unWISE tiles Reading WISE tile 1283p257 band 2 Reading WISE tile 1283p257 band 4 Reading WISE tile 1283p257 band 3 Reading WISE tile 1283p257 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 951 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 174 MB, maxrss: 0.18604 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 959 MB, VmSize: 791 MB, VmRSS: 142 MB, VmData: 170 MB, maxrss: 0.206424 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 956 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 170 MB, maxrss: 0.204224 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1283p257/unwise-1283p257-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 957 MB, VmSize: 795 MB, VmRSS: 150 MB, VmData: 174 MB, maxrss: 0.214316 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/tmp-legacysurvey-custom-128508p26149-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/tmp-legacysurvey-custom-128508p26149-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.30 s, CPU: 2.86 s, VmPeak: 1028 MB, VmSize: 1027 MB, VmRSS: 220 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage wise_forced finished: 2020-06-04T09:33:06.975956 Resources for stage wise_forced : 2.932 s worker CPU, 8.240 s worker Wall, Wall: 8.298 s, Cores in use: 0.70, Total efficiency (on 8 cores): 8.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T09:33:06.977885 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/coadd/cus/custom-128508p26149/legacysurvey-custom-128508p26149-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/tractor-i/cus/tractor-custom-128508p26149.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/tractor/cus/tractor-custom-128508p26149.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1764627/tractor/cus/brick-custom-128508p26149.sha256sum Stage writecat : Wall: 2.81 s, CPU: 2.45 s, VmPeak: 1159 MB, VmSize: 1031 MB, VmRSS: 222 MB, VmData: 246 MB, maxrss: 0.44844 MB Stage writecat finished: 2020-06-04T09:33:09.788981 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.812 s, Cores in use: 0.87, Total efficiency (on 8 cores): 10.9 % Stage writecat finished All done: 30.727 s worker CPU, 337.115 s worker Wall, Wall: 112.007 s, Cores in use: 0.57, Total efficiency (on 8 cores): 7.1 % Finished galaxy PGC1764627 in 1.946 minutes.