Started working on galaxy 2MASXJ15145306+2452564 at Thu Jun 4 09:45:57 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.7209495 24.882285600000003 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T09:45:58.792168 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '228.7209495', '24.882285600000003', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 228.7209495 24.882285600000003 --width 257 --height 257 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 228.7209495 24.882285600000003 Starting process 46820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 46821 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 46822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 46823 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 46824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 46825 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 46826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 46827 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T09:46:02.977208 Keeping 12 CCDs: c4d_150409_075734_ooi_z_ls9.fits.fz c4d_150409_075734_ooi_z_ls9-S24 z exptime 110.0 propid 2014B-0404 seeing 0.97 MJD 57121.330 object DECaLS_215_z c4d_170422_065309_ooi_g_ls9.fits.fz c4d_170422_065309_ooi_g_ls9-S24 g exptime 127.0 propid 2014B-0404 seeing 1.19 MJD 57865.285 object DECaLS_215_g c4d_170422_065035_ooi_r_ls9.fits.fz c4d_170422_065035_ooi_r_ls9-S24 r exptime 75.0 propid 2014B-0404 seeing 0.98 MJD 57865.284 object DECaLS_215_r c4d_150410_085923_ooi_z_ls9.fits.fz c4d_150410_085923_ooi_z_ls9-S23 z exptime 107.0 propid 2014B-0404 seeing 1.13 MJD 57122.373 object DECaLS_16087_z c4d_170406_080400_ooi_g_ls9.fits.fz c4d_170406_080400_ooi_g_ls9-S23 g exptime 156.0 propid 2014B-0404 seeing 1.85 MJD 57849.334 object DECaLS_16087_g c4d_170331_081729_ooi_r_ls9.fits.fz c4d_170331_081729_ooi_r_ls9-S23 r exptime 63.0 propid 2014B-0404 seeing 1.21 MJD 57843.344 object DECaLS_16087_r c4d_170505_040301_ooi_z_ls9.fits.fz c4d_170505_040301_ooi_z_ls9-S23 z exptime 91.0 propid 2014B-0404 seeing 0.97 MJD 57878.167 object DECaLS_31959_z c4d_190305_080445_ooi_g_ls9.fits.fz c4d_190305_080445_ooi_g_ls9-S23 g exptime 127.0 propid 2014B-0404 seeing 1.49 MJD 58547.337 object DECaLS_31959_g c4d_180516_042453_ooi_r_ls9.fits.fz c4d_180516_042453_ooi_r_ls9-S23 r exptime 50.0 propid 2014B-0404 seeing 0.93 MJD 58254.184 object DECaLS_31959_r c4d_150409_080220_ooi_z_ls9.fits.fz c4d_150409_080220_ooi_z_ls9-N25 z exptime 112.0 propid 2014B-0404 seeing 1.05 MJD 57121.333 object DECaLS_214_z c4d_170328_083419_ooi_r_ls9.fits.fz c4d_170328_083419_ooi_r_ls9-N25 r exptime 77.0 propid 2014B-0404 seeing 1.27 MJD 57840.356 object DECaLS_214_r c4d_170329_083926_ooi_g_ls9.fits.fz c4d_170329_083926_ooi_g_ls9-N25 g exptime 175.0 propid 2014B-0404 seeing 1.41 MJD 57841.358 object DECaLS_214_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e9f3-z-20150410T085646_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517f92-r-20170422T064829_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95155af-z-20170505T040040_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95173ea-g-20170406T080035_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516c11-r-20170331T081536_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a368-g-20190305T080445_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170422T065012_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T075456_oi[S24,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9514cf9-g-20170329T083542_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9512bde-r-20170328T083211_oi[N25,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560003-r-20180516T042453_oi[S23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T075940_oi[N25,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 124.22 s, CPU: 2.69 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 175 MB, VmData: 209 MB, maxrss: 0.448448 MB Stage tims finished: 2020-06-04T09:48:07.193222 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9516c11-r-20170331T081536_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a368-g-20190305T080445_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9518570-g-20170422T065012_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T075456_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95155af-z-20170505T040040_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9514cf9-g-20170329T083542_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95173ea-g-20170406T080035_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9512bde-r-20170328T083211_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.055 s worker CPU, 405.467 s worker Wall, Wall: 124.218 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9517f92-r-20170422T064829_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95718f0-z-20150409T075940_oi[N25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_956e9f3-z-20150410T085646_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560003-r-20180516T042453_oi[S23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-04T09:48:07.217133 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03601.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03473.fits Matched 8 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/reference-custom-228720p24882.fits Stage refs : Wall: 4.23 s, CPU: 3.10 s, VmPeak: 1026 MB, VmSize: 1013 MB, VmRSS: 193 MB, VmData: 226 MB, maxrss: 0.448448 MB Stage refs finished: 2020-06-04T09:48:11.450775 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.235 s, Cores in use: 0.73, Total efficiency (on 8 cores): 9.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T09:48:11.452493 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/outlier-mask-custom-228720p24882.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/outliers-pre-custom-228720p24882.jpg Image c4d_170406_080400_ooi_g_ls9-S23 g : masking 1052 positive outlier pixels and 0 negative outlier pixels Image c4d_190305_080445_ooi_g_ls9-S23 g : masking 916 positive outlier pixels and 0 negative outlier pixels Image c4d_170422_065035_ooi_r_ls9-S24 r : masking 82 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_080220_ooi_z_ls9-N25 z : masking 216 positive outlier pixels and 0 negative outlier pixels Image c4d_150409_075734_ooi_z_ls9-S24 z : masking 68 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/outlier-mask-custom-228720p24882.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/outliers-post-custom-228720p24882.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/outliers-masked-pos-custom-228720p24882.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/outliers-masked-neg-custom-228720p24882.jpg Stage outliers : Wall: 2.91 s, CPU: 2.71 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 209 MB, VmData: 240 MB, maxrss: 0.448448 MB Stage outliers finished: 2020-06-04T09:48:14.366326 Resources for stage outliers : 0.747 s worker CPU, 0.749 s worker Wall, Wall: 2.915 s, Cores in use: 1.19, Total efficiency (on 8 cores): 14.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T09:48:14.368265 Stage halos : Wall: 3.59 s, CPU: 2.72 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 209 MB, VmData: 240 MB, maxrss: 0.448448 MB Stage halos finished: 2020-06-04T09:48:17.961082 Resources for stage halos : 0.161 s worker CPU, 5.071 s worker Wall, Wall: 3.609 s, Cores in use: 0.80, Total efficiency (on 8 cores): 10.0 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T09:48:17.978034 PSF sigmas in coadd pixels: ['1.94', '3.00', '2.43', '2.29'] Using average PSF sigma 2.4136587143472283 Gaussian PSF norm 0.11687434934237188 vs pixelized 0.10718734 average tim pixel scale / coadd scale: 1.0013107857124823 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.60', '1.97', '1.52', '2.07'] Using average PSF sigma 1.7863700332519983 Gaussian PSF norm 0.15791509403028808 vs pixelized 0.13616264 average tim pixel scale / coadd scale: 1.0012982888387174 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.58', '1.83', '1.58', '1.71'] Using average PSF sigma 1.675630261010933 Gaussian PSF norm 0.16835145457667142 vs pixelized 0.14145333 average tim pixel scale / coadd scale: 1.0012972391013213 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.16 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.448448 MB Stage fit_on_coadds finished: 2020-06-04T09:48:18.163433 Resources for stage fit_on_coadds : 0.211 s worker CPU, 0.212 s worker Wall, Wall: 0.187 s, Cores in use: 2.00, Total efficiency (on 8 cores): 25.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T09:48:18.166722 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 138 potential peaks Of 138 potential peaks: 103 in veto map, 8 cut by saddle test, 0 cut by aper test, 27 kept SED z : 27 new peaks Found 166 potential peaks Of 166 potential peaks: 152 in veto map, 11 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 99 potential peaks Of 99 potential peaks: 90 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 137 potential peaks Of 137 potential peaks: 118 in veto map, 15 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 176 potential peaks Of 176 potential peaks: 159 in veto map, 16 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 37 new sources Median coadd sky for g : 0.00020595809 Median coadd sky for r : 0.000544488 Median coadd sky for z : 0.0011440049 Stage srcs : Wall: 4.14 s, CPU: 4.10 s, VmPeak: 1026 MB, VmSize: 1023 MB, VmRSS: 211 MB, VmData: 240 MB, maxrss: 0.448448 MB Stage srcs finished: 2020-06-04T09:48:22.310178 Resources for stage srcs : 0.081 s worker CPU, 0.082 s worker Wall, Wall: 4.144 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/2MASXJ15145306+2452564-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T09:48:22.453354 Blob 1 of 5, id: 0, sources: 36, size: 245x257, npix 40806, brick X: 0,245, Y: 0,257, one pixel: 48 0 Blob 2 of 5, id: 3, sources: 1, size: 39x38, npix 916, brick X: 3,42, Y: 170,208, one pixel: 12 170 Blob 3 of 5, id: 1, sources: 1, size: 21x25, npix 349, brick X: 0,21, Y: 41,66, one pixel: 8 41 Blob 4 of 5, id: 4, sources: 1, size: 21x21, npix 270, brick X: 24,45, Y: 229,250, one pixel: 33 229 Blob 5 of 5, id: 2, sources: 1, size: 19x19, npix 217, brick X: 202,221, Y: 67,86, one pixel: 210 67 Blob 5 finished, total: Wall: 0.04 s, CPU: 0.04 s, VmPeak: 947 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145432 MB Blob 3 finished, total: Wall: 0.18 s, CPU: 0.18 s, VmPeak: 930 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.14724 MB Blob 4 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 957 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146348 MB Blob 2 finished, total: Wall: 0.52 s, CPU: 0.51 s, VmPeak: 947 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145056 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.161598, ee1=0.145287, ee2=-0.0138023 Measuring 33 iterative sources Blob 1 finished, total: Wall: 73.01 s, CPU: 72.99 s, VmPeak: 956 MB, VmSize: 720 MB, VmRSS: 150 MB, VmData: 183 MB, maxrss: 0.166804 MB Old catalog: 41 New catalog: 67 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/blobs-custom-228720p24882.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/metrics/cus/all-models-custom-228720p24882.fits Stage fitblobs : Wall: 75.96 s, CPU: 2.91 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.448448 MB Stage fitblobs finished: 2020-06-04T09:49:38.418139 Resources for stage fitblobs : 74.067 s worker CPU, 74.102 s worker Wall, Wall: 75.967 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.7 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T09:49:38.421049 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/tmp-legacysurvey-custom-228720p24882-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/tmp-legacysurvey-custom-228720p24882-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/tmp-legacysurvey-custom-228720p24882-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/tmp-legacysurvey-custom-228720p24882-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-resid.jpg Stage coadds : Wall: 3.27 s, CPU: 2.42 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 210 MB, VmData: 237 MB, maxrss: 0.448448 MB Stage coadds finished: 2020-06-04T09:49:41.686422 Resources for stage coadds : 4.934 s worker CPU, 5.159 s worker Wall, Wall: 3.266 s, Cores in use: 2.25, Total efficiency (on 8 cores): 28.1 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T09:49:41.688306 Cut to 2 unWISE tiles Reading WISE tile 2278p242 band 1 Reading WISE tile 2278p242 band 2 Reading WISE tile 2278p242 band 3 Reading WISE tile 2278p242 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2295p242 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2295p242 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2295p242 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/227/2278p242/unwise-2278p242-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2295p242 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.24 s, CPU: 0.62 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.190536 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.39 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 146 MB, VmData: 187 MB, maxrss: 0.206104 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.37 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 144 MB, VmData: 187 MB, maxrss: 0.20354 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/229/2295p242/unwise-2295p242-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.43 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 148 MB, VmData: 187 MB, maxrss: 0.206236 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/tmp-legacysurvey-custom-228720p24882-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/tmp-legacysurvey-custom-228720p24882-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.81 s, CPU: 2.72 s, VmPeak: 1026 MB, VmSize: 1019 MB, VmRSS: 211 MB, VmData: 237 MB, maxrss: 0.448448 MB Stage wise_forced finished: 2020-06-04T09:49:49.503092 Resources for stage wise_forced : 7.802 s worker CPU, 13.680 s worker Wall, Wall: 7.816 s, Cores in use: 1.35, Total efficiency (on 8 cores): 16.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T09:49:49.505039 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/coadd/cus/custom-228720p24882/legacysurvey-custom-228720p24882-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/tractor-i/cus/tractor-custom-228720p24882.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/tractor/cus/tractor-custom-228720p24882.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/228/2MASXJ15145306+2452564/tractor/cus/brick-custom-228720p24882.sha256sum Stage writecat : Wall: 3.84 s, CPU: 3.71 s, VmPeak: 1151 MB, VmSize: 1023 MB, VmRSS: 213 MB, VmData: 237 MB, maxrss: 0.448448 MB Stage writecat finished: 2020-06-04T09:49:53.348186 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.844 s, Cores in use: 0.97, Total efficiency (on 8 cores): 12.1 % Stage writecat finished All done: 94.061 s worker CPU, 504.525 s worker Wall, Wall: 230.376 s, Cores in use: 0.53, Total efficiency (on 8 cores): 6.6 % Finished galaxy 2MASXJ15145306+2452564 in 3.928 minutes.