Started working on galaxy PGC1116648 at Sat Jun 6 15:29:40 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.623419 -1.5234766000000002 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-06T15:29:42.458854 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '128.623419', '-1.5234766000000002', '--width', '257', '--height', '257', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 128.623419 -1.5234766000000002 --width 257 --height 257 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 128.623419 -1.5234766000000002 Starting process 60311 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 60312 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 60313 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB Starting process 60314 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-06T15:29:47.242342 Keeping 17 CCDs: c4d_181017_075308_ooi_r_ls9.fits.fz c4d_181017_075308_ooi_r_ls9-S8 r exptime 106.0 propid 2014B-0404 seeing 1.65 MJD 58408.329 object DECaLS_47366_r c4d_180515_225852_ooi_z_ls9.fits.fz c4d_180515_225852_ooi_z_ls9-S13 z exptime 180.0 propid 2014B-0404 seeing 0.75 MJD 58253.958 object DECaLS_47360_z c4d_190307_011757_ooi_g_ls9.fits.fz c4d_190307_011757_ooi_g_ls9-S13 g exptime 67.0 propid 2014B-0404 seeing 1.21 MJD 58549.054 object DECaLS_47360_g c4d_181104_064752_ooi_r_ls9.fits.fz c4d_181104_064752_ooi_r_ls9-S13 r exptime 65.0 propid 2014B-0404 seeing 1.21 MJD 58426.283 object DECaLS_47360_r c4d_181016_080541_ooi_g_ls9.fits.fz c4d_181016_080541_ooi_g_ls9-S13 g exptime 200.0 propid 2014B-0404 seeing 2.14 MJD 58407.337 object DECaLS_47360_g c4d_180210_055557_ooi_r_ls9.fits.fz c4d_180210_055557_ooi_r_ls9-S4 r exptime 43.0 propid 2014B-0404 seeing 0.94 MJD 58159.247 object DECaLS_15622_r c4d_180210_055709_ooi_g_ls9.fits.fz c4d_180210_055709_ooi_g_ls9-S4 g exptime 98.0 propid 2014B-0404 seeing 1.16 MJD 58159.248 object DECaLS_15622_g c4d_161221_060027_ooi_z_ls9.fits.fz c4d_161221_060027_ooi_z_ls9-S4 z exptime 80.0 propid 2014B-0404 seeing 0.97 MJD 57743.249 object DECaLS_15622_z c4d_161221_074330_ooi_z_ls9.fits.fz c4d_161221_074330_ooi_z_ls9-S3 z exptime 80.0 propid 2014B-0404 seeing 0.85 MJD 57743.320 object DECaLS_31494_z c4d_180221_044637_ooi_g_ls9.fits.fz c4d_180221_044637_ooi_g_ls9-S3 g exptime 83.0 propid 2014B-0404 seeing 1.03 MJD 58170.199 object DECaLS_31494_g c4d_180221_044528_ooi_r_ls9.fits.fz c4d_180221_044528_ooi_r_ls9-S3 r exptime 40.0 propid 2014B-0404 seeing 0.89 MJD 58170.198 object DECaLS_31494_r c4d_161221_074330_ooi_z_ls9.fits.fz c4d_161221_074330_ooi_z_ls9-S9 z exptime 80.0 propid 2014B-0404 seeing 0.83 MJD 57743.320 object DECaLS_31494_z c4d_180221_044637_ooi_g_ls9.fits.fz c4d_180221_044637_ooi_g_ls9-S9 g exptime 83.0 propid 2014B-0404 seeing 1.02 MJD 58170.199 object DECaLS_31494_g c4d_180221_044528_ooi_r_ls9.fits.fz c4d_180221_044528_ooi_r_ls9-S9 r exptime 40.0 propid 2014B-0404 seeing 0.86 MJD 58170.198 object DECaLS_31494_r c4d_161221_084426_ooi_z_ls9.fits.fz c4d_161221_084426_ooi_z_ls9-S8 z exptime 80.0 propid 2014B-0404 seeing 0.81 MJD 57743.363 object DECaLS_47366_z c4d_180225_004018_ooi_z_ls9.fits.fz c4d_180225_004018_ooi_z_ls9-S8 z exptime 96.0 propid 2014B-0404 seeing 0.75 MJD 58174.028 object DECaLS_47366_z c4d_181017_075522_ooi_g_ls9.fits.fz c4d_181017_075522_ooi_g_ls9-S8 g exptime 200.0 propid 2014B-0404 seeing 1.70 MJD 58408.330 object DECaLS_47366_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a3c6-g-20190307T011757_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T064752_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181017T075308_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181016T080541_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a2af-g-20180210T055709_oi[S4,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955e646-z-20180515T225852_oi[S13,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95424b2-z-20161221T055817_oi[S4,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180210T055557_oi[S4,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T074120_oi[S3,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bd60-g-20180221T044637_oi[S3,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ba12-r-20180221T044528_oi[S3,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T074120_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T084217_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181017T075522_oi[S8,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ba12-r-20180221T044528_oi[S9,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T004018_oi[S8,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 165.43 s, CPU: 3.41 s, VmPeak: 996 MB, VmSize: 996 MB, VmRSS: 176 MB, VmData: 210 MB, maxrss: 0.454604 MB Stage tims finished: 2020-06-06T15:32:32.675263 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955e646-z-20180515T225852_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952bd60-g-20180221T044637_oi[S3,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T084217_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181017T075308_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952a2af-g-20180210T055709_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T074120_oi[S3,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ba12-r-20180221T044528_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953a3c6-g-20190307T011757_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181016T080541_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95424b2-z-20161221T055817_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ba12-r-20180221T044528_oi[S3,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95285f9-z-20180225T004018_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T064752_oi[S13,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9529f0d-r-20180210T055557_oi[S4,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9542040-z-20161221T074120_oi[S9,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537f22-g-20181017T075522_oi[S8,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Resources for stage tims : 5.127 s worker CPU, 612.931 s worker Wall, Wall: 165.434 s, Cores in use: 0.05, Total efficiency (on 4 cores): 1.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-06T15:32:33.464684 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06381.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06254.fits Matched 13 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/reference-custom-128623m01523.fits Stage refs : Wall: 6.78 s, CPU: 5.67 s, VmPeak: 1043 MB, VmSize: 1037 MB, VmRSS: 220 MB, VmData: 251 MB, maxrss: 0.454604 MB Stage refs finished: 2020-06-06T15:32:40.244860 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.781 s, Cores in use: 0.84, Total efficiency (on 4 cores): 20.9 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-06T15:32:40.246395 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/outlier-mask-custom-128623m01523.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/outliers-pre-custom-128623m01523.jpg Image c4d_181016_080541_ooi_g_ls9-S13 g : masking 327 positive outlier pixels and 0 negative outlier pixels Image c4d_190307_011757_ooi_g_ls9-S13 g : masking 0 positive outlier pixels and 132 negative outlier pixels Image c4d_181017_075522_ooi_g_ls9-S8 g : masking 124 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_075308_ooi_r_ls9-S8 r : masking 62 positive outlier pixels and 0 negative outlier pixels Image c4d_180515_225852_ooi_z_ls9-S13 z : masking 80 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/outlier-mask-custom-128623m01523.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/outliers-post-custom-128623m01523.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/outliers-masked-pos-custom-128623m01523.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/outliers-masked-neg-custom-128623m01523.jpg Stage outliers : Wall: 3.41 s, CPU: 2.74 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.454604 MB Stage outliers finished: 2020-06-06T15:32:43.653635 Resources for stage outliers : 0.953 s worker CPU, 0.961 s worker Wall, Wall: 3.408 s, Cores in use: 1.08, Total efficiency (on 4 cores): 27.1 % Stage outliers finished Running stage halos Running stage halos at 2020-06-06T15:32:43.655331 Stage halos : Wall: 4.58 s, CPU: 2.53 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 232 MB, VmData: 261 MB, maxrss: 0.454604 MB Stage halos finished: 2020-06-06T15:32:48.235310 Resources for stage halos : 0.464 s worker CPU, 7.068 s worker Wall, Wall: 4.581 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-06T15:32:48.237049 PSF sigmas in coadd pixels: ['1.96', '3.47', '1.88', '1.67', '2.76'] Using average PSF sigma 2.348841148088206 Gaussian PSF norm 0.12009956143840711 vs pixelized 0.09597068 average tim pixel scale / coadd scale: 1.001205477056641 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.68', '1.97', '1.53', '1.45'] Using average PSF sigma 1.9061324628378236 Gaussian PSF norm 0.14799327815544328 vs pixelized 0.123112686 average tim pixel scale / coadd scale: 1.001269770972786 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.22', '1.57', '1.38', '1.32', '1.22'] Using average PSF sigma 1.3412406701250277 Gaussian PSF norm 0.21032376817769916 vs pixelized 0.16863312 average tim pixel scale / coadd scale: 1.0010636925256549 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.62 s, CPU: 0.19 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 234 MB, VmData: 262 MB, maxrss: 0.454604 MB Stage fit_on_coadds finished: 2020-06-06T15:32:48.856396 Resources for stage fit_on_coadds : 0.210 s worker CPU, 0.213 s worker Wall, Wall: 0.620 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-06T15:32:48.859189 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 39 potential peaks Of 39 potential peaks: 20 in veto map, 5 cut by saddle test, 0 cut by aper test, 14 kept SED z : 14 new peaks Found 24 potential peaks Of 24 potential peaks: 20 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 20 potential peaks Of 20 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 31 potential peaks Of 31 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 37 potential peaks Of 37 potential peaks: 32 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 21 new sources Median coadd sky for g : -5.901906e-05 Median coadd sky for r : -4.7352703e-05 Median coadd sky for z : 6.30153e-05 Stage srcs : Wall: 3.28 s, CPU: 3.24 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.454604 MB Stage srcs finished: 2020-06-06T15:32:52.143370 Resources for stage srcs : 0.104 s worker CPU, 0.104 s worker Wall, Wall: 3.285 s, Cores in use: 1.02, Total efficiency (on 4 cores): 25.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/PGC1116648-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-06T15:32:52.155064 Blob 1 of 17, id: 5, sources: 4, size: 118x158, npix 11026, brick X: 83,201, Y: 41,199, one pixel: 131 41 Blob 2 of 17, id: 12, sources: 6, size: 81x115, npix 5445, brick X: 0,81, Y: 142,257, one pixel: 14 142 Blob 3 of 17, id: 1, sources: 2, size: 63x53, npix 1792, brick X: 117,180, Y: 0,53, one pixel: 135 0 Blob 4 of 17, id: 15, sources: 1, size: 49x40, npix 1370, brick X: 87,136, Y: 201,241, one pixel: 103 201 Blob 5 of 17, id: 10, sources: 1, size: 37x37, npix 932, brick X: 6,43, Y: 98,135, one pixel: 21 98 Measuring 2 iterative sources Blob 4 finished, total: Wall: 1.81 s, CPU: 1.81 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14886 MB Blob 6 of 17, id: 2, sources: 2, size: 56x22, npix 918, brick X: 164,220, Y: 0,22, one pixel: 171 0 Blob 3 finished, total: Wall: 2.40 s, CPU: 2.40 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146776 MB Blob 7 of 17, id: 13, sources: 2, size: 45x34, npix 800, brick X: 203,248, Y: 149,183, one pixel: 237 149 Blob 5 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14886 MB Blob 8 of 17, id: 16, sources: 1, size: 28x27, npix 486, brick X: 169,197, Y: 205,232, one pixel: 180 205 Measuring 1 iterative sources Blob 6 finished, total: Wall: 2.22 s, CPU: 2.22 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146776 MB Blob 9 of 17, id: 0, sources: 1, size: 33x19, npix 461, brick X: 21,54, Y: 0,19, one pixel: 23 0 Blob 8 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148584 MB Blob 10 of 17, id: 9, sources: 1, size: 24x26, npix 431, brick X: 233,257, Y: 88,114, one pixel: 244 88 Blob 2 finished, total: Wall: 5.65 s, CPU: 5.65 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14924 MB Blob 11 of 17, id: 6, sources: 1, size: 21x21, npix 250, brick X: 235,256, Y: 41,62, one pixel: 244 41 Blob 7 finished, total: Wall: 3.56 s, CPU: 3.56 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14886 MB Blob 12 of 17, id: 7, sources: 1, size: 23x22, npix 248, brick X: 20,43, Y: 52,74, one pixel: 28 52 Blob 11 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14886 MB Blob 13 of 17, id: 14, sources: 1, size: 21x21, npix 248, brick X: 73,94, Y: 185,206, one pixel: 83 185 Blob 9 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148584 MB Blob 14 of 17, id: 3, sources: 1, size: 20x20, npix 238, brick X: 216,236, Y: 18,38, one pixel: 224 18 Blob 10 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150052 MB Blob 15 of 17, id: 8, sources: 1, size: 20x20, npix 238, brick X: 73,93, Y: 55,75, one pixel: 82 55 Blob 13 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148584 MB Blob 16 of 17, id: 4, sources: 1, size: 22x18, npix 234, brick X: 6,28, Y: 34,52, one pixel: 15 34 Blob 12 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14886 MB Blob 17 of 17, id: 11, sources: 1, size: 18x18, npix 180, brick X: 218,236, Y: 120,138, one pixel: 226 120 Blob 15 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148584 MB Blob 16 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 957 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.14886 MB Blob 14 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 966 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150052 MB Blob 17 finished, total: Wall: 0.22 s, CPU: 0.22 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148584 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.342793, ee1=0.0979185, ee2=-0.0453396 Measuring 1 iterative sources Blob 1 finished, total: Wall: 8.54 s, CPU: 8.54 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.150416 MB Old catalog: 35 New catalog: 27 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/blobs-custom-128623m01523.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/metrics/cus/all-models-custom-128623m01523.fits Stage fitblobs : Wall: 11.30 s, CPU: 2.79 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.454604 MB Stage fitblobs finished: 2020-06-06T15:33:03.454425 Resources for stage fitblobs : 31.111 s worker CPU, 31.133 s worker Wall, Wall: 11.300 s, Cores in use: 3.00, Total efficiency (on 4 cores): 75.0 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-06T15:33:03.456118 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/tmp-legacysurvey-custom-128623m01523-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/tmp-legacysurvey-custom-128623m01523-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/tmp-legacysurvey-custom-128623m01523-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/tmp-legacysurvey-custom-128623m01523-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-resid.jpg Stage coadds : Wall: 2.67 s, CPU: 1.94 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 235 MB, VmData: 262 MB, maxrss: 0.454604 MB Stage coadds finished: 2020-06-06T15:33:06.129221 Resources for stage coadds : 2.247 s worker CPU, 2.378 s worker Wall, Wall: 2.674 s, Cores in use: 1.57, Total efficiency (on 4 cores): 39.1 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-06T15:33:06.130540 Cut to 1 unWISE tiles Reading WISE tile 1285m016 band 1 Reading WISE tile 1285m016 band 2 Reading WISE tile 1285m016 band 3 Reading WISE tile 1285m016 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 962 MB, VmSize: 797 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.191416 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.206532 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 966 MB, VmSize: 796 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210848 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/128/1285m016/unwise-1285m016-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 957 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210272 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/tmp-legacysurvey-custom-128623m01523-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/tmp-legacysurvey-custom-128623m01523-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.81 s, CPU: 1.26 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 236 MB, VmData: 262 MB, maxrss: 0.454604 MB Stage wise_forced finished: 2020-06-06T15:33:09.937164 Resources for stage wise_forced : 3.649 s worker CPU, 8.859 s worker Wall, Wall: 3.808 s, Cores in use: 1.29, Total efficiency (on 4 cores): 32.3 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-06T15:33:09.938727 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/coadd/cus/custom-128623m01523/legacysurvey-custom-128623m01523-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/tractor-i/cus/tractor-custom-128623m01523.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/tractor/cus/tractor-custom-128623m01523.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/128/PGC1116648/tractor/cus/brick-custom-128623m01523.sha256sum Stage writecat : Wall: 3.68 s, CPU: 3.50 s, VmPeak: 1179 MB, VmSize: 1051 MB, VmRSS: 238 MB, VmData: 262 MB, maxrss: 0.454604 MB Stage writecat finished: 2020-06-06T15:33:13.621328 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.684 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.8 % Stage writecat finished All done: 43.866 s worker CPU, 663.649 s worker Wall, Wall: 206.385 s, Cores in use: 0.34, Total efficiency (on 4 cores): 8.6 % Finished galaxy PGC1116648 in 3.555 minutes.