Started working on galaxy AGC268148 at Thu Jun 4 06:02:11 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.714513 9.6733321 --width 297 --height 297 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T06:02:12.475627 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '243.714513', '9.6733321', '--width', '297', '--height', '297', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 243.714513 9.6733321 --width 297 --height 297 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 243.714513 9.6733321 Starting process 53559 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 53560 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 53561 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 53562 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 53563 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057324 MB Starting process 53564 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 53565 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 53566 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T06:02:16.509288 Keeping 11 CCDs: c4d_180809_000228_ooi_r_ls9.fits.fz c4d_180809_000228_ooi_r_ls9-N5 r exptime 64.0 propid 2014B-0404 seeing 1.25 MJD 58339.002 object DECaLS_15136_r c4d_140811_020502_ooi_z_ls9.fits.fz c4d_140811_020502_ooi_z_ls9-N5 z exptime 132.0 propid 2014B-0404 seeing 1.61 MJD 56880.085 object DECaLS_15136_z c4d_140816_004706_ooi_g_ls9.fits.fz c4d_140816_004706_ooi_g_ls9-N5 g exptime 75.0 propid 2014B-0404 seeing 0.99 MJD 56885.031 object DECaLS_15136_g c4d_140818_011819_ooi_z_ls9.fits.fz c4d_140818_011819_ooi_z_ls9-N3 z exptime 120.0 propid 2014B-0404 seeing 1.44 MJD 56887.052 object DECaLS_46880_z c4d_140817_012118_ooi_r_ls9.fits.fz c4d_140817_012118_ooi_r_ls9-N3 r exptime 65.0 propid 2014B-0404 seeing 1.75 MJD 56886.055 object DECaLS_46880_r c4d_140816_014035_ooi_g_ls9.fits.fz c4d_140816_014035_ooi_g_ls9-N3 g exptime 76.0 propid 2014B-0404 seeing 1.12 MJD 56885.068 object DECaLS_46880_g c4d_140816_000811_ooi_g_ls9.fits.fz c4d_140816_000811_ooi_g_ls9-N4 g exptime 75.0 propid 2014B-0404 seeing 0.96 MJD 56885.004 object DECaLS_31008_g c4d_140817_000108_ooi_r_ls9.fits.fz c4d_140817_000108_ooi_r_ls9-N4 r exptime 65.0 propid 2014B-0404 seeing 1.45 MJD 56885.999 object DECaLS_31008_r c4d_140818_001611_ooi_z_ls9.fits.fz c4d_140818_001611_ooi_z_ls9-N4 z exptime 116.0 propid 2014B-0404 seeing 1.00 MJD 56887.009 object DECaLS_31008_z c4d_140817_003953_ooi_r_ls9.fits.fz c4d_140817_003953_ooi_r_ls9-N5 r exptime 65.0 propid 2014B-0404 seeing 1.69 MJD 56886.026 object DECaLS_15136_r c4d_180920_235339_ooi_z_ls9.fits.fz c4d_180920_235339_ooi_z_ls9-N5 z exptime 216.0 propid 2014B-0404 seeing 1.04 MJD 58381.996 object DECaLS_15136_z The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T235906_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T011922_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95499d2-z-20140811T020200_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T011518_oi[N3,noinherit][2046,4094][real]: DECaLS_4 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140817T003757_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T001322_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180920T235339_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530fec-r-20180809T000228_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T000605_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T004458_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T013827_oi[N3,noinherit][2046,4094][real]: DECaLS_4 Stage tims : Wall: 58.93 s, CPU: 2.94 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.452616 MB Stage tims finished: 2020-06-04T06:03:15.434784 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T011518_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140816T235906_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d605-z-20140818T001322_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548bbb-r-20140817T011922_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9548395-r-20140817T003757_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95499d2-z-20140811T020200_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952f80e-z-20180920T235339_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530fec-r-20180809T000228_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T000605_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9549d4b-g-20140816T004458_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Resources for stage tims : 5.655 s worker CPU, 303.835 s worker Wall, Wall: 58.927 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a39a-g-20140816T013827_oi[N3,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] Running stage refs at 2020-06-04T06:03:15.461763 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05142.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-05015.fits Matched 1 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/reference-custom-243714p09673.fits Stage refs : Wall: 6.46 s, CPU: 5.42 s, VmPeak: 1041 MB, VmSize: 1035 MB, VmRSS: 221 MB, VmData: 252 MB, maxrss: 0.452616 MB Stage refs finished: 2020-06-04T06:03:21.918913 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.458 s, Cores in use: 0.84, Total efficiency (on 8 cores): 10.5 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T06:03:21.920876 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/outlier-mask-custom-243714p09673.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/outliers-pre-custom-243714p09673.jpg Image c4d_140816_000811_ooi_g_ls9-N4 g : masking 416 positive outlier pixels and 0 negative outlier pixels Image c4d_140817_012118_ooi_r_ls9-N3 r : masking 60 positive outlier pixels and 0 negative outlier pixels Image c4d_180809_000228_ooi_r_ls9-N5 r : masking 94 positive outlier pixels and 0 negative outlier pixels Image c4d_140817_003953_ooi_r_ls9-N5 r : masking 99 positive outlier pixels and 0 negative outlier pixels Image c4d_140818_001611_ooi_z_ls9-N4 z : masking 311 positive outlier pixels and 0 negative outlier pixels Image c4d_140811_020502_ooi_z_ls9-N5 z : masking 574 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/outlier-mask-custom-243714p09673.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/outliers-post-custom-243714p09673.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/outliers-masked-pos-custom-243714p09673.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/outliers-masked-neg-custom-243714p09673.jpg Stage outliers : Wall: 3.28 s, CPU: 2.97 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.452616 MB Stage outliers finished: 2020-06-04T06:03:25.196941 Resources for stage outliers : 1.312 s worker CPU, 1.313 s worker Wall, Wall: 3.277 s, Cores in use: 1.31, Total efficiency (on 8 cores): 16.3 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T06:03:25.199061 Stage halos : Wall: 5.74 s, CPU: 4.67 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 239 MB, VmData: 267 MB, maxrss: 0.452616 MB Stage halos finished: 2020-06-04T06:03:30.942955 Resources for stage halos : 0.128 s worker CPU, 6.071 s worker Wall, Wall: 5.745 s, Cores in use: 0.84, Total efficiency (on 8 cores): 10.4 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T06:03:30.945268 PSF sigmas in coadd pixels: ['1.60', '1.81', '1.56'] Using average PSF sigma 1.6593244374493403 Gaussian PSF norm 0.1700058080308304 vs pixelized 0.13942266 average tim pixel scale / coadd scale: 1.0010973641023266 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.03', '2.84', '2.35', '2.74'] Using average PSF sigma 2.4892263667578094 Gaussian PSF norm 0.11332629106821797 vs pixelized 0.09163381 average tim pixel scale / coadd scale: 1.0010889911969043 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.61', '2.34', '1.63', '1.69'] Using average PSF sigma 2.0694029537027645 Gaussian PSF norm 0.13631699484584595 vs pixelized 0.10936621 average tim pixel scale / coadd scale: 1.0011032376329962 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.24 s, CPU: 0.22 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 242 MB, VmData: 268 MB, maxrss: 0.452616 MB Stage fit_on_coadds finished: 2020-06-04T06:03:31.185326 Resources for stage fit_on_coadds : 0.289 s worker CPU, 0.289 s worker Wall, Wall: 0.241 s, Cores in use: 2.12, Total efficiency (on 8 cores): 26.5 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T06:03:31.188210 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 65 potential peaks Of 65 potential peaks: 37 in veto map, 8 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 40 potential peaks Of 40 potential peaks: 30 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept SED r : 3 new peaks Found 84 potential peaks Of 84 potential peaks: 71 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 63 potential peaks Of 63 potential peaks: 51 in veto map, 10 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 57 potential peaks Of 57 potential peaks: 48 in veto map, 8 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 30 new sources Median coadd sky for g : -1.8440174e-05 Median coadd sky for r : 9.78247e-05 Median coadd sky for z : 0.00013880891 Stage srcs : Wall: 3.65 s, CPU: 3.60 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 242 MB, VmData: 268 MB, maxrss: 0.452616 MB Stage srcs finished: 2020-06-04T06:03:34.836787 Resources for stage srcs : 0.093 s worker CPU, 0.093 s worker Wall, Wall: 3.650 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.7 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/AGC268148-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T06:03:34.852079 Blob 1 of 19, id: 9, sources: 11, size: 278x130, npix 23405, brick X: 0,278, Y: 81,211, one pixel: 87 81 Blob 2 of 19, id: 14, sources: 2, size: 39x45, npix 1318, brick X: 210,249, Y: 252,297, one pixel: 226 252 Blob 3 of 19, id: 11, sources: 2, size: 37x53, npix 1233, brick X: 215,252, Y: 198,251, one pixel: 237 198 Blob 4 of 19, id: 0, sources: 2, size: 39x39, npix 1034, brick X: 81,120, Y: 0,39, one pixel: 89 0 Blob 5 of 19, id: 8, sources: 1, size: 39x32, npix 831, brick X: 189,228, Y: 71,103, one pixel: 201 71 Blob 6 of 19, id: 6, sources: 1, size: 30x35, npix 627, brick X: 156,186, Y: 54,89, one pixel: 175 54 Blob 7 of 19, id: 1, sources: 1, size: 30x28, npix 591, brick X: 173,203, Y: 0,28, one pixel: 183 0 Blob 8 of 19, id: 15, sources: 1, size: 30x24, npix 538, brick X: 26,56, Y: 273,297, one pixel: 37 273 Blob 9 of 19, id: 18, sources: 1, size: 27x20, npix 405, brick X: 112,139, Y: 277,297, one pixel: 121 277 Blob 7 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145184 MB Blob 10 of 19, id: 4, sources: 1, size: 25x25, npix 392, brick X: 42,67, Y: 27,52, one pixel: 53 27 Blob 8 finished, total: Wall: 1.17 s, CPU: 1.16 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145808 MB Blob 11 of 19, id: 17, sources: 1, size: 28x20, npix 377, brick X: 59,87, Y: 277,297, one pixel: 70 277 Blob 6 finished, total: Wall: 1.33 s, CPU: 1.33 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145544 MB Blob 12 of 19, id: 3, sources: 1, size: 24x24, npix 361, brick X: 159,183, Y: 25,49, one pixel: 170 25 Measuring 1 iterative sources Blob 10 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145808 MB Blob 13 of 19, id: 12, sources: 1, size: 23x24, npix 327, brick X: 250,273, Y: 211,235, one pixel: 260 211 Blob 5 finished, total: Wall: 1.67 s, CPU: 1.67 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148392 MB Blob 14 of 19, id: 5, sources: 1, size: 23x22, npix 312, brick X: 208,231, Y: 41,63, one pixel: 218 41 Blob 2 finished, total: Wall: 1.88 s, CPU: 1.87 s, VmPeak: 927 MB, VmSize: 715 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142644 MB Blob 15 of 19, id: 2, sources: 1, size: 22x22, npix 303, brick X: 138,160, Y: 2,24, one pixel: 147 2 Blob 4 finished, total: Wall: 1.97 s, CPU: 1.97 s, VmPeak: 927 MB, VmSize: 715 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142456 MB Blob 16 of 19, id: 13, sources: 1, size: 21x22, npix 271, brick X: 188,209, Y: 244,266, one pixel: 197 244 Blob 13 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148392 MB Blob 17 of 19, id: 10, sources: 1, size: 20x20, npix 218, brick X: 259,279, Y: 186,206, one pixel: 269 186 Blob 11 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145544 MB Blob 18 of 19, id: 16, sources: 1, size: 19x18, npix 198, brick X: 161,180, Y: 276,294, one pixel: 169 276 Blob 12 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145808 MB Blob 19 of 19, id: 7, sources: 1, size: 17x17, npix 145, brick X: 21,38, Y: 59,76, one pixel: 29 59 Blob 17 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145544 MB Blob 19 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 933 MB, VmSize: 719 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145544 MB Blob 9 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 932 MB, VmSize: 719 MB, VmRSS: 144 MB, VmData: 182 MB, maxrss: 0.147424 MB Blob 16 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 958 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148392 MB Blob 15 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 927 MB, VmSize: 715 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142456 MB Blob 18 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.145808 MB Blob 14 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 927 MB, VmSize: 715 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.142644 MB Measuring 1 iterative sources Blob 3 finished, total: Wall: 3.58 s, CPU: 3.58 s, VmPeak: 927 MB, VmSize: 715 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.143648 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=2.5625, ee1=-0.511581, ee2=-0.304675 Measuring 8 iterative sources Blob 1 finished, total: Wall: 18.41 s, CPU: 18.40 s, VmPeak: 953 MB, VmSize: 743 MB, VmRSS: 178 MB, VmData: 206 MB, maxrss: 0.18178 MB Old catalog: 35 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/blobs-custom-243714p09673.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/metrics/cus/all-models-custom-243714p09673.fits Stage fitblobs : Wall: 23.18 s, CPU: 4.79 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 242 MB, VmData: 268 MB, maxrss: 0.452616 MB Stage fitblobs finished: 2020-06-04T06:03:58.031379 Resources for stage fitblobs : 36.866 s worker CPU, 36.916 s worker Wall, Wall: 23.182 s, Cores in use: 1.80, Total efficiency (on 8 cores): 22.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T06:03:58.034661 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/tmp-legacysurvey-custom-243714p09673-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/tmp-legacysurvey-custom-243714p09673-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/tmp-legacysurvey-custom-243714p09673-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/tmp-legacysurvey-custom-243714p09673-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-resid.jpg Stage coadds : Wall: 4.40 s, CPU: 3.57 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 243 MB, VmData: 269 MB, maxrss: 0.452616 MB Stage coadds finished: 2020-06-04T06:04:02.430050 Resources for stage coadds : 4.306 s worker CPU, 4.699 s worker Wall, Wall: 4.396 s, Cores in use: 1.79, Total efficiency (on 8 cores): 22.4 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T06:04:02.431825 Cut to 1 unWISE tiles Reading WISE tile 2435p090 band 3 Reading WISE tile 2435p090 band 1 Reading WISE tile 2435p090 band 2 Reading WISE tile 2435p090 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 932 MB, VmSize: 792 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.209456 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 958 MB, VmSize: 792 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204924 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 953 MB, VmSize: 797 MB, VmRSS: 154 MB, VmData: 176 MB, maxrss: 0.218972 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/243/2435p090/unwise-2435p090-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 927 MB, VmSize: 795 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.189596 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/tmp-legacysurvey-custom-243714p09673-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/tmp-legacysurvey-custom-243714p09673-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 6.83 s, CPU: 2.70 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 244 MB, VmData: 269 MB, maxrss: 0.452616 MB Stage wise_forced finished: 2020-06-04T06:04:09.259226 Resources for stage wise_forced : 3.120 s worker CPU, 7.320 s worker Wall, Wall: 6.829 s, Cores in use: 0.85, Total efficiency (on 8 cores): 10.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T06:04:09.261165 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/coadd/cus/custom-243714p09673/legacysurvey-custom-243714p09673-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/tractor-i/cus/tractor-custom-243714p09673.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/tractor/cus/tractor-custom-243714p09673.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/243/AGC268148/tractor/cus/brick-custom-243714p09673.sha256sum Stage writecat : Wall: 3.50 s, CPU: 3.31 s, VmPeak: 1177 MB, VmSize: 1049 MB, VmRSS: 246 MB, VmData: 269 MB, maxrss: 0.452616 MB Stage writecat finished: 2020-06-04T06:04:12.760311 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.500 s, Cores in use: 0.95, Total efficiency (on 8 cores): 11.8 % Stage writecat finished All done: 51.771 s worker CPU, 360.538 s worker Wall, Wall: 116.257 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.2 % Finished galaxy AGC268148 in 2.029 minutes.