Started working on galaxy PGC1419697 at Sun Jun 7 07:28:59 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.87003500000003 12.9584 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-07T07:29:08.443842 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.87003500000003', '12.9584', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.87003500000003 12.9584 --width 295 --height 295 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 313.87003500000003 12.9584 Starting process 25720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.05732 MB Starting process 25724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.05732 MB Starting process 25731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057308 MB Starting process 25741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 698 MB, VmSize: 698 MB, VmRSS: 56 MB, VmData: 129 MB, maxrss: 0.057324 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-07T07:29:08.914487 Keeping 8 CCDs: c4d_170917_004518_ooi_r_ls9.fits.fz c4d_170917_004518_ooi_r_ls9-S8 r exptime 108.0 propid 2014B-0404 seeing 1.03 MJD 58013.031 object DECaLS_5096_r c4d_170521_103258_ooi_z_ls9.fits.fz c4d_170521_103258_ooi_z_ls9-S8 z exptime 100.0 propid 2014B-0404 seeing 0.84 MJD 57894.438 object DECaLS_5096_z c4d_160813_030831_ooi_z_ls9.fits.fz c4d_160813_030831_ooi_z_ls9-S8 z exptime 89.0 propid 2014B-0404 seeing 0.99 MJD 57613.129 object DECaLS_5096_z c4d_170922_011844_ooi_g_ls9.fits.fz c4d_170922_011844_ooi_g_ls9-S8 g exptime 200.0 propid 2014B-0404 seeing 1.24 MJD 58018.055 object DECaLS_5096_g c4d_170917_004518_ooi_r_ls9.fits.fz c4d_170917_004518_ooi_r_ls9-S14 r exptime 108.0 propid 2014B-0404 seeing 1.02 MJD 58013.031 object DECaLS_5096_r c4d_170521_103258_ooi_z_ls9.fits.fz c4d_170521_103258_ooi_z_ls9-S14 z exptime 100.0 propid 2014B-0404 seeing 0.83 MJD 57894.438 object DECaLS_5096_z c4d_160813_030831_ooi_z_ls9.fits.fz c4d_160813_030831_ooi_z_ls9-S14 z exptime 89.0 propid 2014B-0404 seeing 0.97 MJD 57613.129 object DECaLS_5096_z c4d_170922_011844_ooi_g_ls9.fits.fz c4d_170922_011844_ooi_g_ls9-S14 g exptime 200.0 propid 2014B-0404 seeing 1.25 MJD 58018.055 object DECaLS_5096_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S14,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 186.49 s, CPU: 1.23 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 168 MB, VmData: 202 MB, maxrss: 0.454828 MB Stage tims finished: 2020-06-07T07:32:15.403217 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 3.232 s worker CPU, 600.641 s worker Wall, Wall: 186.490 s, Cores in use: 0.02, Total efficiency (on 4 cores): 0.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-tims.p Running stage refs Running stage refs at 2020-06-07T07:32:15.419836 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04784.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04783.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04655.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04911.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/reference-custom-313870p12958.fits Stage refs : Wall: 28.27 s, CPU: 27.10 s, VmPeak: 1100 MB, VmSize: 1093 MB, VmRSS: 269 MB, VmData: 300 MB, maxrss: 0.454828 MB Stage refs finished: 2020-06-07T07:32:43.694720 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 28.276 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-07T07:32:43.696204 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outlier-mask-custom-313870p12958.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-pre-custom-313870p12958.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outlier-mask-custom-313870p12958.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-post-custom-313870p12958.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-masked-pos-custom-313870p12958.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-masked-neg-custom-313870p12958.jpg Stage outliers : Wall: 11.82 s, CPU: 11.73 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 276 MB, VmData: 305 MB, maxrss: 0.454828 MB Stage outliers finished: 2020-06-07T07:32:55.520746 Resources for stage outliers : 0.196 s worker CPU, 0.196 s worker Wall, Wall: 11.825 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 % Stage outliers finished Running stage halos Running stage halos at 2020-06-07T07:32:55.522334 Stage halos : Wall: 26.40 s, CPU: 10.87 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 276 MB, VmData: 305 MB, maxrss: 0.454828 MB Stage halos finished: 2020-06-07T07:33:21.927155 Resources for stage halos : 0.178 s worker CPU, 35.352 s worker Wall, Wall: 26.406 s, Cores in use: 0.42, Total efficiency (on 4 cores): 10.5 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-07T07:33:21.929436 PSF sigmas in coadd pixels: ['2.02', '2.02'] Using average PSF sigma 2.0205562857822765 Gaussian PSF norm 0.13961243928657133 vs pixelized 0.11458684 average tim pixel scale / coadd scale: 1.001088266378226 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.66'] Using average PSF sigma 1.6669139518283425 Gaussian PSF norm 0.16923176596156303 vs pixelized 0.13557015 average tim pixel scale / coadd scale: 1.001132255373878 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.36', '1.61', '1.35', '1.58'] Using average PSF sigma 1.475321117155906 Gaussian PSF norm 0.1912090788191894 vs pixelized 0.15123096 average tim pixel scale / coadd scale: 1.0011488512222377 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.08 s, CPU: 0.06 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 278 MB, VmData: 305 MB, maxrss: 0.454828 MB Stage fit_on_coadds finished: 2020-06-07T07:33:22.011626 Resources for stage fit_on_coadds : 0.055 s worker CPU, 0.055 s worker Wall, Wall: 0.083 s, Cores in use: 1.44, Total efficiency (on 4 cores): 36.1 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-07T07:33:22.013564 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 56943 potential peaks Of 56943 potential peaks: 56925 in veto map, 2 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 59133 potential peaks Of 59133 potential peaks: 59132 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 58530 potential peaks Of 58530 potential peaks: 58526 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 52309 potential peaks Of 52309 potential peaks: 52308 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 52322 potential peaks Of 52322 potential peaks: 52320 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 17 new sources Median coadd sky for g : -6.946831e-05 Median coadd sky for r : -0.00015053587 Median coadd sky for z : 0.0011379544 Stage srcs : Wall: 14.65 s, CPU: 13.11 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 281 MB, VmData: 308 MB, maxrss: 0.454828 MB Stage srcs finished: 2020-06-07T07:33:36.663829 Resources for stage srcs : 4.025 s worker CPU, 4.030 s worker Wall, Wall: 14.651 s, Cores in use: 1.17, Total efficiency (on 4 cores): 29.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-07T07:33:36.702666 Blob 1 of 3, id: 0, sources: 35, size: 295x295, npix 82793, brick X: 0,295, Y: 0,295, one pixel: 0 0 Blob 2 of 3, id: 2, sources: 1, size: 20x15, npix 208, brick X: 82,102, Y: 280,295, one pixel: 90 280 Blob 3 of 3, id: 1, sources: 1, size: 15x17, npix 185, brick X: 0,15, Y: 278,295, one pixel: 5 278 Blob 2 finished, total: Wall: 0.80 s, CPU: 0.75 s, VmPeak: 1023 MB, VmSize: 785 MB, VmRSS: 144 MB, VmData: 184 MB, maxrss: 0.147664 MB Blob 3 finished, total: Wall: 1.00 s, CPU: 0.94 s, VmPeak: 1023 MB, VmSize: 779 MB, VmRSS: 139 MB, VmData: 178 MB, maxrss: 0.141848 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.84996, 12.94727), pm (1.9, -13.0), parallax 2.716 with NanoMaggies: g=13.5, r=12.8, z=12.5 Reset brightness to NanoMaggies: g=13.5, r=12.8, z=12.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87974, 12.95897), pm (-1.5, -3.8), parallax 0.776 with NanoMaggies: g=15.4, r=14.9, z=14.7 Reset brightness to NanoMaggies: g=15.4, r=14.9, z=14.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.88273, 12.95452), pm (1.3, -9.1), parallax 0.421 with NanoMaggies: g=16.5, r=15.9, z=15.7 Reset brightness to NanoMaggies: g=16.5, r=15.9, z=15.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.88379, 12.96589), pm (-4.2, -6.1), parallax 0.048 with NanoMaggies: g=16.8, r=16, z=15.6 Reset brightness to NanoMaggies: g=16.8, r=16, z=15.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87569, 12.95945), pm (-1.6, -6.2), parallax 0.305 with NanoMaggies: g=18.4, r=17.9, z=17.6 Reset brightness to NanoMaggies: g=18.4, r=17.9, z=17.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.85609, ee1=0.502855, ee2=-0.106885 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86458, 12.96073), pm (-12.3, -19.6), parallax 1.005 with NanoMaggies: g=20.7, r=19.3, z=18.3 Reset brightness to NanoMaggies: g=20.7, r=19.3, z=18.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.85996, 12.94616), pm (1.3, -3.2), parallax 0.955 with NanoMaggies: g=(flux -43.9), r=(flux -7.46e+03), z=(flux -84.2) Reset brightness to NanoMaggies: g=20.2, r=19.1, z=18.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87112, 12.95438), pm (0.3, -3.7), parallax 0.443 with NanoMaggies: g=19.6, r=19.1, z=18.9 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86033, 12.96410), pm (-3.7, -6.5), parallax 0.150 with NanoMaggies: g=20, r=(flux -27), z=14.2 Reset brightness to NanoMaggies: g=20, r=19.2, z=18.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.85832, 12.94631), pm (-4.6, -3.7), parallax 0.865 with NanoMaggies: g=(flux -1.37), r=13.2, z=15.3 Reset brightness to NanoMaggies: g=19.9, r=19.3, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86238, 12.95382), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.6, r=19.5, z=18.9 Reset brightness to NanoMaggies: g=20.6, r=19.5, z=18.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86195, 12.95336), pm (-2.8, -11.8), parallax 0.868 with NanoMaggies: g=21.3, r=19.9, z=19 Reset brightness to NanoMaggies: g=21.3, r=19.9, z=19 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87317, 12.95898), pm (1.6, 0.9), parallax 0.193 with NanoMaggies: g=21.1, r=19.9, z=19.3 Reset brightness to NanoMaggies: g=21.1, r=19.9, z=19.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87915, 12.94581), pm (1.0, -5.3), parallax -0.856 with NanoMaggies: g=17.1, r=(flux -109), z=15.2 Reset brightness to NanoMaggies: g=20.6, r=20.1, z=19.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86878, 12.94749), pm (-10.9, -5.3), parallax 2.285 with NanoMaggies: g=21.7, r=20.9, z=19.5 Reset brightness to NanoMaggies: g=21.7, r=20.4, z=19.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86137, 12.95385), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.3, r=20.7, z=20.5 Reset brightness to NanoMaggies: g=21.3, r=20.7, z=20.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86583, 12.96236), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22, r=21, z=20.5 Reset brightness to NanoMaggies: g=22, r=21, z=20.5 Measuring 4 iterative sources Blob 1 finished, total: Wall: 15.05 s, CPU: 15.05 s, VmPeak: 1022 MB, VmSize: 797 MB, VmRSS: 164 MB, VmData: 196 MB, maxrss: 0.18248 MB Old catalog: 39 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/blobs-custom-313870p12958.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/all-models-custom-313870p12958.fits Stage fitblobs : Wall: 25.62 s, CPU: 10.51 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 285 MB, VmData: 312 MB, maxrss: 0.454828 MB Stage fitblobs finished: 2020-06-07T07:34:02.324626 Resources for stage fitblobs : 16.806 s worker CPU, 16.974 s worker Wall, Wall: 25.623 s, Cores in use: 1.07, Total efficiency (on 4 cores): 26.6 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-07T07:34:02.326301 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-resid.jpg Stage coadds : Wall: 9.88 s, CPU: 6.93 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 290 MB, VmData: 316 MB, maxrss: 0.454828 MB Stage coadds finished: 2020-06-07T07:34:12.207727 Resources for stage coadds : 6.417 s worker CPU, 6.623 s worker Wall, Wall: 9.882 s, Cores in use: 1.35, Total efficiency (on 4 cores): 33.8 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-07T07:34:12.209118 Cut to 1 unWISE tiles Reading WISE tile 3134p136 band 3 Reading WISE tile 3134p136 band 1 Reading WISE tile 3134p136 band 2 Reading WISE tile 3134p136 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.18 s, CPU: 0.13 s, VmPeak: 1028 MB, VmSize: 856 MB, VmRSS: 141 MB, VmData: 176 MB, maxrss: 0.203976 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.25 s, CPU: 0.17 s, VmPeak: 1023 MB, VmSize: 864 MB, VmRSS: 149 MB, VmData: 179 MB, maxrss: 0.18954 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 1022 MB, VmSize: 861 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.215384 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1023 MB, VmSize: 861 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.209036 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 7.08 s, CPU: 4.79 s, VmPeak: 1103 MB, VmSize: 1103 MB, VmRSS: 291 MB, VmData: 316 MB, maxrss: 0.454828 MB Stage wise_forced finished: 2020-06-07T07:34:19.291294 Resources for stage wise_forced : 5.435 s worker CPU, 7.768 s worker Wall, Wall: 7.083 s, Cores in use: 1.44, Total efficiency (on 4 cores): 36.1 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-07T07:34:19.293055 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/tractor-i/cus/tractor-custom-313870p12958.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/tractor/cus/tractor-custom-313870p12958.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/tractor/cus/brick-custom-313870p12958.sha256sum Stage writecat : Wall: 6.08 s, CPU: 5.93 s, VmPeak: 1235 MB, VmSize: 1107 MB, VmRSS: 293 MB, VmData: 316 MB, maxrss: 0.454828 MB Stage writecat finished: 2020-06-07T07:34:25.374785 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.083 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.4 % Stage writecat finished All done: 36.344 s worker CPU, 671.641 s worker Wall, Wall: 316.465 s, Cores in use: 0.41, Total efficiency (on 4 cores): 10.2 % Finished galaxy PGC1419697 in 5.443 minutes. Started working on galaxy PGC1419697 at Sat Jul 18 20:24:00 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.87003500000003 12.9584 --width 295 --height 295 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-18T20:24:00.962517 legacypipe git version: DR9.5.5-6-g531bd718 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.87003500000003', '12.9584', '--width', '295', '--height', '295', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.87003500000003 12.9584 --width 295 --height 295 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 313.87003500000003 12.9584 Starting process 64211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB Starting process 64212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB Starting process 64213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058852 MB Starting process 64214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB Starting process 64215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB Starting process 64216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB Starting process 64217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 64218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 64219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 64220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 64221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 64222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 64223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 64224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 64225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 64226 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 64227 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 64228 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058876 MB Starting process 64229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 64230 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 64231 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 64232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 64233 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 64234 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 64235 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 64236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 64237 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 64238 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 64239 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 64240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 64241 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 64242 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-18T20:24:01.583603 Keeping 8 CCDs: c4d_170917_004518_ooi_r_ls9.fits.fz c4d_170917_004518_ooi_r_ls9-S8 r exptime 108.0 propid 2014B-0404 seeing 1.03 MJD 58013.031 object DECaLS_5096_r c4d_170521_103258_ooi_z_ls9.fits.fz c4d_170521_103258_ooi_z_ls9-S8 z exptime 100.0 propid 2014B-0404 seeing 0.84 MJD 57894.438 object DECaLS_5096_z c4d_160813_030831_ooi_z_ls9.fits.fz c4d_160813_030831_ooi_z_ls9-S8 z exptime 89.0 propid 2014B-0404 seeing 0.99 MJD 57613.129 object DECaLS_5096_z c4d_170922_011844_ooi_g_ls9.fits.fz c4d_170922_011844_ooi_g_ls9-S8 g exptime 200.0 propid 2014B-0404 seeing 1.24 MJD 58018.055 object DECaLS_5096_g c4d_170917_004518_ooi_r_ls9.fits.fz c4d_170917_004518_ooi_r_ls9-S14 r exptime 108.0 propid 2014B-0404 seeing 1.02 MJD 58013.031 object DECaLS_5096_r c4d_170521_103258_ooi_z_ls9.fits.fz c4d_170521_103258_ooi_z_ls9-S14 z exptime 100.0 propid 2014B-0404 seeing 0.83 MJD 57894.438 object DECaLS_5096_z c4d_160813_030831_ooi_z_ls9.fits.fz c4d_160813_030831_ooi_z_ls9-S14 z exptime 89.0 propid 2014B-0404 seeing 0.97 MJD 57613.129 object DECaLS_5096_z c4d_170922_011844_ooi_g_ls9.fits.fz c4d_170922_011844_ooi_g_ls9-S14 g exptime 200.0 propid 2014B-0404 seeing 1.25 MJD 58018.055 object DECaLS_5096_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S8,noinherit][2046,4094][real]: DECaLS_5 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S14,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S8,noinherit][2046,4094][real]: DECaLS_5 Stage tims : Wall: 4.65 s, CPU: 0.94 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 169 MB, VmData: 203 MB, maxrss: 0.176212 MB Stage tims finished: 2020-07-18T20:24:06.231445 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T030612_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 4.139 s worker CPU, 24.520 s worker Wall, Wall: 4.650 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951822a-z-20170521T103022_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952528e-g-20170922T011844_oi[S8,noinherit][2046,4094][real]: DECaLS_5 [astropy.io.fits.card] Running stage refs at 2020-07-18T20:24:07.416639 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04784.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04783.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04655.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-04911.fits Matched 3 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/reference-custom-313870p12958.fits Stage refs : Wall: 11.09 s, CPU: 8.42 s, VmPeak: 1103 MB, VmSize: 1097 MB, VmRSS: 272 MB, VmData: 302 MB, maxrss: 0.278116 MB Stage refs finished: 2020-07-18T20:24:18.502786 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 11.089 s, Cores in use: 0.76, Total efficiency (on 32 cores): 2.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-18T20:24:18.529216 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outlier-mask-custom-313870p12958.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-pre-custom-313870p12958.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outlier-mask-custom-313870p12958.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-post-custom-313870p12958.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-masked-pos-custom-313870p12958.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/outliers-masked-neg-custom-313870p12958.jpg Stage outliers : Wall: 0.83 s, CPU: 0.60 s, VmPeak: 1107 MB, VmSize: 1107 MB, VmRSS: 278 MB, VmData: 307 MB, maxrss: 0.284996 MB Stage outliers finished: 2020-07-18T20:24:19.361868 Resources for stage outliers : 0.328 s worker CPU, 0.399 s worker Wall, Wall: 0.835 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-outliers.p Running stage halos Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9523600-r-20170917T004518_oi[S14,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage halos at 2020-07-18T20:24:19.440197 Stage halos : Wall: 0.53 s, CPU: 0.38 s, VmPeak: 1107 MB, VmSize: 1107 MB, VmRSS: 279 MB, VmData: 307 MB, maxrss: 0.28538 MB Stage halos finished: 2020-07-18T20:24:19.970819 Resources for stage halos : 0.278 s worker CPU, 0.455 s worker Wall, Wall: 0.533 s, Cores in use: 1.23, Total efficiency (on 32 cores): 3.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-18T20:24:19.988885 PSF sigmas in coadd pixels: ['2.02', '2.02'] Using average PSF sigma 2.0205562857822765 Gaussian PSF norm 0.13961243928657133 vs pixelized 0.11458684 average tim pixel scale / coadd scale: 1.001088266378226 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.67', '1.66'] Using average PSF sigma 1.6669139518283425 Gaussian PSF norm 0.16923176596156303 vs pixelized 0.13557015 average tim pixel scale / coadd scale: 1.001132255373878 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.36', '1.61', '1.35', '1.58'] Using average PSF sigma 1.475321117155906 Gaussian PSF norm 0.1912090788191894 vs pixelized 0.15123096 average tim pixel scale / coadd scale: 1.0011488512222377 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.08 s, CPU: 0.06 s, VmPeak: 1107 MB, VmSize: 1107 MB, VmRSS: 280 MB, VmData: 308 MB, maxrss: 0.28686 MB Stage fit_on_coadds finished: 2020-07-18T20:24:20.070472 Resources for stage fit_on_coadds : 0.058 s worker CPU, 0.072 s worker Wall, Wall: 0.084 s, Cores in use: 1.48, Total efficiency (on 32 cores): 4.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-18T20:24:20.082687 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 56943 potential peaks Of 56943 potential peaks: 56925 in veto map, 2 cut by saddle test, 0 cut by aper test, 16 kept SED z : 16 new peaks Found 59133 potential peaks Of 59133 potential peaks: 59132 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 58530 potential peaks Of 58530 potential peaks: 58526 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 52309 potential peaks Of 52309 potential peaks: 52308 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 52322 potential peaks Of 52322 potential peaks: 52320 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 17 new sources Median coadd sky for g : -6.946831e-05 Median coadd sky for r : -0.00015053587 Median coadd sky for z : 0.0011379544 Stage srcs : Wall: 1.76 s, CPU: 0.77 s, VmPeak: 1107 MB, VmSize: 1107 MB, VmRSS: 283 MB, VmData: 310 MB, maxrss: 0.290016 MB Stage srcs finished: 2020-07-18T20:24:21.845317 Resources for stage srcs : 2.922 s worker CPU, 2.922 s worker Wall, Wall: 1.765 s, Cores in use: 2.09, Total efficiency (on 32 cores): 6.5 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-18T20:24:21.873833 Blob 1 of 3, id: 0, sources: 35, size: 295x295, npix 82793, brick X: 0,295, Y: 0,295, one pixel: 0 0 Blob 2 of 3, id: 2, sources: 1, size: 20x15, npix 208, brick X: 82,102, Y: 280,295, one pixel: 90 280 Blob 3 of 3, id: 1, sources: 1, size: 15x17, npix 185, brick X: 0,15, Y: 278,295, one pixel: 5 278 Blob 2 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091344 MB Blob 3 finished, total: Wall: 0.63 s, CPU: 0.63 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.091512 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.84996, 12.94727), pm (1.9, -13.0), parallax 2.716 with NanoMaggies: g=13.5, r=12.8, z=12.5 Reset brightness to NanoMaggies: g=13.5, r=12.8, z=12.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87974, 12.95897), pm (-1.5, -3.8), parallax 0.776 with NanoMaggies: g=15.4, r=14.9, z=14.7 Reset brightness to NanoMaggies: g=15.4, r=14.9, z=14.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.88273, 12.95452), pm (1.3, -9.1), parallax 0.421 with NanoMaggies: g=16.5, r=15.9, z=15.7 Reset brightness to NanoMaggies: g=16.5, r=15.9, z=15.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.88379, 12.96589), pm (-4.2, -6.1), parallax 0.048 with NanoMaggies: g=16.8, r=16, z=15.6 Reset brightness to NanoMaggies: g=16.8, r=16, z=15.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87569, 12.95945), pm (-1.6, -6.2), parallax 0.305 with NanoMaggies: g=18.4, r=17.9, z=17.6 Reset brightness to NanoMaggies: g=18.4, r=17.9, z=17.6 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.85609, ee1=0.502855, ee2=-0.106885 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86458, 12.96073), pm (-12.3, -19.6), parallax 1.005 with NanoMaggies: g=20.7, r=19.3, z=18.3 Reset brightness to NanoMaggies: g=20.7, r=19.3, z=18.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.85996, 12.94616), pm (1.3, -3.2), parallax 0.955 with NanoMaggies: g=(flux -43.9), r=(flux -7.46e+03), z=(flux -84.2) Reset brightness to NanoMaggies: g=20.2, r=19.1, z=18.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87112, 12.95438), pm (0.3, -3.7), parallax 0.443 with NanoMaggies: g=19.6, r=19.1, z=18.9 Reset brightness to NanoMaggies: g=19.6, r=19.1, z=18.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86033, 12.96410), pm (-3.7, -6.5), parallax 0.150 with NanoMaggies: g=20, r=(flux -27), z=14.2 Reset brightness to NanoMaggies: g=20, r=19.2, z=18.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.85832, 12.94631), pm (-4.6, -3.7), parallax 0.865 with NanoMaggies: g=(flux -1.37), r=13.2, z=15.3 Reset brightness to NanoMaggies: g=19.9, r=19.3, z=19.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86238, 12.95382), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=20.6, r=19.5, z=18.9 Reset brightness to NanoMaggies: g=20.6, r=19.5, z=18.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86195, 12.95336), pm (-2.8, -11.8), parallax 0.868 with NanoMaggies: g=21.3, r=19.9, z=19 Reset brightness to NanoMaggies: g=21.3, r=19.9, z=19 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87317, 12.95898), pm (1.6, 0.9), parallax 0.193 with NanoMaggies: g=21.1, r=19.9, z=19.3 Reset brightness to NanoMaggies: g=21.1, r=19.9, z=19.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.87915, 12.94581), pm (1.0, -5.3), parallax -0.856 with NanoMaggies: g=17.1, r=(flux -109), z=15.2 Reset brightness to NanoMaggies: g=20.6, r=20.1, z=19.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86878, 12.94749), pm (-10.9, -5.3), parallax 2.285 with NanoMaggies: g=21.7, r=20.9, z=19.5 Reset brightness to NanoMaggies: g=21.7, r=20.4, z=19.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86137, 12.95385), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.3, r=20.7, z=20.5 Reset brightness to NanoMaggies: g=21.3, r=20.7, z=20.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.86583, 12.96236), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=22, r=21, z=20.5 Reset brightness to NanoMaggies: g=22, r=21, z=20.5 Measuring 4 iterative sources Blob 1 finished, total: Wall: 12.91 s, CPU: 12.91 s, VmPeak: 722 MB, VmSize: 687 MB, VmRSS: 126 MB, VmData: 164 MB, maxrss: 0.162036 MB Old catalog: 39 New catalog: 38 T_dup: tabledata object with 1 rows and 62 columns: a_g_val () shape (1,) dtype float32 astrometric_excess_noise () shape (1,) dtype float32 astrometric_excess_noise_sig () shape (1,) dtype float32 astrometric_n_good_obs_al () shape (1,) dtype int16 astrometric_n_obs_al () shape (1,) dtype int16 astrometric_params_solved () shape (1,) dtype uint8 astrometric_sigma5d_max () shape (1,) dtype float32 astrometric_weight_al () shape (1,) dtype float32 ba () shape (1,) dtype float32 dec () shape (1,) dtype float64 dec_ivar () shape (1,) dtype float32 decam_mag_g () shape (1,) dtype float32 decam_mag_r () shape (1,) dtype float32 decam_mag_z () shape (1,) dtype float32 donotfit () shape (1,) dtype bool duplicated_source () shape (1,) dtype bool e_bp_min_rp_val () shape (1,) dtype float32 freezeparams () shape (1,) dtype bool hmag () shape (1,) dtype float32 ibx () shape (1,) dtype int32 iby () shape (1,) dtype int32 in_bounds () shape (1,) dtype bool isbright () shape (1,) dtype bool iscluster () shape (1,) dtype bool isgaia () shape (1,) dtype bool isgalaxy () shape (1,) dtype uint8 islargegalaxy () shape (1,) dtype bool ismedium () shape (1,) dtype bool istycho () shape (1,) dtype bool jmag () shape (1,) dtype float32 keep_radius () shape (1,) dtype float32 kmag () shape (1,) dtype float32 mag () shape (1,) dtype float32 mask_mag () shape (1,) dtype float32 pa () shape (1,) dtype float32 parallax () shape (1,) dtype float32 parallax_ivar () shape (1,) dtype float32 phot_bp_mean_flux_over_error () shape (1,) dtype float32 phot_bp_mean_mag () shape (1,) dtype float32 phot_bp_n_obs () shape (1,) dtype int16 phot_bp_rp_excess_factor () shape (1,) dtype float32 phot_g_mean_flux_over_error () shape (1,) dtype float32 phot_g_mean_mag () shape (1,) dtype float32 phot_g_n_obs () shape (1,) dtype int16 phot_rp_mean_flux_over_error () shape (1,) dtype float32 phot_rp_mean_mag () shape (1,) dtype float32 phot_rp_n_obs () shape (1,) dtype int16 phot_variable_flag () shape (1,) dtype bool pmdec () shape (1,) dtype float32 pmdec_ivar () shape (1,) dtype float32 pmra () shape (1,) dtype float32 pmra_ivar () shape (1,) dtype float32 pointsource () shape (1,) dtype bool ra () shape (1,) dtype float64 ra_ivar () shape (1,) dtype float32 radius () shape (1,) dtype float32 radius_pix () shape (1,) dtype int64 ref_cat () shape (1,) dtype ) shape (1,) dtype float32 ref_id () shape (1,) dtype int64 source_id () shape (1,) dtype int64 zguess () shape (1,) dtype float32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/blobs-custom-313870p12958.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/metrics/cus/all-models-custom-313870p12958.fits Stage fitblobs : Wall: 13.64 s, CPU: 0.53 s, VmPeak: 1107 MB, VmSize: 1107 MB, VmRSS: 287 MB, VmData: 314 MB, maxrss: 0.293964 MB Stage fitblobs finished: 2020-07-18T20:24:35.517276 Resources for stage fitblobs : 14.061 s worker CPU, 14.077 s worker Wall, Wall: 13.646 s, Cores in use: 1.07, Total efficiency (on 32 cores): 3.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-18T20:24:35.532758 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-resid.jpg Stage coadds : Wall: 5.45 s, CPU: 0.75 s, VmPeak: 1107 MB, VmSize: 1107 MB, VmRSS: 292 MB, VmData: 318 MB, maxrss: 0.299236 MB Stage coadds finished: 2020-07-18T20:24:40.986082 Resources for stage coadds : 32.783 s worker CPU, 33.538 s worker Wall, Wall: 5.456 s, Cores in use: 6.15, Total efficiency (on 32 cores): 19.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-18T20:24:41.751156 Cut to 1 unWISE tiles Reading WISE tile 3134p136 band 1 Reading WISE tile 3134p136 band 2 Reading WISE tile 3134p136 band 4 Reading WISE tile 3134p136 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 953 MB, VmSize: 794 MB, VmRSS: 145 MB, VmData: 176 MB, maxrss: 0.186516 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 792 MB, VmRSS: 140 MB, VmData: 173 MB, maxrss: 0.202252 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 958 MB, VmSize: 792 MB, VmRSS: 140 MB, VmData: 173 MB, maxrss: 0.202488 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3134p136/unwise-3134p136-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 788 MB, VmSize: 788 MB, VmRSS: 139 MB, VmData: 172 MB, maxrss: 0.199784 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/tmp-legacysurvey-custom-313870p12958-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 14.94 s, CPU: 0.66 s, VmPeak: 1107 MB, VmSize: 1107 MB, VmRSS: 293 MB, VmData: 318 MB, maxrss: 0.299748 MB Stage wise_forced finished: 2020-07-18T20:24:56.692779 Resources for stage wise_forced : 3.276 s worker CPU, 4.348 s worker Wall, Wall: 14.945 s, Cores in use: 0.26, Total efficiency (on 32 cores): 0.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-18T20:25:01.897785 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/coadd/cus/custom-313870p12958/legacysurvey-custom-313870p12958-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/tractor-i/cus/tractor-custom-313870p12958.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/tractor/cus/tractor-custom-313870p12958.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/tractor/cus/brick-custom-313870p12958.sha256sum Stage writecat : Wall: 0.80 s, CPU: 0.67 s, VmPeak: 1239 MB, VmSize: 1111 MB, VmRSS: 294 MB, VmData: 318 MB, maxrss: 0.432556 MB Stage writecat finished: 2020-07-18T20:25:02.698520 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.803 s, Cores in use: 0.84, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/PGC1419697/PGC1419697-largegalaxy-writecat.p All done: 57.852 s worker CPU, 80.338 s worker Wall, Wall: 61.147 s, Cores in use: 1.17, Total efficiency (on 32 cores): 3.7 % Finished galaxy PGC1419697 in 1.056 minutes.