Started working on galaxy DR8-3133m125-4939 at Thu Jun 4 03:16:05 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.369959829252 -12.5803573146978 --width 139 --height 139 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-04T03:16:06.377927 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.369959829252', '-12.5803573146978', '--width', '139', '--height', '139', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.369959829252 -12.5803573146978 --width 139 --height 139 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 313.369959829252 -12.5803573146978 Starting process 32812 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 32813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 32814 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 32815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Starting process 32816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05732 MB Starting process 32817 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 32818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Starting process 32819 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057328 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-04T03:16:07.250602 Keeping 8 CCDs: c4d_180905_000137_ooi_g_ls9.fits.fz c4d_180905_000137_ooi_g_ls9-S22 g exptime 76.0 propid 2014B-0404 seeing 1.30 MJD 58366.001 object DECaLS_50904_g c4d_180907_012150_ooi_r_ls9.fits.fz c4d_180907_012150_ooi_r_ls9-N4 r exptime 40.0 propid 2014B-0404 seeing 1.02 MJD 58368.057 object DECaLS_32422_r c4d_180911_015100_ooi_g_ls9.fits.fz c4d_180911_015100_ooi_g_ls9-N4 g exptime 68.0 propid 2014B-0404 seeing 1.04 MJD 58372.077 object DECaLS_32422_g c4d_180829_033635_ooi_z_ls9.fits.fz c4d_180829_033635_ooi_z_ls9-N4 z exptime 80.0 propid 2014B-0404 seeing 0.88 MJD 58359.150 object DECaLS_32422_z c4d_180917_000752_ooi_z_ls9.fits.fz c4d_180917_000752_ooi_z_ls9-N5 z exptime 80.0 propid 2014B-0404 seeing 0.90 MJD 58378.005 object DECaLS_16550_z c4d_180908_015740_ooi_r_ls9.fits.fz c4d_180908_015740_ooi_r_ls9-N5 r exptime 40.0 propid 2014B-0404 seeing 0.96 MJD 58369.082 object DECaLS_16550_r c4d_180904_003030_ooi_g_ls9.fits.fz c4d_180904_003030_ooi_g_ls9-N5 g exptime 122.0 propid 2014B-0404 seeing 1.29 MJD 58365.021 object DECaLS_16550_g c4d_180906_002207_ooi_g_ls9.fits.fz c4d_180906_002207_ooi_g_ls9-S20 g exptime 62.0 propid 2014B-0404 seeing 1.14 MJD 58367.015 object DECaLS_59166_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T002207_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T000137_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953502f-r-20180908T015740_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T012150_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180911T015100_oi[N4,noinherit][2046,4094][real]: DECaLS_32422 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T003030_oi[N5,noinherit][2046,4094][real]: DECaLS_16550 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f4c3-z-20180829T033635_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T000752_oi[N5,noinherit][2046,4094][real]: DECaLS_1 Stage tims : Wall: 83.08 s, CPU: 1.08 s, VmPeak: 995 MB, VmSize: 995 MB, VmRSS: 168 MB, VmData: 202 MB, maxrss: 0.451328 MB Stage tims finished: 2020-06-04T03:17:30.335071 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T002207_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T000137_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953502f-r-20180908T015740_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180911T015100_oi[N4,noinherit][2046,4094][real]: DECaLS_32422 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T012150_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T000752_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Resources for stage tims : 4.476 s worker CPU, 176.290 s worker Wall, Wall: 83.086 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.8 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-tims.p Running stage refs WARNING: image median 0.0058132303 is more than 1 sigma away from zero! WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T003030_oi[N5,noinherit][2046,4094][real]: DECaLS_16550 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f4c3-z-20180829T033635_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Running stage refs at 2020-06-04T03:17:30.350498 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07600.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07599.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07471.fits Matched 4 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/reference-custom-313369m12580.fits Stage refs : Wall: 11.36 s, CPU: 10.06 s, VmPeak: 1089 MB, VmSize: 1083 MB, VmRSS: 260 MB, VmData: 291 MB, maxrss: 0.451328 MB Stage refs finished: 2020-06-04T03:17:41.706263 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.357 s, Cores in use: 0.89, Total efficiency (on 8 cores): 11.1 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-04T03:17:41.708068 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outlier-mask-custom-313369m12580.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-pre-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outlier-mask-custom-313369m12580.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-post-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-masked-pos-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-masked-neg-custom-313369m12580.jpg Stage outliers : Wall: 4.94 s, CPU: 4.84 s, VmPeak: 1093 MB, VmSize: 1093 MB, VmRSS: 265 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage outliers finished: 2020-06-04T03:17:46.648957 Resources for stage outliers : 0.192 s worker CPU, 0.192 s worker Wall, Wall: 4.942 s, Cores in use: 1.02, Total efficiency (on 8 cores): 12.7 % Stage outliers finished Running stage halos Running stage halos at 2020-06-04T03:17:46.650702 Stage halos : Wall: 8.54 s, CPU: 7.05 s, VmPeak: 1093 MB, VmSize: 1093 MB, VmRSS: 265 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage halos finished: 2020-06-04T03:17:55.186793 Resources for stage halos : 0.307 s worker CPU, 6.947 s worker Wall, Wall: 8.538 s, Cores in use: 0.86, Total efficiency (on 8 cores): 10.8 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-04T03:17:55.189019 PSF sigmas in coadd pixels: ['2.11', '1.68', '2.10', '1.86'] Using average PSF sigma 1.9379966571896041 Gaussian PSF norm 0.1455599991503388 vs pixelized 0.11764143 average tim pixel scale / coadd scale: 1.001039853489261 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.57'] Using average PSF sigma 1.6088050046822464 Gaussian PSF norm 0.17534430272958682 vs pixelized 0.14028771 average tim pixel scale / coadd scale: 1.0010240824345698 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.43', '1.46'] Using average PSF sigma 1.4422484542966414 Gaussian PSF norm 0.19559375566219672 vs pixelized 0.15984839 average tim pixel scale / coadd scale: 1.0009670966902022 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.07 s, CPU: 0.06 s, VmPeak: 1093 MB, VmSize: 1093 MB, VmRSS: 266 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage fit_on_coadds finished: 2020-06-04T03:17:55.259526 Resources for stage fit_on_coadds : 0.044 s worker CPU, 0.044 s worker Wall, Wall: 0.071 s, Cores in use: 1.47, Total efficiency (on 8 cores): 18.4 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-04T03:17:55.261760 Avoiding source detection in 1 CLUSTERs SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 63 potential peaks Of 63 potential peaks: 63 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED z : 0 new peaks Found 55 potential peaks Of 55 potential peaks: 55 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 48 potential peaks Of 48 potential peaks: 48 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 56 potential peaks Of 56 potential peaks: 56 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 65 potential peaks Of 65 potential peaks: 65 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Median coadd sky for g : 0.00016861869 Median coadd sky for r : 0.00013119241 Median coadd sky for z : 0.0007330965 Stage srcs : Wall: 2.15 s, CPU: 2.13 s, VmPeak: 1093 MB, VmSize: 1093 MB, VmRSS: 267 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage srcs finished: 2020-06-04T03:17:57.407117 Resources for stage srcs : 0.032 s worker CPU, 0.032 s worker Wall, Wall: 2.146 s, Cores in use: 1.01, Total efficiency (on 8 cores): 12.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-04T03:17:57.418019 Blob 1 of 1, id: 0, sources: 38, size: 139x139, npix 17993, brick X: 0,139, Y: 0,139, one pixel: 13 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.44300, -12.56895), pm (-1.0, -16.6), parallax 2.910 with NanoMaggies: g=9.51, r=9.25, z=9.23 Reset brightness to NanoMaggies: g=9.51, r=9.25, z=9.23 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37716, -12.57029), pm (-4.8, -0.6), parallax 2.200 with NanoMaggies: g=12.5, r=12.2, z=12.1 Reset brightness to NanoMaggies: g=12.5, r=12.2, z=12.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37728, -12.56860), pm (6.8, 0.6), parallax 0.933 with NanoMaggies: g=15.6, r=15.1, z=14.9 Reset brightness to NanoMaggies: g=15.6, r=15.1, z=14.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36184, -12.58048), pm (-1.1, -3.1), parallax -0.208 with NanoMaggies: g=17.1, r=16.4, z=16.1 Reset brightness to NanoMaggies: g=17.1, r=16.4, z=16.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37908, -12.57602), pm (-1.2, -3.3), parallax -0.168 with NanoMaggies: g=17.3, r=16.6, z=16.3 Reset brightness to NanoMaggies: g=17.3, r=16.6, z=16.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36578, -12.57155), pm (-1.4, -3.2), parallax 0.076 with NanoMaggies: g=18.2, r=17.7, z=17.4 Reset brightness to NanoMaggies: g=18.2, r=17.7, z=17.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37795, -12.57797), pm (1.3, -3.3), parallax 0.122 with NanoMaggies: g=19.5, r=18.9, z=18.7 Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36296, -12.57677), pm (-2.5, -4.7), parallax 0.154 with NanoMaggies: g=14.8, r=13.8, z=13.3 Reset brightness to NanoMaggies: g=20.2, r=19.9, z=19.9 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.290587, ee1=0.568536, ee2=0.289981 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37342, -12.57368), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=18.9, r=19.6, z=14.7 Reset brightness to NanoMaggies: g=21.2, r=20.8, z=20.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37564, -12.58421), pm (-7.3, -8.3), parallax 1.068 with NanoMaggies: g=20.1, r=20, z=19.5 Reset brightness to NanoMaggies: g=20.9, r=20.8, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37577, -12.57478), pm (3.8, -0.6), parallax -0.296 with NanoMaggies: g=18.3, r=17.5, z=16.4 Reset brightness to NanoMaggies: g=21, r=20.8, z=20.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37687, -12.57790), pm (-5.5, -6.1), parallax -0.201 with NanoMaggies: g=16, r=14.8, z=14 Reset brightness to NanoMaggies: g=20.9, r=20.8, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36819, -12.58575), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21, r=19.7, z=19.1 Reset brightness to NanoMaggies: g=21.9, r=20.9, z=20.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36681, -12.57434), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=16.9, r=15.9, z=15.5 Reset brightness to NanoMaggies: g=21.1, r=20.9, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36451, -12.57845), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.4, r=20.7, z=21.3 Reset brightness to NanoMaggies: g=22.1, r=21.1, z=20.7 Blob 1 finished, total: Wall: 5.36 s, CPU: 5.36 s, VmPeak: 945 MB, VmSize: 714 MB, VmRSS: 139 MB, VmData: 177 MB, maxrss: 0.142664 MB Old catalog: 44 New catalog: 38 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/blobs-custom-313369m12580.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/all-models-custom-313369m12580.fits Stage fitblobs : Wall: 10.38 s, CPU: 4.97 s, VmPeak: 1093 MB, VmSize: 1093 MB, VmRSS: 267 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage fitblobs finished: 2020-06-04T03:18:07.793705 Resources for stage fitblobs : 5.374 s worker CPU, 5.381 s worker Wall, Wall: 10.377 s, Cores in use: 1.00, Total efficiency (on 8 cores): 12.5 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-04T03:18:07.795404 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-resid.jpg Stage coadds : Wall: 5.59 s, CPU: 4.93 s, VmPeak: 1093 MB, VmSize: 1093 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage coadds finished: 2020-06-04T03:18:13.385336 Resources for stage coadds : 3.916 s worker CPU, 4.169 s worker Wall, Wall: 5.591 s, Cores in use: 1.58, Total efficiency (on 8 cores): 19.8 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-04T03:18:13.386888 Cut to 1 unWISE tiles Reading WISE tile 3136m122 band 1 Reading WISE tile 3136m122 band 2 Reading WISE tile 3136m122 band 3 Reading WISE tile 3136m122 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 951 MB, VmSize: 792 MB, VmRSS: 143 MB, VmData: 175 MB, maxrss: 0.184284 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 943 MB, VmSize: 786 MB, VmRSS: 136 MB, VmData: 169 MB, maxrss: 0.198768 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 951 MB, VmSize: 786 MB, VmRSS: 136 MB, VmData: 169 MB, maxrss: 0.199576 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 946 MB, VmSize: 786 MB, VmRSS: 137 MB, VmData: 169 MB, maxrss: 0.199972 MB Checking for sources inside CLUSTER mask Found 23 of 38 sources inside CLUSTER mask Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 8.38 s, CPU: 2.96 s, VmPeak: 1093 MB, VmSize: 1093 MB, VmRSS: 268 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage wise_forced finished: 2020-06-04T03:18:21.766985 Resources for stage wise_forced : 2.964 s worker CPU, 8.741 s worker Wall, Wall: 8.381 s, Cores in use: 0.71, Total efficiency (on 8 cores): 8.8 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-04T03:18:21.768915 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor-i/cus/tractor-custom-313369m12580.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor/cus/tractor-custom-313369m12580.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor/cus/brick-custom-313369m12580.sha256sum Stage writecat : Wall: 3.28 s, CPU: 2.42 s, VmPeak: 1225 MB, VmSize: 1097 MB, VmRSS: 270 MB, VmData: 294 MB, maxrss: 0.451328 MB Stage writecat finished: 2020-06-04T03:18:25.048500 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.281 s, Cores in use: 0.74, Total efficiency (on 8 cores): 9.2 % Stage writecat finished All done: 17.308 s worker CPU, 201.799 s worker Wall, Wall: 137.803 s, Cores in use: 0.42, Total efficiency (on 8 cores): 5.2 % Finished galaxy DR8-3133m125-4939 in 2.333 minutes. Started working on galaxy DR8-3133m125-4939 at Thu Jul 23 04:02:34 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.369959829252 -12.5803573146978 --width 139 --height 139 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-23T04:02:37.110969 legacypipe git version: DR9.5.5-21-g66b1aacb Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.369959829252', '-12.5803573146978', '--width', '139', '--height', '139', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.369959829252 -12.5803573146978 --width 139 --height 139 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 313.369959829252 -12.5803573146978 Starting process 55979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 55980 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 55981 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 55982 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059156 MB Starting process 55983 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB Starting process 55984 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05916 MB Starting process 55985 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058868 MB Starting process 55986 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 55987 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 55988 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 55989 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 55990 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 55991 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 55992 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 55993 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 55994 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-23T04:02:37.649136 Keeping 8 CCDs: c4d_180905_000137_ooi_g_ls9.fits.fz c4d_180905_000137_ooi_g_ls9-S22 g exptime 76.0 propid 2014B-0404 seeing 1.30 MJD 58366.001 object DECaLS_50904_g c4d_180907_012150_ooi_r_ls9.fits.fz c4d_180907_012150_ooi_r_ls9-N4 r exptime 40.0 propid 2014B-0404 seeing 1.02 MJD 58368.057 object DECaLS_32422_r c4d_180911_015100_ooi_g_ls9.fits.fz c4d_180911_015100_ooi_g_ls9-N4 g exptime 68.0 propid 2014B-0404 seeing 1.04 MJD 58372.077 object DECaLS_32422_g c4d_180829_033635_ooi_z_ls9.fits.fz c4d_180829_033635_ooi_z_ls9-N4 z exptime 80.0 propid 2014B-0404 seeing 0.88 MJD 58359.150 object DECaLS_32422_z c4d_180917_000752_ooi_z_ls9.fits.fz c4d_180917_000752_ooi_z_ls9-N5 z exptime 80.0 propid 2014B-0404 seeing 0.90 MJD 58378.005 object DECaLS_16550_z c4d_180908_015740_ooi_r_ls9.fits.fz c4d_180908_015740_ooi_r_ls9-N5 r exptime 40.0 propid 2014B-0404 seeing 0.96 MJD 58369.082 object DECaLS_16550_r c4d_180904_003030_ooi_g_ls9.fits.fz c4d_180904_003030_ooi_g_ls9-N5 g exptime 122.0 propid 2014B-0404 seeing 1.29 MJD 58365.021 object DECaLS_16550_g c4d_180906_002207_ooi_g_ls9.fits.fz c4d_180906_002207_ooi_g_ls9-S20 g exptime 62.0 propid 2014B-0404 seeing 1.14 MJD 58367.015 object DECaLS_59166_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T000137_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T002207_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953502f-r-20180908T015740_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f4c3-z-20180829T033635_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T012150_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T000752_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T003030_oi[N5,noinherit][2046,4094][real]: DECaLS_16550 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180911T015100_oi[N4,noinherit][2046,4094][real]: DECaLS_32422 Stage tims : Wall: 20.76 s, CPU: 0.80 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.173688 MB Stage tims finished: 2020-07-23T04:02:58.409199 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T000137_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953502f-r-20180908T015740_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f4c3-z-20180829T033635_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T012150_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T000752_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: image median 0.0058132303 is more than 1 sigma away from zero! Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T003030_oi[N5,noinherit][2046,4094][real]: DECaLS_16550 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180911T015100_oi[N4,noinherit][2046,4094][real]: DECaLS_32422 [astropy.io.fits.card] Resources for stage tims : 4.029 s worker CPU, 79.034 s worker Wall, Wall: 20.762 s, Cores in use: 0.23, Total efficiency (on 16 cores): 1.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T002207_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-23T04:02:58.429395 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07600.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07599.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07471.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/reference-custom-313369m12580.fits Stage refs : Wall: 10.07 s, CPU: 7.33 s, VmPeak: 1092 MB, VmSize: 1087 MB, VmRSS: 261 MB, VmData: 293 MB, maxrss: 0.267292 MB Stage refs finished: 2020-07-23T04:03:08.495218 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.067 s, Cores in use: 0.73, Total efficiency (on 16 cores): 4.6 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-23T04:03:08.527885 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outlier-mask-custom-313369m12580.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-pre-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outlier-mask-custom-313369m12580.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-post-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-masked-pos-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-masked-neg-custom-313369m12580.jpg Stage outliers : Wall: 0.99 s, CPU: 0.75 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 267 MB, VmData: 296 MB, maxrss: 0.273272 MB Stage outliers finished: 2020-07-23T04:03:09.517970 Resources for stage outliers : 0.268 s worker CPU, 0.580 s worker Wall, Wall: 0.992 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-23T04:03:09.539794 Stage halos : Wall: 0.43 s, CPU: 0.32 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 267 MB, VmData: 296 MB, maxrss: 0.27328 MB Stage halos finished: 2020-07-23T04:03:09.967315 Resources for stage halos : 0.350 s worker CPU, 0.652 s worker Wall, Wall: 0.429 s, Cores in use: 1.56, Total efficiency (on 16 cores): 9.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-23T04:03:09.992114 PSF sigmas in coadd pixels: ['2.11', '1.68', '2.10', '1.86'] Using average PSF sigma 1.9379966571896041 Gaussian PSF norm 0.1455599991503388 vs pixelized 0.11764143 average tim pixel scale / coadd scale: 1.001039853489261 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.57'] Using average PSF sigma 1.6088050046822464 Gaussian PSF norm 0.17534430272958682 vs pixelized 0.14028771 average tim pixel scale / coadd scale: 1.0010240824345698 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.43', '1.46'] Using average PSF sigma 1.4422484542966414 Gaussian PSF norm 0.19559375566219672 vs pixelized 0.15984839 average tim pixel scale / coadd scale: 1.0009670966902022 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.08 s, CPU: 0.07 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 268 MB, VmData: 296 MB, maxrss: 0.274752 MB Stage fit_on_coadds finished: 2020-07-23T04:03:10.074897 Resources for stage fit_on_coadds : 0.047 s worker CPU, 0.047 s worker Wall, Wall: 0.084 s, Cores in use: 1.38, Total efficiency (on 16 cores): 8.6 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-23T04:03:10.089868 Avoiding source detection in 1 CLUSTER masks SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 63 potential peaks Of 63 potential peaks: 63 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED z : 0 new peaks Found 55 potential peaks Of 55 potential peaks: 55 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 48 potential peaks Of 48 potential peaks: 48 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 56 potential peaks Of 56 potential peaks: 56 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 65 potential peaks Of 65 potential peaks: 65 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Median coadd sky for g : 0.00016861872 Median coadd sky for r : 0.00013119241 Median coadd sky for z : 0.0007330966 Stage srcs : Wall: 0.55 s, CPU: 0.53 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 269 MB, VmData: 296 MB, maxrss: 0.275484 MB Stage srcs finished: 2020-07-23T04:03:10.635297 Resources for stage srcs : 0.026 s worker CPU, 0.026 s worker Wall, Wall: 0.547 s, Cores in use: 1.01, Total efficiency (on 16 cores): 6.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-23T04:03:10.655813 Blob 1 of 1, id: 0, sources: 38, size: 139x139, npix 17993, brick X: 0,139, Y: 0,139, one pixel: 13 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.44300, -12.56895), pm (-1.0, -16.6), parallax 2.910 with NanoMaggies: g=9.51, r=9.25, z=9.23 Reset brightness to NanoMaggies: g=9.51, r=9.25, z=9.23 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37716, -12.57029), pm (-4.8, -0.6), parallax 2.200 with NanoMaggies: g=12.5, r=12.2, z=12.1 Reset brightness to NanoMaggies: g=12.5, r=12.2, z=12.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37728, -12.56860), pm (6.8, 0.6), parallax 0.933 with NanoMaggies: g=15.6, r=15.1, z=14.9 Reset brightness to NanoMaggies: g=15.6, r=15.1, z=14.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36184, -12.58048), pm (-1.1, -3.1), parallax -0.208 with NanoMaggies: g=17.1, r=16.4, z=16.1 Reset brightness to NanoMaggies: g=17.1, r=16.4, z=16.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37908, -12.57602), pm (-1.2, -3.3), parallax -0.168 with NanoMaggies: g=17.3, r=16.6, z=16.3 Reset brightness to NanoMaggies: g=17.3, r=16.6, z=16.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36578, -12.57155), pm (-1.4, -3.2), parallax 0.076 with NanoMaggies: g=18.2, r=17.7, z=17.4 Reset brightness to NanoMaggies: g=18.2, r=17.7, z=17.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37795, -12.57797), pm (1.3, -3.3), parallax 0.122 with NanoMaggies: g=19.5, r=18.9, z=18.7 Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36296, -12.57677), pm (-2.5, -4.7), parallax 0.154 with NanoMaggies: g=14.8, r=13.8, z=13.3 Reset brightness to NanoMaggies: g=20.2, r=19.9, z=19.9 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.290589, ee1=0.568539, ee2=0.289983 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37342, -12.57368), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=18.9, r=19.6, z=14.7 Reset brightness to NanoMaggies: g=21.2, r=20.8, z=20.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37564, -12.58421), pm (-7.3, -8.3), parallax 1.068 with NanoMaggies: g=20.1, r=20, z=19.5 Reset brightness to NanoMaggies: g=20.9, r=20.8, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37577, -12.57478), pm (3.8, -0.6), parallax -0.296 with NanoMaggies: g=18.3, r=17.5, z=16.4 Reset brightness to NanoMaggies: g=21, r=20.8, z=20.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37687, -12.57790), pm (-5.5, -6.1), parallax -0.201 with NanoMaggies: g=16, r=14.8, z=14 Reset brightness to NanoMaggies: g=20.9, r=20.8, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36819, -12.58575), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21, r=19.7, z=19.1 Reset brightness to NanoMaggies: g=21.9, r=20.9, z=20.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36681, -12.57434), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=16.9, r=15.9, z=15.5 Reset brightness to NanoMaggies: g=21.1, r=20.9, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36451, -12.57845), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.4, r=20.7, z=21.3 Reset brightness to NanoMaggies: g=22.1, r=21.1, z=20.7 Blob 1 finished, total: Wall: 5.54 s, CPU: 5.51 s, VmPeak: 918 MB, VmSize: 719 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146752 MB Old catalog: 44 New catalog: 38 T_dup: tabledata object with 1 rows and 63 columns: a_g_val () shape (1,) dtype float32 astrometric_excess_noise () shape (1,) dtype float32 astrometric_excess_noise_sig () shape (1,) dtype float32 astrometric_n_good_obs_al () shape (1,) dtype int16 astrometric_n_obs_al () shape (1,) dtype int16 astrometric_params_solved () shape (1,) dtype uint8 astrometric_sigma5d_max () shape (1,) dtype float32 astrometric_weight_al () shape (1,) dtype float32 ba () shape (1,) dtype float32 dec () shape (1,) dtype float64 dec_ivar () shape (1,) dtype float32 decam_mag_g () shape (1,) dtype float32 decam_mag_r () shape (1,) dtype float32 decam_mag_z () shape (1,) dtype float32 donotfit () shape (1,) dtype bool duplicated_source () shape (1,) dtype bool e_bp_min_rp_val () shape (1,) dtype float32 freezeparams () shape (1,) dtype bool hmag () shape (1,) dtype float32 ibx () shape (1,) dtype int32 iby () shape (1,) dtype int32 in_bounds () shape (1,) dtype bool isbright () shape (1,) dtype bool iscluster () shape (1,) dtype bool isgaia () shape (1,) dtype bool isgalaxy () shape (1,) dtype uint8 islargegalaxy () shape (1,) dtype bool ismedium () shape (1,) dtype bool istycho () shape (1,) dtype bool jmag () shape (1,) dtype float32 keep_radius () shape (1,) dtype float32 kmag () shape (1,) dtype float32 mag () shape (1,) dtype float32 mask_mag () shape (1,) dtype float32 pa () shape (1,) dtype float32 parallax () shape (1,) dtype float32 parallax_ivar () shape (1,) dtype float32 phot_bp_mean_flux_over_error () shape (1,) dtype float32 phot_bp_mean_mag () shape (1,) dtype float32 phot_bp_n_obs () shape (1,) dtype int16 phot_bp_rp_excess_factor () shape (1,) dtype float32 phot_g_mean_flux_over_error () shape (1,) dtype float32 phot_g_mean_mag () shape (1,) dtype float32 phot_g_n_obs () shape (1,) dtype int16 phot_rp_mean_flux_over_error () shape (1,) dtype float32 phot_rp_mean_mag () shape (1,) dtype float32 phot_rp_n_obs () shape (1,) dtype int16 phot_variable_flag () shape (1,) dtype bool pmdec () shape (1,) dtype float32 pmdec_ivar () shape (1,) dtype float32 pmra () shape (1,) dtype float32 pmra_ivar () shape (1,) dtype float32 pointsource () shape (1,) dtype bool ra () shape (1,) dtype float64 ra_ivar () shape (1,) dtype float32 radius () shape (1,) dtype float32 radius_pix () shape (1,) dtype int64 ref_cat () shape (1,) dtype ) shape (1,) dtype float32 ref_id () shape (1,) dtype int64 source_id () shape (1,) dtype int64 type () shape (1,) dtype ) shape (1,) dtype float32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/blobs-custom-313369m12580.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/all-models-custom-313369m12580.fits Stage fitblobs : Wall: 6.17 s, CPU: 0.47 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 269 MB, VmData: 296 MB, maxrss: 0.275744 MB Stage fitblobs finished: 2020-07-23T04:03:16.825157 Resources for stage fitblobs : 5.526 s worker CPU, 5.564 s worker Wall, Wall: 6.171 s, Cores in use: 0.97, Total efficiency (on 16 cores): 6.1 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-23T04:03:16.854617 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-resid.jpg Stage coadds : Wall: 2.04 s, CPU: 0.80 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 270 MB, VmData: 296 MB, maxrss: 0.276208 MB Stage coadds finished: 2020-07-23T04:03:18.895073 Resources for stage coadds : 11.267 s worker CPU, 12.404 s worker Wall, Wall: 2.042 s, Cores in use: 5.91, Total efficiency (on 16 cores): 36.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-23T04:03:18.909855 Cut to 1 unWISE tiles Reading WISE tile 3136m122 band 2 Reading WISE tile 3136m122 band 1 Reading WISE tile 3136m122 band 4 Reading WISE tile 3136m122 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 956 MB, VmSize: 792 MB, VmRSS: 140 MB, VmData: 173 MB, maxrss: 0.203588 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 949 MB, VmSize: 792 MB, VmRSS: 140 MB, VmData: 173 MB, maxrss: 0.203552 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 785 MB, VmSize: 785 MB, VmRSS: 134 MB, VmData: 170 MB, maxrss: 0.194236 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.02 s, CPU: 0.02 s, VmPeak: 956 MB, VmSize: 794 MB, VmRSS: 142 MB, VmData: 176 MB, maxrss: 0.1869 MB Checking for sources inside CLUSTER mask Found 24 of 39 sources inside CLUSTER mask Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.05 s, CPU: 0.51 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 270 MB, VmData: 296 MB, maxrss: 0.276724 MB Stage wise_forced finished: 2020-07-23T04:03:20.956386 Resources for stage wise_forced : 2.969 s worker CPU, 4.889 s worker Wall, Wall: 2.048 s, Cores in use: 1.70, Total efficiency (on 16 cores): 10.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-23T04:03:20.975406 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor-i/cus/tractor-custom-313369m12580.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor/cus/tractor-custom-313369m12580.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor/cus/brick-custom-313369m12580.sha256sum Stage writecat : Wall: 1.70 s, CPU: 1.06 s, VmPeak: 1228 MB, VmSize: 1100 MB, VmRSS: 272 MB, VmData: 296 MB, maxrss: 0.409472 MB Stage writecat finished: 2020-07-23T04:03:22.674286 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.701 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-writecat.p All done: 24.486 s worker CPU, 103.202 s worker Wall, Wall: 45.051 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 % Finished galaxy DR8-3133m125-4939 in 0.812 minutes. Started working on galaxy DR8-3133m125-4939 at Thu Jul 23 12:12:26 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.369959829252 -12.5803573146978 --width 139 --height 139 --pixscale 0.262 --threads 12 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-23T12:12:27.193696 legacypipe git version: DR9.5.6 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '313.369959829252', '-12.5803573146978', '--width', '139', '--height', '139', '--pixscale', '0.262', '--threads', '12', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 313.369959829252 -12.5803573146978 --width 139 --height 139 --pixscale 0.262 --threads 12 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 313.369959829252 -12.5803573146978 Starting process 9208 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB Starting process 9209 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058844 MB Starting process 9210 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058848 MB Starting process 9211 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05914 MB Starting process 9212 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059144 MB Starting process 9213 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB Starting process 9215 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 9214 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 9216 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 9217 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058856 MB Starting process 9218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 9219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-23T12:12:27.460197 Keeping 8 CCDs: c4d_180905_000137_ooi_g_ls9.fits.fz c4d_180905_000137_ooi_g_ls9-S22 g exptime 76.0 propid 2014B-0404 seeing 1.30 MJD 58366.001 object DECaLS_50904_g c4d_180907_012150_ooi_r_ls9.fits.fz c4d_180907_012150_ooi_r_ls9-N4 r exptime 40.0 propid 2014B-0404 seeing 1.02 MJD 58368.057 object DECaLS_32422_r c4d_180911_015100_ooi_g_ls9.fits.fz c4d_180911_015100_ooi_g_ls9-N4 g exptime 68.0 propid 2014B-0404 seeing 1.04 MJD 58372.077 object DECaLS_32422_g c4d_180829_033635_ooi_z_ls9.fits.fz c4d_180829_033635_ooi_z_ls9-N4 z exptime 80.0 propid 2014B-0404 seeing 0.88 MJD 58359.150 object DECaLS_32422_z c4d_180917_000752_ooi_z_ls9.fits.fz c4d_180917_000752_ooi_z_ls9-N5 z exptime 80.0 propid 2014B-0404 seeing 0.90 MJD 58378.005 object DECaLS_16550_z c4d_180908_015740_ooi_r_ls9.fits.fz c4d_180908_015740_ooi_r_ls9-N5 r exptime 40.0 propid 2014B-0404 seeing 0.96 MJD 58369.082 object DECaLS_16550_r c4d_180904_003030_ooi_g_ls9.fits.fz c4d_180904_003030_ooi_g_ls9-N5 g exptime 122.0 propid 2014B-0404 seeing 1.29 MJD 58365.021 object DECaLS_16550_g c4d_180906_002207_ooi_g_ls9.fits.fz c4d_180906_002207_ooi_g_ls9-S20 g exptime 62.0 propid 2014B-0404 seeing 1.14 MJD 58367.015 object DECaLS_59166_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T000752_oi[N5,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T003030_oi[N5,noinherit][2046,4094][real]: DECaLS_16550 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T002207_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T012150_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180911T015100_oi[N4,noinherit][2046,4094][real]: DECaLS_32422 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f4c3-z-20180829T033635_oi[N4,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T000137_oi[S22,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953502f-r-20180908T015740_oi[N5,noinherit][2046,4094][real]: DECaLS_1 Stage tims : Wall: 4.53 s, CPU: 0.72 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.20558 MB Stage tims finished: 2020-07-23T12:12:31.994027 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95345f0-r-20180907T012150_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: image median 0.0058132303 is more than 1 sigma away from zero! WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T003030_oi[N5,noinherit][2046,4094][real]: DECaLS_16550 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T002207_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_955f4c3-z-20180829T033635_oi[N4,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180911T015100_oi[N4,noinherit][2046,4094][real]: DECaLS_32422 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T000137_oi[S22,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953502f-r-20180908T015740_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Resources for stage tims : 8.457 s worker CPU, 29.263 s worker Wall, Wall: 4.536 s, Cores in use: 2.02, Total efficiency (on 12 cores): 16.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952ebf8-z-20180917T000752_oi[N5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] Running stage refs at 2020-07-23T12:12:35.646649 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07600.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07599.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07471.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/reference-custom-313369m12580.fits Stage refs : Wall: 8.08 s, CPU: 7.13 s, VmPeak: 1092 MB, VmSize: 1087 MB, VmRSS: 261 MB, VmData: 293 MB, maxrss: 0.26712 MB Stage refs finished: 2020-07-23T12:12:43.724861 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.080 s, Cores in use: 0.88, Total efficiency (on 12 cores): 7.4 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-23T12:12:43.755906 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outlier-mask-custom-313369m12580.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-pre-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outlier-mask-custom-313369m12580.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-post-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-masked-pos-custom-313369m12580.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/outliers-masked-neg-custom-313369m12580.jpg Stage outliers : Wall: 0.53 s, CPU: 0.19 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 266 MB, VmData: 296 MB, maxrss: 0.272484 MB Stage outliers finished: 2020-07-23T12:12:44.288115 Resources for stage outliers : 0.233 s worker CPU, 0.347 s worker Wall, Wall: 0.534 s, Cores in use: 0.79, Total efficiency (on 12 cores): 6.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-23T12:12:45.703514 Stage halos : Wall: 0.10 s, CPU: 0.04 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 266 MB, VmData: 296 MB, maxrss: 0.272716 MB Stage halos finished: 2020-07-23T12:12:45.801540 Resources for stage halos : 0.367 s worker CPU, 0.388 s worker Wall, Wall: 0.100 s, Cores in use: 4.07, Total efficiency (on 12 cores): 34.0 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-23T12:12:50.400057 PSF sigmas in coadd pixels: ['2.11', '1.68', '2.10', '1.86'] Using average PSF sigma 1.9379966571896041 Gaussian PSF norm 0.1455599991503388 vs pixelized 0.11764143 average tim pixel scale / coadd scale: 1.001039853489261 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.57'] Using average PSF sigma 1.6088050046822464 Gaussian PSF norm 0.17534430272958682 vs pixelized 0.14028771 average tim pixel scale / coadd scale: 1.0010240824345698 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.43', '1.46'] Using average PSF sigma 1.4422484542966414 Gaussian PSF norm 0.19559375566219672 vs pixelized 0.15984839 average tim pixel scale / coadd scale: 1.0009670966902022 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-copsf-z.fits.fz Stage fit_on_coadds : Wall: 1.90 s, CPU: 0.08 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 268 MB, VmData: 296 MB, maxrss: 0.274584 MB Stage fit_on_coadds finished: 2020-07-23T12:12:52.299109 Resources for stage fit_on_coadds : 0.039 s worker CPU, 0.039 s worker Wall, Wall: 1.901 s, Cores in use: 0.06, Total efficiency (on 12 cores): 0.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-23T12:12:52.336163 Avoiding source detection in 1 CLUSTER masks SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 63 potential peaks Of 63 potential peaks: 63 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED z : 0 new peaks Found 55 potential peaks Of 55 potential peaks: 55 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 48 potential peaks Of 48 potential peaks: 48 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 56 potential peaks Of 56 potential peaks: 56 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Flat : 0 new peaks Found 65 potential peaks Of 65 potential peaks: 65 in veto map, 0 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Median coadd sky for g : 0.00016861872 Median coadd sky for r : 0.00013119241 Median coadd sky for z : 0.0007330966 Stage srcs : Wall: 0.14 s, CPU: 0.12 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 269 MB, VmData: 296 MB, maxrss: 0.275384 MB Stage srcs finished: 2020-07-23T12:12:52.471553 Resources for stage srcs : 0.029 s worker CPU, 0.029 s worker Wall, Wall: 0.137 s, Cores in use: 1.11, Total efficiency (on 12 cores): 9.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-23T12:12:52.770360 Blob 1 of 1, id: 0, sources: 38, size: 139x139, npix 17993, brick X: 0,139, Y: 0,139, one pixel: 13 0 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.44300, -12.56895), pm (-1.0, -16.6), parallax 2.910 with NanoMaggies: g=9.51, r=9.25, z=9.23 Reset brightness to NanoMaggies: g=9.51, r=9.25, z=9.23 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37716, -12.57029), pm (-4.8, -0.6), parallax 2.200 with NanoMaggies: g=12.5, r=12.2, z=12.1 Reset brightness to NanoMaggies: g=12.5, r=12.2, z=12.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37728, -12.56860), pm (6.8, 0.6), parallax 0.933 with NanoMaggies: g=15.6, r=15.1, z=14.9 Reset brightness to NanoMaggies: g=15.6, r=15.1, z=14.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36184, -12.58048), pm (-1.1, -3.1), parallax -0.208 with NanoMaggies: g=17.1, r=16.4, z=16.1 Reset brightness to NanoMaggies: g=17.1, r=16.4, z=16.1 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37908, -12.57602), pm (-1.2, -3.3), parallax -0.168 with NanoMaggies: g=17.3, r=16.6, z=16.3 Reset brightness to NanoMaggies: g=17.3, r=16.6, z=16.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36578, -12.57155), pm (-1.4, -3.2), parallax 0.076 with NanoMaggies: g=18.2, r=17.7, z=17.4 Reset brightness to NanoMaggies: g=18.2, r=17.7, z=17.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37795, -12.57797), pm (1.3, -3.3), parallax 0.122 with NanoMaggies: g=19.5, r=18.9, z=18.7 Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36296, -12.57677), pm (-2.5, -4.7), parallax 0.154 with NanoMaggies: g=14.8, r=13.8, z=13.3 Reset brightness to NanoMaggies: g=20.2, r=19.9, z=19.9 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.79176, ee1=-0.351516, ee2=0.280836 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37342, -12.57368), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=18.9, r=19.7, z=14.7 Reset brightness to NanoMaggies: g=21.2, r=20.8, z=20.6 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37564, -12.58421), pm (-7.3, -8.3), parallax 1.068 with NanoMaggies: g=20.1, r=20, z=19.5 Reset brightness to NanoMaggies: g=20.9, r=20.8, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37577, -12.57478), pm (3.8, -0.6), parallax -0.296 with NanoMaggies: g=18.3, r=17.5, z=16.4 Reset brightness to NanoMaggies: g=21, r=20.8, z=20.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.37687, -12.57790), pm (-5.5, -6.1), parallax -0.201 with NanoMaggies: g=16, r=14.8, z=14 Reset brightness to NanoMaggies: g=20.9, r=20.8, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36819, -12.58575), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21, r=19.7, z=19.1 Reset brightness to NanoMaggies: g=21.9, r=20.9, z=20.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36681, -12.57434), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=16.9, r=15.9, z=15.5 Reset brightness to NanoMaggies: g=21.1, r=20.9, z=20.9 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (313.36451, -12.57845), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.4, r=20.7, z=21.3 Reset brightness to NanoMaggies: g=22.1, r=21.1, z=20.7 Blob 1 finished, total: Wall: 3.71 s, CPU: 3.70 s, VmPeak: 950 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146036 MB Old catalog: 44 New catalog: 38 T_dup: tabledata object with 1 rows and 63 columns: a_g_val () shape (1,) dtype float32 astrometric_excess_noise () shape (1,) dtype float32 astrometric_excess_noise_sig () shape (1,) dtype float32 astrometric_n_good_obs_al () shape (1,) dtype int16 astrometric_n_obs_al () shape (1,) dtype int16 astrometric_params_solved () shape (1,) dtype uint8 astrometric_sigma5d_max () shape (1,) dtype float32 astrometric_weight_al () shape (1,) dtype float32 ba () shape (1,) dtype float32 dec () shape (1,) dtype float64 dec_ivar () shape (1,) dtype float32 decam_mag_g () shape (1,) dtype float32 decam_mag_r () shape (1,) dtype float32 decam_mag_z () shape (1,) dtype float32 donotfit () shape (1,) dtype bool duplicated_source () shape (1,) dtype bool e_bp_min_rp_val () shape (1,) dtype float32 freezeparams () shape (1,) dtype bool hmag () shape (1,) dtype float32 ibx () shape (1,) dtype int32 iby () shape (1,) dtype int32 in_bounds () shape (1,) dtype bool isbright () shape (1,) dtype bool iscluster () shape (1,) dtype bool isgaia () shape (1,) dtype bool isgalaxy () shape (1,) dtype uint8 islargegalaxy () shape (1,) dtype bool ismedium () shape (1,) dtype bool istycho () shape (1,) dtype bool jmag () shape (1,) dtype float32 keep_radius () shape (1,) dtype float32 kmag () shape (1,) dtype float32 mag () shape (1,) dtype float32 mask_mag () shape (1,) dtype float32 pa () shape (1,) dtype float32 parallax () shape (1,) dtype float32 parallax_ivar () shape (1,) dtype float32 phot_bp_mean_flux_over_error () shape (1,) dtype float32 phot_bp_mean_mag () shape (1,) dtype float32 phot_bp_n_obs () shape (1,) dtype int16 phot_bp_rp_excess_factor () shape (1,) dtype float32 phot_g_mean_flux_over_error () shape (1,) dtype float32 phot_g_mean_mag () shape (1,) dtype float32 phot_g_n_obs () shape (1,) dtype int16 phot_rp_mean_flux_over_error () shape (1,) dtype float32 phot_rp_mean_mag () shape (1,) dtype float32 phot_rp_n_obs () shape (1,) dtype int16 phot_variable_flag () shape (1,) dtype bool pmdec () shape (1,) dtype float32 pmdec_ivar () shape (1,) dtype float32 pmra () shape (1,) dtype float32 pmra_ivar () shape (1,) dtype float32 pointsource () shape (1,) dtype bool ra () shape (1,) dtype float64 ra_ivar () shape (1,) dtype float32 radius () shape (1,) dtype float32 radius_pix () shape (1,) dtype int64 ref_cat () shape (1,) dtype ) shape (1,) dtype float32 ref_id () shape (1,) dtype int64 source_id () shape (1,) dtype int64 type () shape (1,) dtype ) shape (1,) dtype float32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/blobs-custom-313369m12580.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/metrics/cus/all-models-custom-313369m12580.fits Stage fitblobs : Wall: 3.85 s, CPU: 0.10 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 269 MB, VmData: 296 MB, maxrss: 0.275604 MB Stage fitblobs finished: 2020-07-23T12:12:56.617454 Resources for stage fitblobs : 3.720 s worker CPU, 3.728 s worker Wall, Wall: 3.849 s, Cores in use: 0.99, Total efficiency (on 12 cores): 8.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-23T12:12:56.636342 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-resid.jpg Stage coadds : Wall: 1.36 s, CPU: 0.23 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 270 MB, VmData: 296 MB, maxrss: 0.276076 MB Stage coadds finished: 2020-07-23T12:12:57.996594 Resources for stage coadds : 5.506 s worker CPU, 5.525 s worker Wall, Wall: 1.362 s, Cores in use: 4.22, Total efficiency (on 12 cores): 35.1 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-23T12:12:58.013165 Cut to 1 unWISE tiles Reading WISE tile 3136m122 band 1 Reading WISE tile 3136m122 band 2 Reading WISE tile 3136m122 band 3 Reading WISE tile 3136m122 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 950 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 174 MB, maxrss: 0.187128 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 956 MB, VmSize: 790 MB, VmRSS: 141 MB, VmData: 173 MB, maxrss: 0.202524 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 951 MB, VmSize: 790 MB, VmRSS: 139 MB, VmData: 173 MB, maxrss: 0.202484 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/313/3136m122/unwise-3136m122-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.03 s, CPU: 0.03 s, VmPeak: 850 MB, VmSize: 850 MB, VmRSS: 203 MB, VmData: 236 MB, maxrss: 0.20766 MB Checking for sources inside CLUSTER mask Found 24 of 39 sources inside CLUSTER mask Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/tmp-legacysurvey-custom-313369m12580-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.33 s, CPU: 0.29 s, VmPeak: 1096 MB, VmSize: 1096 MB, VmRSS: 270 MB, VmData: 296 MB, maxrss: 0.276588 MB Stage wise_forced finished: 2020-07-23T12:13:00.343455 Resources for stage wise_forced : 3.413 s worker CPU, 4.719 s worker Wall, Wall: 2.332 s, Cores in use: 1.59, Total efficiency (on 12 cores): 13.3 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-23T12:13:00.364091 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/coadd/cus/custom-313369m12580/legacysurvey-custom-313369m12580-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor-i/cus/tractor-custom-313369m12580.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor/cus/tractor-custom-313369m12580.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/tractor/cus/brick-custom-313369m12580.sha256sum Stage writecat : Wall: 0.69 s, CPU: 0.35 s, VmPeak: 1228 MB, VmSize: 1100 MB, VmRSS: 272 MB, VmData: 297 MB, maxrss: 0.409136 MB Stage writecat finished: 2020-07-23T12:13:01.058141 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.696 s, Cores in use: 0.51, Total efficiency (on 12 cores): 4.3 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/313/DR8-3133m125-4939/DR8-3133m125-4939-largegalaxy-writecat.p All done: 21.768 s worker CPU, 44.042 s worker Wall, Wall: 33.741 s, Cores in use: 0.92, Total efficiency (on 12 cores): 7.7 % Finished galaxy DR8-3133m125-4939 in 0.661 minutes.