Started working on galaxy PGC1962079 at Fri Jun 5 15:56:45 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.98670799999996 31.7412222 --width 369 --height 369 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-06-05T15:56:47.257344 legacypipe git version: DR9.5.2 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.98670799999996', '31.7412222', '--width', '369', '--height', '369', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.98670799999996 31.7412222 --width 369 --height 369 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.98670799999996 31.7412222 Starting process 37874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 37875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB Starting process 37876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB Starting process 37877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-06-05T15:56:47.718060 Keeping 3 CCDs: c4d_160408_100505_ooi_z_ls9.fits.fz c4d_160408_100505_ooi_z_ls9-N31 z exptime 162.0 propid 2014B-0404 seeing 1.49 MJD 57486.418 object DECaLS_18778_z c4d_160803_023232_ooi_r_ls9.fits.fz c4d_160803_023232_ooi_r_ls9-N31 r exptime 73.0 propid 2014B-0404 seeing 1.31 MJD 57603.104 object DECaLS_18778_r c4d_160803_023542_ooi_g_ls9.fits.fz c4d_160803_023542_ooi_g_ls9-S28 g exptime 165.0 propid 2014B-0404 seeing 1.61 MJD 57603.106 object DECaLS_18779_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T023207_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160408T100133_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T023023_oi[N31,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 22.29 s, CPU: 0.88 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 169 MB, VmData: 203 MB, maxrss: 0.450532 MB Stage tims finished: 2020-06-05T15:57:10.010140 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T023207_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160408T100133_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 1.747 s worker CPU, 54.941 s worker Wall, Wall: 22.293 s, Cores in use: 0.12, Total efficiency (on 4 cores): 2.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T023023_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-06-05T15:57:10.042548 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02850.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02979.fits Matched 13 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/reference-custom-277986p31741.fits Stage refs : Wall: 14.78 s, CPU: 10.96 s, VmPeak: 1127 MB, VmSize: 1121 MB, VmRSS: 299 MB, VmData: 330 MB, maxrss: 0.450532 MB Stage refs finished: 2020-06-05T15:57:24.822712 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 14.781 s, Cores in use: 0.74, Total efficiency (on 4 cores): 18.5 % Stage refs finished Running stage outliers Running stage outliers at 2020-06-05T15:57:24.824134 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outlier-mask-custom-277986p31741.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-pre-custom-277986p31741.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outlier-mask-custom-277986p31741.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-post-custom-277986p31741.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-masked-pos-custom-277986p31741.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-masked-neg-custom-277986p31741.jpg Stage outliers : Wall: 0.69 s, CPU: 0.45 s, VmPeak: 1130 MB, VmSize: 1130 MB, VmRSS: 311 MB, VmData: 340 MB, maxrss: 0.450532 MB Stage outliers finished: 2020-06-05T15:57:25.517323 Resources for stage outliers : 0.243 s worker CPU, 0.284 s worker Wall, Wall: 0.694 s, Cores in use: 0.99, Total efficiency (on 4 cores): 24.8 % Stage outliers finished Running stage halos Running stage halos at 2020-06-05T15:57:25.519197 Stage halos : Wall: 0.58 s, CPU: 0.22 s, VmPeak: 1130 MB, VmSize: 1130 MB, VmRSS: 312 MB, VmData: 340 MB, maxrss: 0.450532 MB Stage halos finished: 2020-06-05T15:57:26.099591 Resources for stage halos : 0.103 s worker CPU, 0.512 s worker Wall, Wall: 0.582 s, Cores in use: 0.56, Total efficiency (on 4 cores): 14.1 % Stage halos finished Running stage fit_on_coadds Running stage fit_on_coadds at 2020-06-05T15:57:26.101343 PSF sigmas in coadd pixels: ['2.62'] Using average PSF sigma 2.6213729944509105 Gaussian PSF norm 0.1076133737438489 vs pixelized 0.10100979 average tim pixel scale / coadd scale: 1.0013646972259036 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.13'] Using average PSF sigma 2.131481532631938 Gaussian PSF norm 0.13234681485865352 vs pixelized 0.115830906 average tim pixel scale / coadd scale: 1.0014169841457357 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.42'] Using average PSF sigma 2.4222612764109988 Gaussian PSF norm 0.11645927486065856 vs pixelized 0.10006107 average tim pixel scale / coadd scale: 1.0014454770179195 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.11 s, CPU: 0.09 s, VmPeak: 1130 MB, VmSize: 1130 MB, VmRSS: 313 MB, VmData: 340 MB, maxrss: 0.450532 MB Stage fit_on_coadds finished: 2020-06-05T15:57:26.214628 Resources for stage fit_on_coadds : 0.063 s worker CPU, 0.063 s worker Wall, Wall: 0.114 s, Cores in use: 1.32, Total efficiency (on 4 cores): 33.0 % Stage fit_on_coadds finished Running stage srcs Running stage srcs at 2020-06-05T15:57:26.216470 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 66 potential peaks Of 66 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 36 kept SED z : 36 new peaks Found 88153 potential peaks Of 88153 potential peaks: 88149 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 48893 potential peaks Of 48893 potential peaks: 48886 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 451 potential peaks Of 451 potential peaks: 449 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 441 potential peaks Of 441 potential peaks: 437 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 42 new sources Median coadd sky for g : 0.00013830472 Median coadd sky for r : 0.00053449604 Median coadd sky for z : -0.00012753616 Stage srcs : Wall: 3.95 s, CPU: 0.72 s, VmPeak: 1130 MB, VmSize: 1130 MB, VmRSS: 314 MB, VmData: 340 MB, maxrss: 0.450532 MB Stage srcs finished: 2020-06-05T15:57:30.170197 Resources for stage srcs : 4.601 s worker CPU, 4.602 s worker Wall, Wall: 3.955 s, Cores in use: 1.34, Total efficiency (on 4 cores): 33.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-06-05T15:57:30.188145 Blob 1 of 6, id: 0, sources: 68, size: 369x369, npix 112448, brick X: 0,369, Y: 0,369, one pixel: 0 0 Blob 2 of 6, id: 1, sources: 5, size: 107x69, npix 2824, brick X: 51,158, Y: 287,356, one pixel: 85 287 Blob 3 of 6, id: 3, sources: 1, size: 41x49, npix 1300, brick X: 30,71, Y: 318,367, one pixel: 52 318 Blob 4 of 6, id: 4, sources: 2, size: 36x32, npix 718, brick X: 2,38, Y: 337,369, one pixel: 10 337 Blob 5 of 6, id: 5, sources: 1, size: 38x24, npix 684, brick X: 303,341, Y: 345,369, one pixel: 318 345 Blob 3 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 684 MB, VmSize: 684 MB, VmRSS: 111 MB, VmData: 163 MB, maxrss: 0.114148 MB Blob 6 of 6, id: 2, sources: 1, size: 19x24, npix 323, brick X: 0,19, Y: 295,319, one pixel: 4 295 Blob 4 finished, total: Wall: 2.07 s, CPU: 2.07 s, VmPeak: 928 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148784 MB Blob 6 finished, total: Wall: 0.62 s, CPU: 0.62 s, VmPeak: 928 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148784 MB Blob 5 finished, total: Wall: 1.74 s, CPU: 1.74 s, VmPeak: 684 MB, VmSize: 684 MB, VmRSS: 112 MB, VmData: 163 MB, maxrss: 0.1142 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 4.84 s, CPU: 4.84 s, VmPeak: 928 MB, VmSize: 715 MB, VmRSS: 141 MB, VmData: 178 MB, maxrss: 0.144504 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.02227, 31.71554), pm (13.2, -43.5), parallax 2.565 with NanoMaggies: g=14.4, r=13.7, z=13.4 Reset brightness to NanoMaggies: g=14.4, r=13.7, z=13.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.95628, 31.74691), pm (-5.9, 0.2), parallax 0.741 with NanoMaggies: g=15.1, r=14.6, z=14.4 Reset brightness to NanoMaggies: g=15.1, r=14.6, z=14.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.01163, 31.73042), pm (-1.5, 1.7), parallax 1.083 with NanoMaggies: g=15.5, r=14.7, z=14.3 Reset brightness to NanoMaggies: g=15.5, r=14.7, z=14.3 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.80306, ee1=-0.0946786, ee2=0.312575 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00359, 31.73843), pm (-3.1, -2.5), parallax 0.680 with NanoMaggies: g=16.8, r=16.3, z=17.1 Reset brightness to NanoMaggies: g=17, r=16.3, z=16 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.96944, 31.75061), pm (-5.1, -5.9), parallax 0.109 with NanoMaggies: g=(flux -2.21e+03), r=17.2, z=(flux -14.4) Reset brightness to NanoMaggies: g=17.3, r=16.9, z=16.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00547, 31.72705), pm (-3.2, -0.8), parallax 0.621 with NanoMaggies: g=18.7, r=17.8, z=17.4 Reset brightness to NanoMaggies: g=18.7, r=17.8, z=17.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.97216, 31.72587), pm (-3.9, 0.6), parallax 0.589 with NanoMaggies: g=19.3, r=18.1, z=(flux -1.16e+03) Reset brightness to NanoMaggies: g=19.3, r=18.1, z=17.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.96693, 31.75877), pm (-2.4, -7.8), parallax -0.023 with NanoMaggies: g=18.7, r=18, z=17.7 Reset brightness to NanoMaggies: g=18.7, r=18, z=17.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.98371, 31.72569), pm (-6.4, -7.4), parallax -0.077 with NanoMaggies: g=19.5, r=18.9, z=12.4 Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.96997, 31.75211), pm (-5.2, -8.3), parallax -0.389 with NanoMaggies: g=18.1, r=22.3, z=(flux -81.2) Reset brightness to NanoMaggies: g=20.5, r=19.8, z=19.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00507, 31.73248), pm (-1.3, -0.0), parallax 0.629 with NanoMaggies: g=20.4, r=19.9, z=(flux -4.04e+05) Reset brightness to NanoMaggies: g=20.4, r=19.9, z=19.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.97166, 31.72747), pm (-4.3, -6.5), parallax -0.204 with NanoMaggies: g=21.3, r=20.1, z=19.5 Reset brightness to NanoMaggies: g=21.3, r=20.1, z=19.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00380, 31.72819), pm (-4.0, -13.0), parallax 2.426 with NanoMaggies: g=21.6, r=20.7, z=(flux -70.6) Reset brightness to NanoMaggies: g=21.6, r=20.7, z=20.2 Measuring 10 iterative sources Blob 1 finished, total: Wall: 27.48 s, CPU: 27.48 s, VmPeak: 946 MB, VmSize: 761 MB, VmRSS: 196 MB, VmData: 224 MB, maxrss: 0.210856 MB Old catalog: 80 New catalog: 84 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/blobs-custom-277986p31741.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/all-models-custom-277986p31741.fits Stage fitblobs : Wall: 28.42 s, CPU: 0.83 s, VmPeak: 1130 MB, VmSize: 1130 MB, VmRSS: 318 MB, VmData: 345 MB, maxrss: 0.450532 MB Stage fitblobs finished: 2020-06-05T15:57:58.606421 Resources for stage fitblobs : 38.057 s worker CPU, 38.084 s worker Wall, Wall: 28.420 s, Cores in use: 1.37, Total efficiency (on 4 cores): 34.2 % Stage fitblobs finished Running stage coadds Running stage coadds at 2020-06-05T15:57:58.611592 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-resid.jpg Stage coadds : Wall: 5.04 s, CPU: 0.69 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 327 MB, VmData: 353 MB, maxrss: 0.450532 MB Stage coadds finished: 2020-06-05T15:58:03.652546 Resources for stage coadds : 8.376 s worker CPU, 8.504 s worker Wall, Wall: 5.042 s, Cores in use: 1.80, Total efficiency (on 4 cores): 45.0 % Stage coadds finished Running stage wise_forced Running stage wise_forced at 2020-06-05T15:58:03.654000 Cut to 2 unWISE tiles Reading WISE tile 2770p318 band 1 Reading WISE tile 2770p318 band 2 Reading WISE tile 2770p318 band 4 Reading WISE tile 2770p318 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 4 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 1 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 2 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.27 s, CPU: 0.59 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 163 MB, VmData: 195 MB, maxrss: 0.22696 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.32 s, CPU: 0.66 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 152 MB, VmData: 193 MB, maxrss: 0.190324 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.19 s, CPU: 0.39 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.208984 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.15 s, CPU: 0.28 s, VmPeak: 1000 MB, VmSize: 1000 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.214208 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 5.70 s, CPU: 0.50 s, VmPeak: 1131 MB, VmSize: 1131 MB, VmRSS: 328 MB, VmData: 353 MB, maxrss: 0.450532 MB Stage wise_forced finished: 2020-06-05T15:58:09.349291 Resources for stage wise_forced : 8.537 s worker CPU, 16.245 s worker Wall, Wall: 5.697 s, Cores in use: 1.59, Total efficiency (on 4 cores): 39.7 % Stage wise_forced finished Running stage writecat Running stage writecat at 2020-06-05T15:58:09.351090 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/tractor-i/cus/tractor-custom-277986p31741.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/tractor/cus/tractor-custom-277986p31741.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/tractor/cus/brick-custom-277986p31741.sha256sum Stage writecat : Wall: 0.77 s, CPU: 0.59 s, VmPeak: 1263 MB, VmSize: 1135 MB, VmRSS: 330 MB, VmData: 353 MB, maxrss: 0.468968 MB Stage writecat finished: 2020-06-05T15:58:10.119572 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.769 s, Cores in use: 0.77, Total efficiency (on 4 cores): 19.2 % Stage writecat finished All done: 61.729 s worker CPU, 123.239 s worker Wall, Wall: 82.407 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.6 % Finished galaxy PGC1962079 in 1.413 minutes. Started working on galaxy PGC1962079 at Sat Jul 18 21:15:03 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.98670799999996 31.7412222 --width 369 --height 369 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-07-18T21:15:04.503451 legacypipe git version: DR9.5.5-6-g531bd718 Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '277.98670799999996', '31.7412222', '--width', '369', '--height', '369', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 277.98670799999996 31.7412222 --width 369 --height 369 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 277.98670799999996 31.7412222 Starting process 36897 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 36898 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB Starting process 36899 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 36900 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB Starting process 36901 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB Starting process 36902 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB Starting process 36903 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 36904 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 36905 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 36906 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 36907 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB Starting process 36908 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 36909 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB Starting process 36910 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 36911 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB Starting process 36912 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 36913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 36914 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 36915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB Starting process 36916 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 36917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB Starting process 36918 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 36919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB Starting process 36920 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058892 MB Starting process 36921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB Starting process 36922 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 36923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 36924 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB Starting process 36925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 36926 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 36927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB Starting process 36928 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-07-18T21:15:05.119962 Keeping 3 CCDs: c4d_160408_100505_ooi_z_ls9.fits.fz c4d_160408_100505_ooi_z_ls9-N31 z exptime 162.0 propid 2014B-0404 seeing 1.49 MJD 57486.418 object DECaLS_18778_z c4d_160803_023232_ooi_r_ls9.fits.fz c4d_160803_023232_ooi_r_ls9-N31 r exptime 73.0 propid 2014B-0404 seeing 1.31 MJD 57603.104 object DECaLS_18778_r c4d_160803_023542_ooi_g_ls9.fits.fz c4d_160803_023542_ooi_g_ls9-S28 g exptime 165.0 propid 2014B-0404 seeing 1.61 MJD 57603.106 object DECaLS_18779_g The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T023207_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T023023_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160408T100133_oi[N31,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 4.76 s, CPU: 0.89 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 170 MB, VmData: 205 MB, maxrss: 0.209304 MB Stage tims finished: 2020-07-18T21:15:09.876232 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954d4d0-z-20160408T100133_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 1.495 s worker CPU, 9.046 s worker Wall, Wall: 4.759 s, Cores in use: 0.50, Total efficiency (on 32 cores): 1.6 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T023207_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-07-18T21:15:09.889104 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02850.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02979.fits Matched 13 large galaxies to Gaia stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/reference-custom-277986p31741.fits Stage refs : Wall: 10.91 s, CPU: 10.56 s, VmPeak: 1130 MB, VmSize: 1124 MB, VmRSS: 301 MB, VmData: 332 MB, maxrss: 0.308104 MB Stage refs finished: 2020-07-18T21:15:20.797823 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9568098-r-20160803T023023_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 10.911 s, Cores in use: 0.97, Total efficiency (on 32 cores): 3.0 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-07-18T21:15:20.839116 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outlier-mask-custom-277986p31741.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-pre-custom-277986p31741.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outlier-mask-custom-277986p31741.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-post-custom-277986p31741.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-masked-pos-custom-277986p31741.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/outliers-masked-neg-custom-277986p31741.jpg Stage outliers : Wall: 1.95 s, CPU: 0.65 s, VmPeak: 1134 MB, VmSize: 1134 MB, VmRSS: 314 MB, VmData: 343 MB, maxrss: 0.321604 MB Stage outliers finished: 2020-07-18T21:15:22.791183 Resources for stage outliers : 0.302 s worker CPU, 0.370 s worker Wall, Wall: 1.955 s, Cores in use: 0.49, Total efficiency (on 32 cores): 1.5 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-07-18T21:15:22.824148 Stage halos : Wall: 1.98 s, CPU: 1.71 s, VmPeak: 1134 MB, VmSize: 1134 MB, VmRSS: 314 MB, VmData: 343 MB, maxrss: 0.3218 MB Stage halos finished: 2020-07-18T21:15:24.800393 Resources for stage halos : 0.138 s worker CPU, 0.399 s worker Wall, Wall: 1.978 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-07-18T21:15:25.333021 PSF sigmas in coadd pixels: ['2.62'] Using average PSF sigma 2.6213729944509105 Gaussian PSF norm 0.1076133737438489 vs pixelized 0.10100979 average tim pixel scale / coadd scale: 1.0013646972259036 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.13'] Using average PSF sigma 2.131481532631938 Gaussian PSF norm 0.13234681485865352 vs pixelized 0.115830906 average tim pixel scale / coadd scale: 1.0014169841457357 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-copsf-r.fits.fz PSF sigmas in coadd pixels: ['2.42'] Using average PSF sigma 2.4222612764109988 Gaussian PSF norm 0.11645927486065856 vs pixelized 0.10006107 average tim pixel scale / coadd scale: 1.0014454770179195 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.09 s, VmPeak: 1134 MB, VmSize: 1134 MB, VmRSS: 316 MB, VmData: 343 MB, maxrss: 0.323272 MB Stage fit_on_coadds finished: 2020-07-18T21:15:25.460314 Resources for stage fit_on_coadds : 0.053 s worker CPU, 0.070 s worker Wall, Wall: 0.130 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-07-18T21:15:25.474948 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 66 potential peaks Of 66 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 36 kept SED z : 36 new peaks Found 88153 potential peaks Of 88153 potential peaks: 88149 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept SED r : 2 new peaks Found 48893 potential peaks Of 48893 potential peaks: 48886 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept SED g : 2 new peaks Found 451 potential peaks Of 451 potential peaks: 449 in veto map, 1 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 441 potential peaks Of 441 potential peaks: 437 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 42 new sources Median coadd sky for g : 0.00013830472 Median coadd sky for r : 0.00053449604 Median coadd sky for z : -0.00012753616 Stage srcs : Wall: 4.43 s, CPU: 1.20 s, VmPeak: 1134 MB, VmSize: 1134 MB, VmRSS: 316 MB, VmData: 343 MB, maxrss: 0.323796 MB Stage srcs finished: 2020-07-18T21:15:29.900788 Resources for stage srcs : 4.482 s worker CPU, 4.544 s worker Wall, Wall: 4.428 s, Cores in use: 1.28, Total efficiency (on 32 cores): 4.0 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-07-18T21:15:34.279682 Blob 1 of 6, id: 0, sources: 68, size: 369x369, npix 112448, brick X: 0,369, Y: 0,369, one pixel: 0 0 Blob 2 of 6, id: 1, sources: 5, size: 107x69, npix 2824, brick X: 51,158, Y: 287,356, one pixel: 85 287 Blob 3 of 6, id: 3, sources: 1, size: 41x49, npix 1300, brick X: 30,71, Y: 318,367, one pixel: 52 318 Blob 4 of 6, id: 4, sources: 2, size: 36x32, npix 718, brick X: 2,38, Y: 337,369, one pixel: 10 337 Blob 5 of 6, id: 5, sources: 1, size: 38x24, npix 684, brick X: 303,341, Y: 345,369, one pixel: 318 345 Blob 6 of 6, id: 2, sources: 1, size: 19x24, npix 323, brick X: 0,19, Y: 295,319, one pixel: 4 295 Blob 6 finished, total: Wall: 0.47 s, CPU: 0.47 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 91 MB, VmData: 137 MB, maxrss: 0.093604 MB Blob 3 finished, total: Wall: 0.85 s, CPU: 0.81 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.091204 MB Blob 5 finished, total: Wall: 1.29 s, CPU: 1.25 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.0906 MB Blob 4 finished, total: Wall: 1.38 s, CPU: 1.38 s, VmPeak: 663 MB, VmSize: 663 MB, VmRSS: 95 MB, VmData: 141 MB, maxrss: 0.097348 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 3.37 s, CPU: 3.36 s, VmPeak: 666 MB, VmSize: 664 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.099868 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.02227, 31.71554), pm (13.2, -43.5), parallax 2.565 with NanoMaggies: g=14.4, r=13.7, z=13.4 Reset brightness to NanoMaggies: g=14.4, r=13.7, z=13.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.95628, 31.74691), pm (-5.9, 0.2), parallax 0.741 with NanoMaggies: g=15.1, r=14.6, z=14.4 Reset brightness to NanoMaggies: g=15.1, r=14.6, z=14.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.01163, 31.73042), pm (-1.5, 1.7), parallax 1.083 with NanoMaggies: g=15.5, r=14.7, z=14.3 Reset brightness to NanoMaggies: g=15.5, r=14.7, z=14.3 Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.80306, ee1=-0.0946786, ee2=0.312575 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00359, 31.73843), pm (-3.1, -2.5), parallax 0.680 with NanoMaggies: g=16.8, r=16.3, z=17.1 Reset brightness to NanoMaggies: g=17, r=16.3, z=16 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.96944, 31.75061), pm (-5.1, -5.9), parallax 0.109 with NanoMaggies: g=(flux -2.21e+03), r=17.2, z=(flux -14.4) Reset brightness to NanoMaggies: g=17.3, r=16.9, z=16.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00547, 31.72705), pm (-3.2, -0.8), parallax 0.621 with NanoMaggies: g=18.7, r=17.8, z=17.4 Reset brightness to NanoMaggies: g=18.7, r=17.8, z=17.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.97216, 31.72587), pm (-3.9, 0.6), parallax 0.589 with NanoMaggies: g=19.3, r=18.1, z=(flux -1.16e+03) Reset brightness to NanoMaggies: g=19.3, r=18.1, z=17.3 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.96693, 31.75877), pm (-2.4, -7.8), parallax -0.023 with NanoMaggies: g=18.7, r=18, z=17.7 Reset brightness to NanoMaggies: g=18.7, r=18, z=17.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.98371, 31.72569), pm (-6.4, -7.4), parallax -0.077 with NanoMaggies: g=19.5, r=18.9, z=12.4 Reset brightness to NanoMaggies: g=19.5, r=18.9, z=18.7 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.96997, 31.75211), pm (-5.2, -8.3), parallax -0.389 with NanoMaggies: g=18.1, r=22.3, z=(flux -81.2) Reset brightness to NanoMaggies: g=20.5, r=19.8, z=19.4 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00507, 31.73248), pm (-1.3, -0.0), parallax 0.629 with NanoMaggies: g=20.4, r=19.9, z=(flux -4.04e+05) Reset brightness to NanoMaggies: g=20.4, r=19.9, z=19.8 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (277.97166, 31.72747), pm (-4.3, -6.5), parallax -0.204 with NanoMaggies: g=21.3, r=20.1, z=19.5 Reset brightness to NanoMaggies: g=21.3, r=20.1, z=19.5 Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (278.00380, 31.72819), pm (-4.0, -13.0), parallax 2.426 with NanoMaggies: g=21.6, r=20.7, z=(flux -70.6) Reset brightness to NanoMaggies: g=21.6, r=20.7, z=20.2 Measuring 10 iterative sources Blob 1 finished, total: Wall: 25.78 s, CPU: 25.76 s, VmPeak: 745 MB, VmSize: 737 MB, VmRSS: 179 MB, VmData: 214 MB, maxrss: 0.188904 MB Old catalog: 80 New catalog: 84 T_dup: tabledata object with 1 rows and 62 columns: a_g_val () shape (1,) dtype float32 astrometric_excess_noise () shape (1,) dtype float32 astrometric_excess_noise_sig () shape (1,) dtype float32 astrometric_n_good_obs_al () shape (1,) dtype int16 astrometric_n_obs_al () shape (1,) dtype int16 astrometric_params_solved () shape (1,) dtype uint8 astrometric_sigma5d_max () shape (1,) dtype float32 astrometric_weight_al () shape (1,) dtype float32 ba () shape (1,) dtype float32 dec () shape (1,) dtype float64 dec_ivar () shape (1,) dtype float32 decam_mag_g () shape (1,) dtype float32 decam_mag_r () shape (1,) dtype float32 decam_mag_z () shape (1,) dtype float32 donotfit () shape (1,) dtype bool duplicated_source () shape (1,) dtype bool e_bp_min_rp_val () shape (1,) dtype float32 freezeparams () shape (1,) dtype bool hmag () shape (1,) dtype float32 ibx () shape (1,) dtype int32 iby () shape (1,) dtype int32 in_bounds () shape (1,) dtype bool isbright () shape (1,) dtype bool iscluster () shape (1,) dtype bool isgaia () shape (1,) dtype bool isgalaxy () shape (1,) dtype uint8 islargegalaxy () shape (1,) dtype bool ismedium () shape (1,) dtype bool istycho () shape (1,) dtype bool jmag () shape (1,) dtype float32 keep_radius () shape (1,) dtype float32 kmag () shape (1,) dtype float32 mag () shape (1,) dtype float32 mask_mag () shape (1,) dtype float32 pa () shape (1,) dtype float32 parallax () shape (1,) dtype float32 parallax_ivar () shape (1,) dtype float32 phot_bp_mean_flux_over_error () shape (1,) dtype float32 phot_bp_mean_mag () shape (1,) dtype float32 phot_bp_n_obs () shape (1,) dtype int16 phot_bp_rp_excess_factor () shape (1,) dtype float32 phot_g_mean_flux_over_error () shape (1,) dtype float32 phot_g_mean_mag () shape (1,) dtype float32 phot_g_n_obs () shape (1,) dtype int16 phot_rp_mean_flux_over_error () shape (1,) dtype float32 phot_rp_mean_mag () shape (1,) dtype float32 phot_rp_n_obs () shape (1,) dtype int16 phot_variable_flag () shape (1,) dtype bool pmdec () shape (1,) dtype float32 pmdec_ivar () shape (1,) dtype float32 pmra () shape (1,) dtype float32 pmra_ivar () shape (1,) dtype float32 pointsource () shape (1,) dtype bool ra () shape (1,) dtype float64 ra_ivar () shape (1,) dtype float32 radius () shape (1,) dtype float32 radius_pix () shape (1,) dtype int64 ref_cat () shape (1,) dtype ) shape (1,) dtype float32 ref_id () shape (1,) dtype int64 source_id () shape (1,) dtype int64 zguess () shape (1,) dtype float32 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/blobs-custom-277986p31741.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/metrics/cus/all-models-custom-277986p31741.fits Stage fitblobs : Wall: 28.97 s, CPU: 1.38 s, VmPeak: 1134 MB, VmSize: 1134 MB, VmRSS: 321 MB, VmData: 348 MB, maxrss: 0.328624 MB Stage fitblobs finished: 2020-07-18T21:16:03.251966 Resources for stage fitblobs : 33.181 s worker CPU, 33.330 s worker Wall, Wall: 28.975 s, Cores in use: 1.19, Total efficiency (on 32 cores): 3.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-07-18T21:16:03.273888 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-resid.jpg Stage coadds : Wall: 11.19 s, CPU: 0.94 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 329 MB, VmData: 356 MB, maxrss: 0.336896 MB Stage coadds finished: 2020-07-18T21:16:14.468127 Resources for stage coadds : 55.632 s worker CPU, 69.503 s worker Wall, Wall: 11.197 s, Cores in use: 5.05, Total efficiency (on 32 cores): 15.8 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-07-18T21:16:14.489926 Cut to 2 unWISE tiles Reading WISE tile 2770p318 band 1 Reading WISE tile 2770p318 band 2 Reading WISE tile 2770p318 band 3 Reading WISE tile 2770p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 3 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 2 Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/277/2770p318/unwise-2770p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits Reading WISE tile 2788p318 band 1 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.29 s, CPU: 0.87 s, VmPeak: 1001 MB, VmSize: 1001 MB, VmRSS: 147 MB, VmData: 191 MB, maxrss: 0.190248 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.23 s, CPU: 0.61 s, VmPeak: 991 MB, VmSize: 991 MB, VmRSS: 136 MB, VmData: 183 MB, maxrss: 0.193456 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.37 s, VmPeak: 997 MB, VmSize: 997 MB, VmRSS: 142 MB, VmData: 187 MB, maxrss: 0.203356 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/278/2788p318/unwise-2788p318-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.16 s, CPU: 0.38 s, VmPeak: 1057 MB, VmSize: 993 MB, VmRSS: 138 MB, VmData: 186 MB, maxrss: 0.19392 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/tmp-legacysurvey-custom-277986p31741-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.40 s, CPU: 0.82 s, VmPeak: 1135 MB, VmSize: 1135 MB, VmRSS: 330 MB, VmData: 356 MB, maxrss: 0.337472 MB Stage wise_forced finished: 2020-07-18T21:16:17.887106 Resources for stage wise_forced : 8.141 s worker CPU, 8.515 s worker Wall, Wall: 3.400 s, Cores in use: 2.64, Total efficiency (on 32 cores): 8.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-07-18T21:16:17.935673 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/coadd/cus/custom-277986p31741/legacysurvey-custom-277986p31741-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/tractor-i/cus/tractor-custom-277986p31741.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/tractor/cus/tractor-custom-277986p31741.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/tractor/cus/brick-custom-277986p31741.sha256sum Stage writecat : Wall: 0.92 s, CPU: 0.76 s, VmPeak: 1267 MB, VmSize: 1139 MB, VmRSS: 331 MB, VmData: 356 MB, maxrss: 0.470256 MB Stage writecat finished: 2020-07-18T21:16:18.852141 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.919 s, Cores in use: 0.83, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/277/PGC1962079/PGC1962079-largegalaxy-writecat.p All done: 103.430 s worker CPU, 125.785 s worker Wall, Wall: 73.762 s, Cores in use: 1.66, Total efficiency (on 32 cores): 5.2 % Finished galaxy PGC1962079 in 1.263 minutes.