Started working on galaxy PGC453337 at Fri Jun  5 11:02:45 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.6080005 -51.719055600000004 --width 361 --height 361 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T11:02:46.073812
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '299.6080005', '-51.719055600000004', '--width', '361', '--height', '361', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 299.6080005 -51.719055600000004 --width 361 --height 361 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 299.6080005 -51.719055600000004
Starting process 42462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 42463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 42464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 42465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T11:02:46.528813
Keeping 3 CCDs:
   c4d_150928_235246_ooi_z_ls9.fits.fz c4d_150928_235246_ooi_z_ls9-N1 z exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57293.993 object DES survey hex -582-521 tiling 6
   c4d_150912_010255_ooi_g_ls9.fits.fz c4d_150912_010255_ooi_g_ls9-N1 g exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 57277.042 object DES survey hex -582-521 tiling 6
   c4d_150912_010058_ooi_r_ls9.fits.fz c4d_150912_010058_ooi_r_ls9-N1 r exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 57277.041 object DES survey hex -582-521 tiling 6
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T010033_oi[N1,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T005835_oi[N1,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96218ab-z-20150928T235027_oi[N1,noinherit][2046,4094][real]: DES surv
Stage tims : Wall: 11.87 s, CPU: 0.83 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.448432 MB
Stage tims finished: 2020-06-05T11:02:58.398151
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961f01b-g-20150912T010033_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9620e86-r-20150912T005835_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96218ab-z-20150928T235027_oi[N1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 1.894 s worker CPU, 29.298 s worker Wall, Wall: 11.871 s, Cores in use: 0.23, Total efficiency (on 4 cores): 5.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T11:02:58.414429
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10970.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-11071.fits
Matched 2 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/reference-custom-299608m51719.fits
Stage refs : Wall: 6.90 s, CPU: 6.46 s, VmPeak: 1070 MB, VmSize: 1064 MB, VmRSS: 243 MB, VmData: 275 MB, maxrss: 0.448432 MB
Stage refs finished: 2020-06-05T11:03:05.314817
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 6.901 s, Cores in use: 0.94, Total efficiency (on 4 cores): 23.4 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T11:03:05.316466
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/outlier-mask-custom-299608m51719.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/outliers-pre-custom-299608m51719.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/outlier-mask-custom-299608m51719.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/outliers-post-custom-299608m51719.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/outliers-masked-pos-custom-299608m51719.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/outliers-masked-neg-custom-299608m51719.jpg
Stage outliers : Wall: 0.86 s, CPU: 0.50 s, VmPeak: 1073 MB, VmSize: 1073 MB, VmRSS: 258 MB, VmData: 287 MB, maxrss: 0.448432 MB
Stage outliers finished: 2020-06-05T11:03:06.173192
Resources for stage outliers : 0.461 s worker CPU, 0.520 s worker Wall, Wall: 0.858 s, Cores in use: 1.13, Total efficiency (on 4 cores): 28.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T11:03:06.175073
Stage halos : Wall: 0.44 s, CPU: 0.22 s, VmPeak: 1073 MB, VmSize: 1073 MB, VmRSS: 258 MB, VmData: 287 MB, maxrss: 0.448432 MB
Stage halos finished: 2020-06-05T11:03:06.612619
Resources for stage halos : 0.447 s worker CPU, 0.556 s worker Wall, Wall: 0.439 s, Cores in use: 1.53, Total efficiency (on 4 cores): 38.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T11:03:06.614637
PSF sigmas in coadd pixels: ['2.54']
Using average PSF sigma 2.5392369166094713
Gaussian PSF norm 0.11109431732370473 vs pixelized 0.09244374
average tim pixel scale / coadd scale: 1.0010116855357951
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.42']
Using average PSF sigma 2.419070256064752
Gaussian PSF norm 0.1166128974826795 vs pixelized 0.09508947
average tim pixel scale / coadd scale: 1.001027681534214
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.72']
Using average PSF sigma 1.7171371952306065
Gaussian PSF norm 0.16428203439853487 vs pixelized 0.13707429
average tim pixel scale / coadd scale: 1.0009270067191647
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.17 s, CPU: 0.11 s, VmPeak: 1073 MB, VmSize: 1073 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.448432 MB
Stage fit_on_coadds finished: 2020-06-05T11:03:06.780493
Resources for stage fit_on_coadds : 0.159 s worker CPU, 0.159 s worker Wall, Wall: 0.167 s, Cores in use: 1.64, Total efficiency (on 4 cores): 40.9 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T11:03:06.782472
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 51 potential peaks
Of 51 potential peaks: 22 in veto map, 5 cut by saddle test, 0 cut by aper test, 24 kept
SED z : 24 new peaks
Found 54 potential peaks
Of 54 potential peaks: 42 in veto map, 6 cut by saddle test, 0 cut by aper test, 6 kept
SED r : 6 new peaks
Found 28 potential peaks
Of 28 potential peaks: 24 in veto map, 2 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 56 potential peaks
Of 56 potential peaks: 43 in veto map, 7 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 68 potential peaks
Of 68 potential peaks: 55 in veto map, 8 cut by saddle test, 0 cut by aper test, 5 kept
SED Red : 5 new peaks
Adding 43 new sources
Median coadd sky for g : 6.098653e-05
Median coadd sky for r : 7.6255936e-05
Median coadd sky for z : 0.00040152666
Stage srcs : Wall: 0.85 s, CPU: 0.76 s, VmPeak: 1073 MB, VmSize: 1073 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.448432 MB
Stage srcs finished: 2020-06-05T11:03:07.632782
Resources for stage srcs : 0.246 s worker CPU, 0.247 s worker Wall, Wall: 0.851 s, Cores in use: 1.18, Total efficiency (on 4 cores): 29.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/PGC453337-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T11:03:07.650397
Blob 1 of 36, id: 15, sources: 7, size: 182x105, npix 13040, brick X: 82,264, Y: 130,235, one pixel: 160 130
Blob 2 of 36, id: 10, sources: 5, size: 74x83, npix 4707, brick X: 0,74, Y: 49,132, one pixel: 23 49
Blob 3 of 36, id: 7, sources: 2, size: 50x56, npix 1638, brick X: 155,205, Y: 18,74, one pixel: 184 18
Blob 4 of 36, id: 17, sources: 2, size: 46x58, npix 1627, brick X: 288,334, Y: 143,201, one pixel: 313 143
Blob 5 of 36, id: 3, sources: 4, size: 76x20, npix 1305, brick X: 285,361, Y: 0,20, one pixel: 286 0
Blob 3 finished, total: Wall: 2.10 s, CPU: 2.10 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 139 MB, VmData: 179 MB, maxrss: 0.142256 MB
Blob 6 of 36, id: 0, sources: 2, size: 43x39, npix 1089, brick X: 0,43, Y: 0,39, one pixel: 4 0
Blob 4 finished, total: Wall: 2.25 s, CPU: 2.25 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147584 MB
Blob 7 of 36, id: 29, sources: 2, size: 46x40, npix 1066, brick X: 232,278, Y: 279,319, one pixel: 265 279
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.58696, -51.76983), pm (14.8, -40.2), parallax 1.978 with NanoMaggies: g=11.8, r=11.1, z=10.7
Reset brightness to NanoMaggies: g=11.8, r=11.1, z=10.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.58851, -51.73323), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=(flux -58.3), r=(flux -68.5), z=(flux -249)
Reset brightness to NanoMaggies: g=21.8, r=20.8, z=20.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.58439, -51.73195), pm (7.2, 6.3), parallax 1.899 with NanoMaggies: g=18, r=(flux -103), z=(flux -603)
Reset brightness to NanoMaggies: g=20.8, r=19.3, z=17.2
Blob 5 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.14392 MB
Blob 8 of 36, id: 35, sources: 5, size: 67x22, npix 1006, brick X: 216,283, Y: 339,361, one pixel: 273 339
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.62665, -51.73431), pm (-14.4, -0.5), parallax 1.918 with NanoMaggies: g=12.5, r=11.1, z=10.7
Reset brightness to NanoMaggies: g=13.3, r=12.8, z=12.7
Blob 6 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 9 of 36, id: 2, sources: 1, size: 38x35, npix 953, brick X: 241,279, Y: 0,35, one pixel: 251 0
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.59973, -51.69930), pm (16.9, -42.3), parallax 0.742 with NanoMaggies: g=16.9, r=16.2, z=15.9
Reset brightness to NanoMaggies: g=16.9, r=16.2, z=15.9
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.59784, -51.70559), pm (0.2, 0.5), parallax 0.284 with NanoMaggies: g=20, r=20, z=19.7
Reset brightness to NanoMaggies: g=20.1, r=19.8, z=19.8
Blob 8 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 10 of 36, id: 19, sources: 1, size: 37x37, npix 910, brick X: 18,55, Y: 187,224, one pixel: 31 187
Blob 2 finished, total: Wall: 4.44 s, CPU: 4.44 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.118108 MB
Blob 11 of 36, id: 24, sources: 1, size: 38x34, npix 865, brick X: 252,290, Y: 243,277, one pixel: 271 243
Blob 7 finished, total: Wall: 2.04 s, CPU: 2.04 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 12 of 36, id: 25, sources: 2, size: 41x36, npix 841, brick X: 124,165, Y: 255,291, one pixel: 138 255
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 10 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.118108 MB
Blob 13 of 36, id: 26, sources: 1, size: 36x34, npix 826, brick X: 18,54, Y: 258,292, one pixel: 31 258
Blob 9 finished, total: Wall: 1.36 s, CPU: 1.35 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 14 of 36, id: 33, sources: 1, size: 34x28, npix 721, brick X: 146,180, Y: 333,361, one pixel: 165 333
Blob 11 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 15 of 36, id: 9, sources: 1, size: 33x31, npix 659, brick X: 229,262, Y: 37,68, one pixel: 242 37
Blob 13 finished, total: Wall: 1.02 s, CPU: 1.02 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 16 of 36, id: 30, sources: 1, size: 32x31, npix 641, brick X: 176,208, Y: 314,345, one pixel: 190 314
Blob 14 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 17 of 36, id: 16, sources: 2, size: 26x37, npix 547, brick X: 65,91, Y: 134,171, one pixel: 80 134
Blob 12 finished, total: Wall: 1.53 s, CPU: 1.53 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.118204 MB
Blob 18 of 36, id: 14, sources: 1, size: 30x28, npix 533, brick X: 282,312, Y: 95,123, one pixel: 295 95
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.61953, ee1=-0.340068, ee2=0.0744586
Measuring 4 iterative sources
Blob 15 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 19 of 36, id: 11, sources: 2, size: 21x36, npix 478, brick X: 340,361, Y: 60,96, one pixel: 356 60
Blob 17 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.11824 MB
Blob 20 of 36, id: 22, sources: 1, size: 27x27, npix 465, brick X: 64,91, Y: 234,261, one pixel: 77 234
Blob 16 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 21 of 36, id: 1, sources: 2, size: 32x20, npix 455, brick X: 48,80, Y: 0,20, one pixel: 55 0
Blob 1 finished, total: Wall: 8.48 s, CPU: 8.47 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147056 MB
Blob 22 of 36, id: 12, sources: 1, size: 25x26, npix 402, brick X: 202,227, Y: 86,112, one pixel: 213 86
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.58598, -51.72651), pm (4.5, -12.0), parallax 0.728 with NanoMaggies: g=18.2, r=17, z=16.5
Reset brightness to NanoMaggies: g=18.2, r=17.1, z=16.5
Blob 19 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.11824 MB
Blob 23 of 36, id: 23, sources: 1, size: 25x26, npix 399, brick X: 9,34, Y: 238,264, one pixel: 18 238
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (299.62215, -51.73280), pm (-2.1, -7.9), parallax 0.991 with NanoMaggies: g=19.4, r=18.6, z=17.8
Reset brightness to NanoMaggies: g=19.7, r=18.7, z=18.3
Blob 21 finished, total: Wall: 0.48 s, CPU: 0.48 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147056 MB
Blob 24 of 36, id: 18, sources: 1, size: 22x26, npix 393, brick X: 0,22, Y: 169,195, one pixel: 6 169
Blob 22 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.11824 MB
Blob 25 of 36, id: 5, sources: 1, size: 26x25, npix 383, brick X: 116,142, Y: 5,30, one pixel: 127 5
Blob 18 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 26 of 36, id: 34, sources: 1, size: 23x26, npix 360, brick X: 86,109, Y: 334,360, one pixel: 97 334
Blob 25 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 27 of 36, id: 8, sources: 1, size: 24x24, npix 351, brick X: 104,128, Y: 37,61, one pixel: 115 37
Blob 20 finished, total: Wall: 0.97 s, CPU: 0.97 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 28 of 36, id: 32, sources: 1, size: 24x23, npix 349, brick X: 17,41, Y: 331,354, one pixel: 27 331
Blob 26 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 29 of 36, id: 21, sources: 1, size: 23x24, npix 340, brick X: 102,125, Y: 229,253, one pixel: 111 229
Blob 27 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 30 of 36, id: 20, sources: 1, size: 20x22, npix 268, brick X: 288,308, Y: 201,223, one pixel: 298 201
Blob 23 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147056 MB
Blob 31 of 36, id: 13, sources: 1, size: 21x21, npix 249, brick X: 137,158, Y: 92,113, one pixel: 147 92
Blob 24 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.11824 MB
Blob 32 of 36, id: 27, sources: 1, size: 19x20, npix 218, brick X: 95,114, Y: 277,297, one pixel: 103 277
Blob 29 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 33 of 36, id: 28, sources: 1, size: 20x19, npix 218, brick X: 170,190, Y: 278,297, one pixel: 178 278
Blob 30 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147056 MB
Blob 34 of 36, id: 6, sources: 1, size: 19x19, npix 199, brick X: 156,175, Y: 6,25, one pixel: 165 6
Blob 31 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.11824 MB
Blob 35 of 36, id: 31, sources: 1, size: 17x18, npix 162, brick X: 91,108, Y: 315,333, one pixel: 99 315
Blob 33 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147056 MB
Blob 36 of 36, id: 4, sources: 1, size: 17x17, npix 145, brick X: 204,221, Y: 3,20, one pixel: 212 3
Blob 35 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147056 MB
Blob 36 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 937 MB, VmSize: 716 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.147056 MB
Blob 28 finished, total: Wall: 0.89 s, CPU: 0.88 s, VmPeak: 942 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149192 MB
Blob 32 finished, total: Wall: 0.54 s, CPU: 0.54 s, VmPeak: 938 MB, VmSize: 716 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144832 MB
Blob 34 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 687 MB, VmSize: 687 MB, VmRSS: 115 MB, VmData: 166 MB, maxrss: 0.11824 MB
Old catalog: 68
New catalog: 53
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/blobs-custom-299608m51719.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/metrics/cus/all-models-custom-299608m51719.fits
Stage fitblobs : Wall: 11.09 s, CPU: 0.56 s, VmPeak: 1073 MB, VmSize: 1073 MB, VmRSS: 260 MB, VmData: 287 MB, maxrss: 0.448432 MB
Stage fitblobs finished: 2020-06-05T11:03:18.742743
Resources for stage fitblobs : 42.084 s worker CPU, 42.142 s worker Wall, Wall: 11.094 s, Cores in use: 3.84, Total efficiency (on 4 cores): 96.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T11:03:18.744597
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/tmp-legacysurvey-custom-299608m51719-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/tmp-legacysurvey-custom-299608m51719-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/tmp-legacysurvey-custom-299608m51719-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/tmp-legacysurvey-custom-299608m51719-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-resid.jpg
Stage coadds : Wall: 1.96 s, CPU: 0.71 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 265 MB, VmData: 292 MB, maxrss: 0.448432 MB
Stage coadds finished: 2020-06-05T11:03:20.704763
Resources for stage coadds : 3.466 s worker CPU, 3.810 s worker Wall, Wall: 1.961 s, Cores in use: 2.13, Total efficiency (on 4 cores): 53.3 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T11:03:20.706374
Cut to 1 unWISE tiles
Reading WISE tile 3004m515 band 1
Reading WISE tile 3004m515 band 2
Reading WISE tile 3004m515 band 3
Reading WISE tile 3004m515 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.20 s, CPU: 0.20 s, VmPeak: 793 MB, VmSize: 793 MB, VmRSS: 145 MB, VmData: 175 MB, maxrss: 0.1886 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 937 MB, VmSize: 796 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.211568 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 942 MB, VmSize: 796 MB, VmRSS: 149 MB, VmData: 175 MB, maxrss: 0.21176 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/300/3004m515/unwise-3004m515-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 938 MB, VmSize: 796 MB, VmRSS: 148 MB, VmData: 175 MB, maxrss: 0.210788 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/tmp-legacysurvey-custom-299608m51719-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/tmp-legacysurvey-custom-299608m51719-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.49 s, CPU: 0.53 s, VmPeak: 1075 MB, VmSize: 1075 MB, VmRSS: 266 MB, VmData: 292 MB, maxrss: 0.448432 MB
Stage wise_forced finished: 2020-06-05T11:03:23.197233
Resources for stage wise_forced : 5.120 s worker CPU, 6.589 s worker Wall, Wall: 2.492 s, Cores in use: 2.27, Total efficiency (on 4 cores): 56.7 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T11:03:23.199120
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/coadd/cus/custom-299608m51719/legacysurvey-custom-299608m51719-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/tractor-i/cus/tractor-custom-299608m51719.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/tractor/cus/tractor-custom-299608m51719.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/299/PGC453337/tractor/cus/brick-custom-299608m51719.sha256sum
Stage writecat : Wall: 1.80 s, CPU: 1.64 s, VmPeak: 1207 MB, VmSize: 1079 MB, VmRSS: 268 MB, VmData: 292 MB, maxrss: 0.448432 MB
Stage writecat finished: 2020-06-05T11:03:25.001765
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.804 s, Cores in use: 0.91, Total efficiency (on 4 cores): 22.8 %
Stage writecat finished
All done: 53.878 s worker CPU, 83.323 s worker Wall, Wall: 38.478 s, Cores in use: 1.72, Total efficiency (on 4 cores): 43.0 %
Finished galaxy PGC453337 in 0.669 minutes.