Started working on galaxy PGC212980 at Fri Jun  5 05:10:09 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.595083 31.939 --width 345 --height 345 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T05:10:10.422329
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.595083', '31.939', '--width', '345', '--height', '345', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.595083 31.939 --width 345 --height 345 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 36.595083 31.939
Starting process 7805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 7806 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 7807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 7808 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T05:10:20.332476
Keeping 6 CCDs:
   c4d_181103_043124_ooi_g_ls9.fits.fz c4d_181103_043124_ooi_g_ls9-S24 g exptime 183.0 propid 2014B-0404 seeing 1.71 MJD 58425.188 object DECaLS_36739_g
   c4d_181002_061704_ooi_z_ls9.fits.fz c4d_181002_061704_ooi_z_ls9-S24 z exptime 95.0 propid 2014B-0404 seeing 0.95 MJD 58393.262 object DECaLS_36739_z
   c4d_181104_044012_ooi_r_ls9.fits.fz c4d_181104_044012_ooi_r_ls9-S24 r exptime 84.0 propid 2014B-0404 seeing 1.27 MJD 58426.195 object DECaLS_36739_r
   c4d_181102_043407_ooi_g_ls9.fits.fz c4d_181102_043407_ooi_g_ls9-S25 g exptime 145.0 propid 2014B-0404 seeing 1.40 MJD 58424.190 object DECaLS_5011_g
   c4d_181102_043700_ooi_r_ls9.fits.fz c4d_181102_043700_ooi_r_ls9-S25 r exptime 73.0 propid 2014B-0404 seeing 1.10 MJD 58424.192 object DECaLS_5011_r
   c4d_181104_050606_ooi_z_ls9.fits.fz c4d_181104_050606_ooi_z_ls9-S25 z exptime 164.0 propid 2014B-0404 seeing 1.00 MJD 58426.213 object DECaLS_5011_z
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T044012_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T061704_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T043124_oi[S24,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95382f9-g-20181102T043407_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537a95-r-20181102T043700_oi[S25,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181104T050606_oi[S25,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 67.26 s, CPU: 9.05 s, VmPeak: 994 MB, VmSize: 994 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.45466 MB
Stage tims finished: 2020-06-05T05:11:27.596235
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953878f-g-20181103T043124_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95382f9-g-20181102T043407_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530016-z-20181002T061704_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532bf3-z-20181104T050606_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 3.233 s worker CPU, 173.940 s worker Wall, Wall: 67.265 s, Cores in use: 0.18, Total efficiency (on 4 cores): 4.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537eb2-r-20181104T044012_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9537a95-r-20181102T043700_oi[S25,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Running stage refs at 2020-06-05T05:11:27.626895
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02765.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02764.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02893.fits
Matched 2 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/reference-custom-036595p31939.fits
Stage refs : Wall: 19.09 s, CPU: 10.55 s, VmPeak: 1029 MB, VmSize: 1023 MB, VmRSS: 204 MB, VmData: 237 MB, maxrss: 0.45466 MB
Stage refs finished: 2020-06-05T05:11:46.712120
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 19.086 s, Cores in use: 0.55, Total efficiency (on 4 cores): 13.8 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T05:11:46.713560
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/outlier-mask-custom-036595p31939.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/outliers-pre-custom-036595p31939.jpg
Image c4d_181102_043700_ooi_r_ls9-S25 r : masking 645 positive outlier pixels and 0 negative outlier pixels
Image c4d_181104_050606_ooi_z_ls9-S25 z : masking 153 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/outlier-mask-custom-036595p31939.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/outliers-post-custom-036595p31939.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/outliers-masked-pos-custom-036595p31939.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/outliers-masked-neg-custom-036595p31939.jpg
Stage outliers : Wall: 8.15 s, CPU: 6.47 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.45466 MB
Stage outliers finished: 2020-06-05T05:11:54.866244
Resources for stage outliers : 0.793 s worker CPU, 0.798 s worker Wall, Wall: 8.154 s, Cores in use: 0.89, Total efficiency (on 4 cores): 22.3 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T05:11:54.867920
Stage halos : Wall: 12.17 s, CPU: 9.63 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 222 MB, VmData: 251 MB, maxrss: 0.45466 MB
Stage halos finished: 2020-06-05T05:12:07.035249
Resources for stage halos : 0.637 s worker CPU, 8.158 s worker Wall, Wall: 12.169 s, Cores in use: 0.84, Total efficiency (on 4 cores): 21.1 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T05:12:07.037389
PSF sigmas in coadd pixels: ['2.79', '2.27']
Using average PSF sigma 2.525823360724905
Gaussian PSF norm 0.11168429121382331 vs pixelized 0.10601968
average tim pixel scale / coadd scale: 1.001400338309881
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.06', '1.79']
Using average PSF sigma 1.9251228189122598
Gaussian PSF norm 0.14653339984472702 vs pixelized 0.12698115
average tim pixel scale / coadd scale: 1.0014245322574897
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.54', '1.62']
Using average PSF sigma 1.5803773731624957
Gaussian PSF norm 0.17849837422651643 vs pixelized 0.14868873
average tim pixel scale / coadd scale: 1.0013861918487792
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.18 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 223 MB, VmData: 251 MB, maxrss: 0.45466 MB
Stage fit_on_coadds finished: 2020-06-05T05:12:07.254834
Resources for stage fit_on_coadds : 0.208 s worker CPU, 0.208 s worker Wall, Wall: 0.218 s, Cores in use: 1.76, Total efficiency (on 4 cores): 43.9 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T05:12:07.256848
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 43 potential peaks
Of 43 potential peaks: 12 in veto map, 6 cut by saddle test, 0 cut by aper test, 25 kept
SED z : 25 new peaks
Found 44 potential peaks
Of 44 potential peaks: 38 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED r : 1 new peaks
Found 47 potential peaks
Of 47 potential peaks: 40 in veto map, 5 cut by saddle test, 0 cut by aper test, 2 kept
SED g : 2 new peaks
Found 69 potential peaks
Of 69 potential peaks: 54 in veto map, 8 cut by saddle test, 1 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 81 potential peaks
Of 81 potential peaks: 72 in veto map, 8 cut by saddle test, 1 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 34 new sources
Median coadd sky for g : 0.00017360189
Median coadd sky for r : 0.00035264285
Median coadd sky for z : 0.0010156829
Stage srcs : Wall: 10.06 s, CPU: 9.98 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.45466 MB
Stage srcs finished: 2020-06-05T05:12:17.313839
Resources for stage srcs : 0.178 s worker CPU, 0.178 s worker Wall, Wall: 10.058 s, Cores in use: 1.01, Total efficiency (on 4 cores): 25.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/PGC212980-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T05:12:17.330391
Blob 1 of 21, id: 8, sources: 14, size: 175x196, npix 21133, brick X: 78,253, Y: 82,278, one pixel: 210 82
Blob 2 of 21, id: 5, sources: 4, size: 80x115, npix 3866, brick X: 252,332, Y: 52,167, one pixel: 289 52
Blob 3 of 21, id: 2, sources: 2, size: 28x42, npix 797, brick X: 152,180, Y: 31,73, one pixel: 164 31
Blob 4 of 21, id: 3, sources: 1, size: 39x31, npix 726, brick X: 242,281, Y: 39,70, one pixel: 256 39
Blob 5 of 21, id: 14, sources: 1, size: 31x32, npix 690, brick X: 244,275, Y: 199,231, one pixel: 253 199
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.86 s, CPU: 1.86 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149124 MB
Blob 6 of 21, id: 18, sources: 1, size: 29x29, npix 561, brick X: 113,142, Y: 267,296, one pixel: 123 267
Blob 4 finished, total: Wall: 2.14 s, CPU: 1.42 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148684 MB
Blob 7 of 21, id: 15, sources: 1, size: 29x28, npix 527, brick X: 278,307, Y: 230,258, one pixel: 290 230
Blob 5 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Blob 8 of 21, id: 1, sources: 1, size: 28x29, npix 526, brick X: 111,139, Y: 17,46, one pixel: 123 17
Blob 6 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148684 MB
Blob 9 of 21, id: 16, sources: 1, size: 28x28, npix 511, brick X: 306,334, Y: 243,271, one pixel: 317 243
Blob 8 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.148684 MB
Blob 10 of 21, id: 17, sources: 1, size: 27x28, npix 473, brick X: 274,301, Y: 264,292, one pixel: 286 264
Measuring 3 iterative sources
Blob 7 finished, total: Wall: 2.34 s, CPU: 2.34 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Blob 11 of 21, id: 19, sources: 1, size: 25x29, npix 455, brick X: 48,73, Y: 274,303, one pixel: 56 274
Blob 2 finished, total: Wall: 5.43 s, CPU: 5.43 s, VmPeak: 941 MB, VmSize: 721 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.150012 MB
Blob 12 of 21, id: 11, sources: 1, size: 26x26, npix 442, brick X: 309,335, Y: 166,192, one pixel: 319 166
Blob 9 finished, total: Wall: 1.33 s, CPU: 1.33 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149416 MB
Blob 13 of 21, id: 13, sources: 1, size: 26x26, npix 427, brick X: 26,52, Y: 194,220, one pixel: 36 194
Blob 10 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Blob 14 of 21, id: 7, sources: 1, size: 23x25, npix 370, brick X: 161,184, Y: 74,99, one pixel: 170 74
Blob 11 finished, total: Wall: 0.66 s, CPU: 0.66 s, VmPeak: 941 MB, VmSize: 721 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.150012 MB
Blob 15 of 21, id: 20, sources: 1, size: 23x24, npix 351, brick X: 200,223, Y: 284,308, one pixel: 210 284
Blob 12 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149416 MB
Blob 16 of 21, id: 4, sources: 1, size: 18x25, npix 309, brick X: 0,18, Y: 50,75, one pixel: 5 50
Blob 15 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149416 MB
Blob 17 of 21, id: 0, sources: 1, size: 23x22, npix 302, brick X: 74,97, Y: 8,30, one pixel: 84 8
Blob 13 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Blob 18 of 21, id: 6, sources: 1, size: 22x22, npix 283, brick X: 43,65, Y: 53,75, one pixel: 53 53
Blob 17 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Blob 19 of 21, id: 12, sources: 1, size: 21x21, npix 261, brick X: 30,51, Y: 169,190, one pixel: 39 169
Blob 18 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Blob 20 of 21, id: 9, sources: 1, size: 20x20, npix 219, brick X: 15,35, Y: 116,136, one pixel: 25 116
Blob 14 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 941 MB, VmSize: 721 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.150012 MB
Blob 21 of 21, id: 10, sources: 1, size: 17x18, npix 162, brick X: 84,101, Y: 142,160, one pixel: 92 142
Blob 16 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149416 MB
Blob 21 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 941 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149416 MB
Blob 20 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 941 MB, VmSize: 721 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.150012 MB
Blob 19 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 964 MB, VmSize: 720 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149708 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=2.10024, ee1=0.44322, ee2=0.819434
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 15.63 s, CPU: 15.62 s, VmPeak: 958 MB, VmSize: 721 MB, VmRSS: 153 MB, VmData: 184 MB, maxrss: 0.156164 MB
Old catalog: 52
New catalog: 43
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/blobs-custom-036595p31939.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/metrics/cus/all-models-custom-036595p31939.fits
Stage fitblobs : Wall: 27.40 s, CPU: 7.30 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.45466 MB
Stage fitblobs finished: 2020-06-05T05:12:44.733191
Resources for stage fitblobs : 37.918 s worker CPU, 40.574 s worker Wall, Wall: 27.404 s, Cores in use: 1.65, Total efficiency (on 4 cores): 41.3 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T05:12:44.735176
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/tmp-legacysurvey-custom-036595p31939-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/tmp-legacysurvey-custom-036595p31939-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/tmp-legacysurvey-custom-036595p31939-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/tmp-legacysurvey-custom-036595p31939-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-resid.jpg
Stage coadds : Wall: 7.59 s, CPU: 6.52 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 225 MB, VmData: 252 MB, maxrss: 0.45466 MB
Stage coadds finished: 2020-06-05T05:12:52.321884
Resources for stage coadds : 2.923 s worker CPU, 3.176 s worker Wall, Wall: 7.588 s, Cores in use: 1.24, Total efficiency (on 4 cores): 31.1 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T05:12:52.323420
Cut to 1 unWISE tiles
Reading WISE tile 0370p318 band 2
Reading WISE tile 0370p318 band 1
Reading WISE tile 0370p318 band 3
Reading WISE tile 0370p318 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 941 MB, VmSize: 793 MB, VmRSS: 147 MB, VmData: 172 MB, maxrss: 0.211748 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 964 MB, VmSize: 799 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.195436 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 958 MB, VmSize: 796 MB, VmRSS: 151 MB, VmData: 175 MB, maxrss: 0.215492 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/037/0370p318/unwise-0370p318-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 941 MB, VmSize: 796 MB, VmRSS: 150 MB, VmData: 175 MB, maxrss: 0.214656 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/tmp-legacysurvey-custom-036595p31939-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/tmp-legacysurvey-custom-036595p31939-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 27.86 s, CPU: 7.90 s, VmPeak: 1033 MB, VmSize: 1033 MB, VmRSS: 226 MB, VmData: 252 MB, maxrss: 0.45466 MB
Stage wise_forced finished: 2020-06-05T05:13:20.178696
Resources for stage wise_forced : 3.206 s worker CPU, 7.490 s worker Wall, Wall: 27.856 s, Cores in use: 0.40, Total efficiency (on 4 cores): 10.0 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T05:13:20.180448
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/coadd/cus/custom-036595p31939/legacysurvey-custom-036595p31939-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/tractor-i/cus/tractor-custom-036595p31939.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/tractor/cus/tractor-custom-036595p31939.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC212980/tractor/cus/brick-custom-036595p31939.sha256sum
Stage writecat : Wall: 8.12 s, CPU: 7.81 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 228 MB, VmData: 252 MB, maxrss: 0.45466 MB
Stage writecat finished: 2020-06-05T05:13:28.297333
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.118 s, Cores in use: 0.96, Total efficiency (on 4 cores): 24.0 %
Stage writecat finished
All done: 49.096 s worker CPU, 234.524 s worker Wall, Wall: 188.359 s, Cores in use: 0.66, Total efficiency (on 4 cores): 16.5 %
Finished galaxy PGC212980 in 3.316 minutes.