Started working on galaxy PGC1098021_GROUP at Fri Jun  5 06:32:04 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.50218310462265 -2.2288528961467318 --width 597 --height 597 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T06:32:05.592519
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '336.50218310462265', '-2.2288528961467318', '--width', '597', '--height', '597', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 336.50218310462265 -2.2288528961467318 --width 597 --height 597 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 336.50218310462265 -2.2288528961467318
Starting process 56636 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 56637 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 56638 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057312 MB
Starting process 56639 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057316 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T06:32:13.591790
Keeping 22 CCDs:
   c4d_170821_032750_ooi_g_ls9.fits.fz c4d_170821_032750_ooi_g_ls9-S28 g exptime 200.0 propid 2014B-0404 seeing 1.81 MJD 57986.144 object DECaLS_27771_g
   c4d_180904_012025_ooi_g_ls9.fits.fz c4d_180904_012025_ooi_g_ls9-S28 g exptime 152.0 propid 2014B-0404 seeing 1.45 MJD 58365.056 object DECaLS_27771_g
   c4d_160812_043634_ooi_z_ls9.fits.fz c4d_160812_043634_ooi_z_ls9-S28 z exptime 80.0 propid 2014B-0404 seeing 0.95 MJD 57612.191 object DECaLS_27771_z
   c4d_170726_045204_ooi_r_ls9.fits.fz c4d_170726_045204_ooi_r_ls9-S28 r exptime 43.0 propid 2014B-0404 seeing 1.09 MJD 57960.202 object DECaLS_27771_r
   c4d_180918_003223_ooi_z_ls9.fits.fz c4d_180918_003223_ooi_z_ls9-S27 z exptime 250.0 propid 2014B-0404 seeing 1.13 MJD 58379.022 object DECaLS_43643_z
   c4d_181006_003441_ooi_r_ls9.fits.fz c4d_181006_003441_ooi_r_ls9-S27 r exptime 112.0 propid 2014B-0404 seeing 1.18 MJD 58397.024 object DECaLS_43643_r
   c4d_181002_012359_ooi_g_ls9.fits.fz c4d_181002_012359_ooi_g_ls9-S27 g exptime 135.0 propid 2014B-0404 seeing 1.15 MJD 58393.058 object DECaLS_43643_g
   c4d_171109_002003_ooi_g_ls9.fits.fz c4d_171109_002003_ooi_g_ls9-N27 g exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 58066.014 object DES survey hex -235-14 tiling 8
   c4d_170927_025457_ooi_r_ls9.fits.fz c4d_170927_025457_ooi_r_ls9-N27 r exptime 90.0 propid 2012B-0001 seeing 0.88 MJD 58023.121 object DES survey hex -235-14 tiling 8
   c4d_170927_025655_ooi_z_ls9.fits.fz c4d_170927_025655_ooi_z_ls9-N27 z exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 58023.123 object DES survey hex -235-14 tiling 8
   c4d_180914_021616_ooi_z_ls9.fits.fz c4d_180914_021616_ooi_z_ls9-S12 z exptime 80.0 propid 2014B-0404 seeing 1.11 MJD 58375.095 object DECaLS_49390_z
   c4d_180907_030301_ooi_g_ls9.fits.fz c4d_180907_030301_ooi_g_ls9-S12 g exptime 93.0 propid 2014B-0404 seeing 1.15 MJD 58368.127 object DECaLS_49390_g
   c4d_180812_032515_ooi_r_ls9.fits.fz c4d_180812_032515_ooi_r_ls9-S12 r exptime 40.0 propid 2014B-0404 seeing 1.16 MJD 58342.143 object DECaLS_49390_r
   c4d_180918_003223_ooi_z_ls9.fits.fz c4d_180918_003223_ooi_z_ls9-S28 z exptime 250.0 propid 2014B-0404 seeing 1.12 MJD 58379.022 object DECaLS_43643_z
   c4d_181006_003441_ooi_r_ls9.fits.fz c4d_181006_003441_ooi_r_ls9-S28 r exptime 112.0 propid 2014B-0404 seeing 1.14 MJD 58397.024 object DECaLS_43643_r
   c4d_181002_012359_ooi_g_ls9.fits.fz c4d_181002_012359_ooi_g_ls9-S28 g exptime 135.0 propid 2014B-0404 seeing 1.16 MJD 58393.058 object DECaLS_43643_g
   c4d_131123_011636_ooi_r_ls9.fits.fz c4d_131123_011636_ooi_r_ls9-N8 r exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56619.053 object DES survey hex -219-24 tiling 2
   c4d_130911_042804_ooi_g_ls9.fits.fz c4d_130911_042804_ooi_g_ls9-N8 g exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 56546.186 object DES survey hex -219-24 tiling 2
   c4d_131012_011009_ooi_z_ls9.fits.fz c4d_131012_011009_ooi_z_ls9-N8 z exptime 90.0 propid 2012B-0001 seeing 0.76 MJD 56577.049 object DES survey hex -219-24 tiling 2
   c4d_131011_015451_ooi_z_ls9.fits.fz c4d_131011_015451_ooi_z_ls9-N27 z exptime 90.0 propid 2012B-0001 seeing 0.84 MJD 56576.080 object DES survey hex -235-14 tiling 1
   c4d_130930_014909_ooi_r_ls9.fits.fz c4d_130930_014909_ooi_r_ls9-N27 r exptime 90.0 propid 2012B-0001 seeing 0.86 MJD 56565.076 object DES survey hex -235-14 tiling 1
   c4d_130910_014701_ooi_g_ls9.fits.fz c4d_130910_014701_ooi_g_ls9-N27 g exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 56545.074 object DES survey hex -235-14 tiling 1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180904T012025_oi[S28,noinherit][2046,4094][real]: DECaLS_2777
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520746-r-20170726T045029_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T032750_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T043424_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181002T012359_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536893-r-20181006T003441_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T003223_oi[S27,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T002003_oi[N27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ee00-z-20170927T025655_oi[N27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952da7f-z-20180914T021616_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95254c6-r-20170927T025457_oi[N27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535945-g-20180907T030301_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T003223_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T032515_oi[S12,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536893-r-20181006T003441_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181002T012359_oi[S28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131012T011009_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546e45-r-20131123T011636_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T015451_oi[N27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546d1a-g-20130911T042804_oi[N8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T014701_oi[N27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T014909_oi[N27,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 21.22 s, CPU: 0.83 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 227 MB, VmData: 261 MB, maxrss: 0.454936 MB
Stage tims finished: 2020-06-05T06:32:34.813543
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954a179-z-20160812T043424_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952682e-g-20171109T002003_oi[N27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9535945-g-20180907T030301_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181002T012359_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131011T015451_oi[N27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9520746-r-20170726T045029_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T003223_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952da7f-z-20180914T021616_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952f17b-z-20180918T003223_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546d1a-g-20130911T042804_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95220ee-g-20170821T032750_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536893-r-20181006T003441_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95254c6-r-20170927T025457_oi[N27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536893-r-20181006T003441_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546420-z-20131012T011009_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9545789-r-20130930T014909_oi[N27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_N10-g-20180904T012025_oi[S28,noinherit][2046,4094][real]: DECaLS_2777 [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536981-g-20181002T012359_oi[S27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951ee00-z-20170927T025655_oi[N27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9532aaf-r-20180812T032515_oi[S12,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546e45-r-20131123T011636_oi[N8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9546715-g-20130910T014701_oi[N27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 7.884 s worker CPU, 74.552 s worker Wall, Wall: 21.223 s, Cores in use: 0.41, Total efficiency (on 4 cores): 10.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T06:32:37.186158
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06328.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06455.fits
Matched 20 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/reference-custom-336502m02228.fits
Stage refs : Wall: 23.09 s, CPU: 1.80 s, VmPeak: 1029 MB, VmSize: 1019 MB, VmRSS: 250 MB, VmData: 282 MB, maxrss: 0.454936 MB
Stage refs finished: 2020-06-05T06:33:00.276822
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 23.092 s, Cores in use: 0.08, Total efficiency (on 4 cores): 1.9 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T06:33:00.278359
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/outlier-mask-custom-336502m02228.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/outliers-pre-custom-336502m02228.jpg
Image c4d_181002_012359_ooi_g_ls9-S27 g : masking 903 positive outlier pixels and 85 negative outlier pixels
Image c4d_170821_032750_ooi_g_ls9-S28 g : masking 3341 positive outlier pixels and 0 negative outlier pixels
Image c4d_180904_012025_ooi_g_ls9-S28 g : masking 1694 positive outlier pixels and 0 negative outlier pixels
Image c4d_171109_002003_ooi_g_ls9-N27 g : masking 850 positive outlier pixels and 0 negative outlier pixels
Image c4d_181002_012359_ooi_g_ls9-S28 g : masking 541 positive outlier pixels and 0 negative outlier pixels
Image c4d_130910_014701_ooi_g_ls9-N27 g : masking 134 positive outlier pixels and 392 negative outlier pixels
Image c4d_180907_030301_ooi_g_ls9-S12 g : masking 182 positive outlier pixels and 0 negative outlier pixels
Image c4d_130911_042804_ooi_g_ls9-N8 g : masking 675 positive outlier pixels and 99 negative outlier pixels
Image c4d_181006_003441_ooi_r_ls9-S28 r : masking 215 positive outlier pixels and 0 negative outlier pixels
Image c4d_170726_045204_ooi_r_ls9-S28 r : masking 334 positive outlier pixels and 151 negative outlier pixels
Image c4d_170927_025457_ooi_r_ls9-N27 r : masking 2240 positive outlier pixels and 100 negative outlier pixels
Image c4d_180812_032515_ooi_r_ls9-S12 r : masking 1425 positive outlier pixels and 0 negative outlier pixels
Image c4d_130930_014909_ooi_r_ls9-N27 r : masking 0 positive outlier pixels and 84 negative outlier pixels
Image c4d_131123_011636_ooi_r_ls9-N8 r : masking 882 positive outlier pixels and 0 negative outlier pixels
Image c4d_180918_003223_ooi_z_ls9-S27 z : masking 767 positive outlier pixels and 0 negative outlier pixels
Image c4d_160812_043634_ooi_z_ls9-S28 z : masking 492 positive outlier pixels and 0 negative outlier pixels
Image c4d_170927_025655_ooi_z_ls9-N27 z : masking 753 positive outlier pixels and 293 negative outlier pixels
Image c4d_180914_021616_ooi_z_ls9-S12 z : masking 223 positive outlier pixels and 135 negative outlier pixels
Image c4d_180918_003223_ooi_z_ls9-S28 z : masking 265 positive outlier pixels and 0 negative outlier pixels
Image c4d_131011_015451_ooi_z_ls9-N27 z : masking 242 positive outlier pixels and 0 negative outlier pixels
Image c4d_131012_011009_ooi_z_ls9-N8 z : masking 151 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/outlier-mask-custom-336502m02228.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/outliers-post-custom-336502m02228.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/outliers-masked-pos-custom-336502m02228.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/outliers-masked-neg-custom-336502m02228.jpg
Stage outliers : Wall: 30.43 s, CPU: 2.92 s, VmPeak: 1157 MB, VmSize: 1102 MB, VmRSS: 322 MB, VmData: 352 MB, maxrss: 0.454936 MB
Stage outliers finished: 2020-06-05T06:33:30.709335
Resources for stage outliers : 11.017 s worker CPU, 13.054 s worker Wall, Wall: 30.433 s, Cores in use: 0.46, Total efficiency (on 4 cores): 11.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T06:33:30.712340
Stage halos : Wall: 1.19 s, CPU: 0.29 s, VmPeak: 1166 MB, VmSize: 1038 MB, VmRSS: 285 MB, VmData: 314 MB, maxrss: 0.454936 MB
Stage halos finished: 2020-06-05T06:33:31.901348
Resources for stage halos : 2.222 s worker CPU, 3.577 s worker Wall, Wall: 1.190 s, Cores in use: 2.11, Total efficiency (on 4 cores): 52.8 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T06:33:31.903199
PSF sigmas in coadd pixels: ['2.94', '2.36', '1.87', '1.83', '1.87', '1.88', '1.70', '2.09']
Using average PSF sigma 2.0680050832855796
Gaussian PSF norm 0.13640913847546984 vs pixelized 0.114189886
average tim pixel scale / coadd scale: 1.0010795435603381
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.77', '1.91', '1.44', '1.89', '1.86', '1.59', '1.40']
Using average PSF sigma 1.6918902186638896
Gaussian PSF norm 0.16673350827493558 vs pixelized 0.1454798
average tim pixel scale / coadd scale: 1.0010921368385577
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.54', '1.83', '1.24', '1.80', '1.82', '1.24', '1.36']
Using average PSF sigma 1.5459742508469585
Gaussian PSF norm 0.18247056289542543 vs pixelized 0.1502956
average tim pixel scale / coadd scale: 1.0010321375623452
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 14.72 s, CPU: 1.10 s, VmPeak: 1166 MB, VmSize: 1102 MB, VmRSS: 335 MB, VmData: 363 MB, maxrss: 0.454936 MB
Stage fit_on_coadds finished: 2020-06-05T06:33:46.626791
Resources for stage fit_on_coadds : 1.931 s worker CPU, 2.153 s worker Wall, Wall: 14.726 s, Cores in use: 0.21, Total efficiency (on 4 cores): 5.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T06:33:46.632455
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 626 potential peaks
Of 626 potential peaks: 483 in veto map, 43 cut by saddle test, 1 cut by aper test, 99 kept
SED z : 99 new peaks
Found 643 potential peaks
Of 643 potential peaks: 584 in veto map, 36 cut by saddle test, 0 cut by aper test, 23 kept
SED r : 23 new peaks
Found 423 potential peaks
Of 423 potential peaks: 386 in veto map, 28 cut by saddle test, 1 cut by aper test, 8 kept
SED g : 8 new peaks
Found 646 potential peaks
Of 646 potential peaks: 590 in veto map, 40 cut by saddle test, 1 cut by aper test, 15 kept
SED Flat : 15 new peaks
Found 847 potential peaks
Of 847 potential peaks: 791 in veto map, 50 cut by saddle test, 0 cut by aper test, 6 kept
SED Red : 6 new peaks
Adding 151 new sources
Median coadd sky for g : 4.3234428e-05
Median coadd sky for r : 0.0001306565
Median coadd sky for z : 0.00057566026
Stage srcs : Wall: 6.99 s, CPU: 3.66 s, VmPeak: 1166 MB, VmSize: 1038 MB, VmRSS: 287 MB, VmData: 314 MB, maxrss: 0.454936 MB
Stage srcs finished: 2020-06-05T06:33:53.620041
Resources for stage srcs : 0.523 s worker CPU, 0.523 s worker Wall, Wall: 6.989 s, Cores in use: 0.60, Total efficiency (on 4 cores): 15.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/PGC1098021_GROUP-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T06:33:58.591628
Blob 1 of 51, id: 20, sources: 65, size: 443x494, npix 118333, brick X: 99,542, Y: 103,597, one pixel: 351 103
Blob 2 of 51, id: 33, sources: 17, size: 139x229, npix 16794, brick X: 0,139, Y: 368,597, one pixel: 35 368
Blob 3 of 51, id: 31, sources: 9, size: 126x127, npix 7527, brick X: 471,597, Y: 359,486, one pixel: 585 359
Blob 4 of 51, id: 16, sources: 5, size: 69x112, npix 3487, brick X: 499,568, Y: 71,183, one pixel: 514 71
Blob 5 of 51, id: 19, sources: 3, size: 60x81, npix 2318, brick X: 417,477, Y: 95,176, one pixel: 452 95
Measuring 4 iterative sources
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 10.35 s, CPU: 10.17 s, VmPeak: 976 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.15902 MB
Blob 6 of 51, id: 27, sources: 6, size: 44x97, npix 2167, brick X: 540,584, Y: 234,331, one pixel: 572 234
Blob 2 finished, total: Wall: 10.43 s, CPU: 10.42 s, VmPeak: 972 MB, VmSize: 731 MB, VmRSS: 157 MB, VmData: 194 MB, maxrss: 0.16106 MB
Blob 7 of 51, id: 46, sources: 3, size: 67x52, npix 2003, brick X: 188,255, Y: 545,597, one pixel: 242 545
Blob 4 finished, total: Wall: 11.17 s, CPU: 11.12 s, VmPeak: 974 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158984 MB
Blob 8 of 51, id: 7, sources: 2, size: 56x58, npix 1847, brick X: 357,413, Y: 22,80, one pixel: 379 22
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 3.97 s, CPU: 3.84 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.161476 MB
Blob 9 of 51, id: 45, sources: 4, size: 58x54, npix 1665, brick X: 431,489, Y: 543,597, one pixel: 444 543
Measuring 3 iterative sources
Measuring 2 iterative sources
Measuring 3 iterative sources
Blob 7 finished, total: Wall: 7.36 s, CPU: 7.26 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 10 of 51, id: 34, sources: 1, size: 41x43, npix 1226, brick X: 391,432, Y: 428,471, one pixel: 405 428
Blob 5 finished, total: Wall: 8.84 s, CPU: 8.84 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.160176 MB
Blob 11 of 51, id: 40, sources: 3, size: 34x57, npix 1222, brick X: 175,209, Y: 497,554, one pixel: 190 497
Blob 8 finished, total: Wall: 5.35 s, CPU: 5.24 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.16218 MB
Blob 12 of 51, id: 8, sources: 1, size: 41x41, npix 1155, brick X: 199,240, Y: 26,67, one pixel: 218 26
Blob 10 finished, total: Wall: 1.47 s, CPU: 1.47 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.160176 MB
Blob 13 of 51, id: 6, sources: 2, size: 52x39, npix 1128, brick X: 55,107, Y: 14,53, one pixel: 91 14
Measuring 1 iterative sources
Blob 9 finished, total: Wall: 3.15 s, CPU: 3.15 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 14 of 51, id: 14, sources: 2, size: 46x29, npix 745, brick X: 411,457, Y: 56,85, one pixel: 439 56
Blob 12 finished, total: Wall: 1.52 s, CPU: 1.41 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.160176 MB
Blob 15 of 51, id: 17, sources: 1, size: 25x38, npix 683, brick X: 572,597, Y: 78,116, one pixel: 588 78
Blob 11 finished, total: Wall: 3.08 s, CPU: 3.08 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.16218 MB
Blob 16 of 51, id: 35, sources: 1, size: 34x29, npix 645, brick X: 107,141, Y: 433,462, one pixel: 117 433
Blob 13 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 17 of 51, id: 41, sources: 1, size: 30x30, npix 595, brick X: 529,559, Y: 501,531, one pixel: 541 501
Blob 14 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.160176 MB
Blob 18 of 51, id: 0, sources: 1, size: 36x20, npix 552, brick X: 465,501, Y: 0,20, one pixel: 467 0
Blob 17 finished, total: Wall: 1.04 s, CPU: 1.04 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.160176 MB
Blob 15 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.16218 MB
Blob 16 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 19 of 51, id: 23, sources: 1, size: 34x28, npix 548, brick X: 132,166, Y: 179,207, one pixel: 145 179
Blob 20 of 51, id: 5, sources: 1, size: 30x31, npix 543, brick X: 340,370, Y: 13,44, one pixel: 357 13
Blob 21 of 51, id: 48, sources: 2, size: 27x34, npix 521, brick X: 147,174, Y: 553,587, one pixel: 160 553
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 20 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 22 of 51, id: 44, sources: 2, size: 31x30, npix 514, brick X: 488,519, Y: 534,564, one pixel: 505 534
Blob 19 finished, total: Wall: 1.28 s, CPU: 1.28 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 23 of 51, id: 47, sources: 1, size: 23x30, npix 478, brick X: 541,564, Y: 549,579, one pixel: 550 549
Blob 18 finished, total: Wall: 1.48 s, CPU: 1.48 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.160176 MB
Blob 22 finished, total: Wall: 0.65 s, CPU: 0.65 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 21 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 24 of 51, id: 39, sources: 2, size: 26x34, npix 459, brick X: 148,174, Y: 481,515, one pixel: 164 481
Blob 25 of 51, id: 24, sources: 1, size: 28x26, npix 456, brick X: 568,596, Y: 189,215, one pixel: 579 189
Blob 26 of 51, id: 9, sources: 1, size: 25x25, npix 414, brick X: 265,290, Y: 26,51, one pixel: 275 26
Measuring 1 iterative sources
Blob 25 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 27 of 51, id: 21, sources: 1, size: 25x26, npix 411, brick X: 32,57, Y: 125,151, one pixel: 45 125
Blob 24 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 28 of 51, id: 32, sources: 1, size: 26x24, npix 396, brick X: 523,549, Y: 363,387, one pixel: 536 363
Blob 23 finished, total: Wall: 1.17 s, CPU: 1.17 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 29 of 51, id: 10, sources: 1, size: 25x25, npix 388, brick X: 420,445, Y: 27,52, one pixel: 433 27
Blob 26 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 30 of 51, id: 15, sources: 1, size: 24x25, npix 378, brick X: 89,113, Y: 58,83, one pixel: 101 58
Blob 27 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 31 of 51, id: 50, sources: 1, size: 25x22, npix 358, brick X: 126,151, Y: 575,597, one pixel: 136 575
Blob 29 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 32 of 51, id: 42, sources: 1, size: 23x24, npix 339, brick X: 412,435, Y: 522,546, one pixel: 422 522
Blob 28 finished, total: Wall: 0.84 s, CPU: 0.84 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 33 of 51, id: 3, sources: 1, size: 23x24, npix 338, brick X: 435,458, Y: 10,34, one pixel: 446 10
Blob 30 finished, total: Wall: 0.74 s, CPU: 0.74 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 34 of 51, id: 38, sources: 1, size: 23x23, npix 338, brick X: 419,442, Y: 473,496, one pixel: 428 473
Blob 31 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 35 of 51, id: 28, sources: 1, size: 23x23, npix 326, brick X: 16,39, Y: 257,280, one pixel: 26 257
Blob 32 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 33 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 36 of 51, id: 12, sources: 1, size: 24x22, npix 324, brick X: 446,470, Y: 34,56, one pixel: 458 34
Blob 37 of 51, id: 29, sources: 1, size: 23x22, npix 312, brick X: 13,36, Y: 323,345, one pixel: 23 323
Blob 34 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 38 of 51, id: 36, sources: 1, size: 22x22, npix 302, brick X: 150,172, Y: 457,479, one pixel: 160 457
Blob 35 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 39 of 51, id: 13, sources: 1, size: 22x21, npix 288, brick X: 525,547, Y: 46,67, one pixel: 533 46
Blob 37 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 40 of 51, id: 25, sources: 1, size: 21x22, npix 280, brick X: 83,104, Y: 222,244, one pixel: 93 222
Blob 36 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 41 of 51, id: 26, sources: 1, size: 22x20, npix 258, brick X: 515,537, Y: 223,243, one pixel: 524 223
Blob 38 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 42 of 51, id: 18, sources: 1, size: 21x21, npix 250, brick X: 303,324, Y: 85,106, one pixel: 312 85
Blob 39 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 43 of 51, id: 30, sources: 1, size: 20x21, npix 248, brick X: 537,557, Y: 330,351, one pixel: 546 330
Blob 42 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 41 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 158 MB, VmData: 195 MB, maxrss: 0.162268 MB
Blob 40 finished, total: Wall: 0.64 s, CPU: 0.64 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 44 of 51, id: 49, sources: 1, size: 20x21, npix 238, brick X: 0,20, Y: 565,586, one pixel: 9 565
Blob 45 of 51, id: 43, sources: 1, size: 20x20, npix 219, brick X: 447,467, Y: 527,547, one pixel: 457 527
Blob 46 of 51, id: 37, sources: 1, size: 19x19, npix 217, brick X: 519,538, Y: 466,485, one pixel: 527 466
Blob 43 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 47 of 51, id: 2, sources: 1, size: 20x18, npix 206, brick X: 565,585, Y: 7,25, one pixel: 573 7
Blob 44 finished, total: Wall: 0.25 s, CPU: 0.16 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 48 of 51, id: 1, sources: 1, size: 18x18, npix 180, brick X: 240,258, Y: 7,25, one pixel: 248 7
Blob 47 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 49 of 51, id: 11, sources: 1, size: 18x18, npix 180, brick X: 136,154, Y: 29,47, one pixel: 144 29
Blob 46 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 50 of 51, id: 22, sources: 1, size: 17x18, npix 162, brick X: 142,159, Y: 153,171, one pixel: 150 153
Blob 49 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 51 of 51, id: 4, sources: 1, size: 17x17, npix 145, brick X: 499,516, Y: 11,28, one pixel: 507 11
Blob 48 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Blob 50 finished, total: Wall: 0.05 s, CPU: 0.05 s, VmPeak: 976 MB, VmSize: 729 MB, VmRSS: 157 MB, VmData: 192 MB, maxrss: 0.160356 MB
Blob 45 finished, total: Wall: 0.90 s, CPU: 0.81 s, VmPeak: 972 MB, VmSize: 732 MB, VmRSS: 159 MB, VmData: 195 MB, maxrss: 0.162716 MB
Blob 51 finished, total: Wall: 0.06 s, CPU: 0.06 s, VmPeak: 974 MB, VmSize: 729 MB, VmRSS: 156 MB, VmData: 192 MB, maxrss: 0.159244 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.09945, ee1=-0.053229, ee2=-0.0194564
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.948729, ee1=-0.334534, ee2=-0.259229
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.148844, ee1=0.151633, ee2=-0.0742667
Measuring 60 iterative sources
Blob 1 finished, total: Wall: 138.78 s, CPU: 138.70 s, VmPeak: 973 MB, VmSize: 793 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.245876 MB
Old catalog: 171
New catalog: 213
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/blobs-custom-336502m02228.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/metrics/cus/all-models-custom-336502m02228.fits
Stage fitblobs : Wall: 148.79 s, CPU: 0.88 s, VmPeak: 1166 MB, VmSize: 1040 MB, VmRSS: 289 MB, VmData: 318 MB, maxrss: 0.454936 MB
Stage fitblobs finished: 2020-06-05T06:36:27.383341
Resources for stage fitblobs : 231.594 s worker CPU, 236.585 s worker Wall, Wall: 148.793 s, Cores in use: 1.56, Total efficiency (on 4 cores): 39.1 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T06:36:27.386942
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/tmp-legacysurvey-custom-336502m02228-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/tmp-legacysurvey-custom-336502m02228-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/tmp-legacysurvey-custom-336502m02228-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/tmp-legacysurvey-custom-336502m02228-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-resid.jpg
Stage coadds : Wall: 116.43 s, CPU: 1.29 s, VmPeak: 1166 MB, VmSize: 1087 MB, VmRSS: 338 MB, VmData: 368 MB, maxrss: 0.454936 MB
Stage coadds finished: 2020-06-05T06:38:23.821377
Resources for stage coadds : 7.230 s worker CPU, 8.295 s worker Wall, Wall: 116.438 s, Cores in use: 0.07, Total efficiency (on 4 cores): 1.8 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T06:38:23.825314
Cut to 2 unWISE tiles
Reading WISE tile 3357m016 band 1
Reading WISE tile 3357m016 band 2
Reading WISE tile 3357m016 band 3
Reading WISE tile 3357m016 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3357m031 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3357m031 band 4
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3357m031 band 2
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m016/unwise-3357m016-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
Reading WISE tile 3357m031 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.91 s, CPU: 1.35 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 159 MB, VmData: 198 MB, maxrss: 0.220972 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.84 s, CPU: 1.03 s, VmPeak: 1068 MB, VmSize: 1008 MB, VmRSS: 157 MB, VmData: 195 MB, maxrss: 0.221372 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 2.82 s, CPU: 5.66 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 161 MB, VmData: 199 MB, maxrss: 0.19836 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/335/3357m031/unwise-3357m031-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.88 s, CPU: 1.51 s, VmPeak: 1102 MB, VmSize: 1102 MB, VmRSS: 257 MB, VmData: 289 MB, maxrss: 0.263308 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/tmp-legacysurvey-custom-336502m02228-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/tmp-legacysurvey-custom-336502m02228-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 66.83 s, CPU: 2.03 s, VmPeak: 1166 MB, VmSize: 1045 MB, VmRSS: 297 MB, VmData: 326 MB, maxrss: 0.454936 MB
Stage wise_forced finished: 2020-06-05T06:39:30.654742
Resources for stage wise_forced : 16.893 s worker CPU, 17.187 s worker Wall, Wall: 66.831 s, Cores in use: 0.28, Total efficiency (on 4 cores): 7.1 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T06:39:30.656902
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/coadd/cus/custom-336502m02228/legacysurvey-custom-336502m02228-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/tractor-i/cus/tractor-custom-336502m02228.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/tractor/cus/tractor-custom-336502m02228.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/336/PGC1098021_GROUP/tractor/cus/brick-custom-336502m02228.sha256sum
Stage writecat : Wall: 19.28 s, CPU: 1.46 s, VmPeak: 1183 MB, VmSize: 1055 MB, VmRSS: 304 MB, VmData: 331 MB, maxrss: 0.454936 MB
Stage writecat finished: 2020-06-05T06:39:49.933118
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 19.277 s, Cores in use: 0.08, Total efficiency (on 4 cores): 1.9 %
Stage writecat finished
All done: 279.296 s worker CPU, 355.931 s worker Wall, Wall: 464.008 s, Cores in use: 0.64, Total efficiency (on 4 cores): 15.9 %
Finished galaxy PGC1098021_GROUP in 13.836 minutes.