Started working on galaxy PGC198973 at Sun Jun  7 05:24:18 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.156648000000004 -29.7817672 --width 387 --height 387 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T05:24:19.084174
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '33.156648000000004', '-29.7817672', '--width', '387', '--height', '387', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 33.156648000000004 -29.7817672 --width 387 --height 387 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 33.156648000000004 -29.7817672
Starting process 9092 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 9093 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057372 MB
Starting process 9094 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.05738 MB
Starting process 9095 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057376 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T05:24:27.134005
Keeping 25 CCDs:
   c4d_180123_010615_ooi_z_ls9.fits.fz c4d_180123_010615_ooi_z_ls9-N16 z exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 58141.046 object DES survey hex 323-298 tiling 9
   c4d_180107_025630_ooi_g_ls9.fits.fz c4d_180107_025630_ooi_g_ls9-N16 g exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 58125.123 object DES survey hex 323-298 tiling 9
   c4d_151215_043949_ooi_r_ls9.fits.fz c4d_151215_043949_ooi_r_ls9-S8 r exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 57371.193 object DES survey hex 340-308 tiling 4
   c4d_170209_004746_ooi_z_ls9.fits.fz c4d_170209_004746_ooi_z_ls9-N16 z exptime 90.0 propid 2012B-0001 seeing 0.86 MJD 57793.032 object DES survey hex 323-298 tiling 7
   c4d_180916_084355_ooi_r_v1.fits.fz c4d_180916_084355_ooi_r_v1-S20 r exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 58377.364 object DES survey hex 340-308 tiling 10
   c4d_160923_032836_ooi_g_ls9.fits.fz c4d_160923_032836_ooi_g_ls9-N13 g exptime 90.0 propid 2012B-0001 seeing 1.57 MJD 57654.143 object DES survey hex 323-298 tiling 5
   c4d_160120_020042_ooi_z_ls9.fits.fz c4d_160120_020042_ooi_z_ls9-N13 z exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57407.082 object DES survey hex 323-298 tiling 5
   c4d_151108_054732_ooi_g_ls9.fits.fz c4d_151108_054732_ooi_g_ls9-N3 g exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57334.240 object DES survey hex 343-288 tiling 3
   c4d_141116_061458_ooi_z_ls9.fits.fz c4d_141116_061458_ooi_z_ls9-N3 z exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56977.259 object DES survey hex 343-288 tiling 3
   c4d_151108_054533_ooi_r_ls9.fits.fz c4d_151108_054533_ooi_r_ls9-N3 r exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 57334.238 object DES survey hex 343-288 tiling 3
   c4d_171207_050449_ooi_z_ls9.fits.fz c4d_171207_050449_ooi_z_ls9-S7 z exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58094.212 object DES survey hex 323-298 tiling 8
   c4d_171020_075834_ooi_r_ls9.fits.fz c4d_171020_075834_ooi_r_ls9-S7 r exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58046.332 object DES survey hex 323-298 tiling 8
   c4d_171020_080032_ooi_g_ls9.fits.fz c4d_171020_080032_ooi_g_ls9-S7 g exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 58046.334 object DES survey hex 323-298 tiling 8
   c4d_180107_025230_ooi_r_ls9.fits.fz c4d_180107_025230_ooi_r_ls9-N16 r exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 58125.120 object DES survey hex 323-298 tiling 9
   c4d_151101_072145_ooi_z_ls9.fits.fz c4d_151101_072145_ooi_z_ls9-S8 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57327.305 object DES survey hex 340-308 tiling 4
   c4d_151215_044147_ooi_g_ls9.fits.fz c4d_151215_044147_ooi_g_ls9-S8 g exptime 90.0 propid 2012B-0001 seeing 1.26 MJD 57371.194 object DES survey hex 340-308 tiling 4
   c4d_141211_041131_ooi_z_ls9.fits.fz c4d_141211_041131_ooi_z_ls9-S22 z exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57002.173 object DES survey hex 340-308 tiling 2
   c4d_151211_011636_ooi_g_ls9.fits.fz c4d_151211_011636_ooi_g_ls9-S22 g exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 57367.052 object DES survey hex 340-308 tiling 2
   c4d_151009_083921_ooi_r_ls9.fits.fz c4d_151009_083921_ooi_r_ls9-S22 r exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 57304.359 object DES survey hex 340-308 tiling 2
   c4d_161207_050351_ooi_r_ls9.fits.fz c4d_161207_050351_ooi_r_ls9-S21 r exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57729.209 object DES survey hex 340-308 tiling 6
   c4d_161218_041236_ooi_z_ls9.fits.fz c4d_161218_041236_ooi_z_ls9-S21 z exptime 90.0 propid 2012B-0001 seeing 0.96 MJD 57740.174 object DES survey hex 340-308 tiling 6
   c4d_161124_061013_ooi_g_v1.fits.fz c4d_161124_061013_ooi_g_v1-S21 g exptime 90.0 propid 2012B-0001 seeing 1.94 MJD 57716.255 object DES survey hex 340-308 tiling 6
   c4d_161126_054500_ooi_g_ls9.fits.fz c4d_161126_054500_ooi_g_ls9-S21 g exptime 90.0 propid 2012B-0001 seeing 1.62 MJD 57718.238 object DES survey hex 340-308 tiling 6
   c4d_151204_031543_ooi_g_ls9.fits.fz c4d_151204_031543_ooi_g_ls9-S6 g exptime 90.0 propid 2012B-0001 seeing 1.33 MJD 57360.134 object DES survey hex 323-298 tiling 1
   c4d_151118_025337_ooi_r_ls9.fits.fz c4d_151118_025337_ooi_r_ls9-S6 r exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57344.119 object DES survey hex 323-298 tiling 1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151215T043727_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95255fd-z-20180123T010615_oi[N16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9509aac-z-20170209T004525_oi[N16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20180107T025630_oi[N16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559d8b-g-20160923T032616_oi[N13,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-r-20180916T084355_oi[S20,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957eec3-g-20151108T054512_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551f30-z-20141116T061237_oi[N3,noinherit][2046,4094][real]: DES surv
Zeroing out 6924 weight-map pixels below quantization error (= median 6.1e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T054313_oi[N3,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160120T015822_oi[N13,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958d10b-z-20151101T071927_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9624859-g-20151215T043926_oi[S8,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T050131_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041012_oi[S21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T060753_oi[S21,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20180107T025230_oi[N16,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[S6,noinherit][2046,4094][real]: DES surv
Zeroing out 519 weight-map pixels below quantization error (= median 0.00022)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[S6,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950265c-g-20161126T054240_oi[S21,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 264.38 s, CPU: 7.91 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 205 MB, VmData: 238 MB, maxrss: 0.45494 MB
Stage tims finished: 2020-06-07T05:28:51.513394
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9509aac-z-20170209T004525_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9550f89-z-20160120T015822_oi[N13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20180107T025230_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95255fd-z-20180123T010615_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559d8b-g-20160923T032616_oi[N13,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551f30-z-20141116T061237_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525f73-r-20171020T075834_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T041012_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ab70-g-20151204T031324_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529278-g-20180107T025630_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957eec3-g-20151108T054512_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524514-z-20171207T050449_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958d10b-z-20151101T071927_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958b0e2-z-20141211T040911_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9622f50-r-20151009T083701_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161124T060753_oi[S21,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958318b-r-20151118T025115_oi[S6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Resources for stage tims : 8.087 s worker CPU, 993.815 s worker Wall, Wall: 264.381 s, Cores in use: 0.06, Total efficiency (on 4 cores): 1.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95892f6-r-20151215T043727_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18B_20180912_92acf38-r-20180916T084355_oi[S20,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T054313_oi[N3,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525daf-g-20171020T080032_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9624859-g-20151215T043926_oi[S8,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9586c68-g-20151211T011414_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9505fe7-r-20161207T050131_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950265c-g-20161126T054240_oi[S21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-06-07T05:28:51.739230
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09163.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09292.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09036.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/reference-custom-033156m29781.fits
Stage refs : Wall: 3.39 s, CPU: 2.39 s, VmPeak: 1036 MB, VmSize: 1015 MB, VmRSS: 223 MB, VmData: 255 MB, maxrss: 0.45494 MB
Stage refs finished: 2020-06-07T05:28:55.132227
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.394 s, Cores in use: 0.70, Total efficiency (on 4 cores): 17.6 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T05:28:55.133663
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/outlier-mask-custom-033156m29781.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/outliers-pre-custom-033156m29781.jpg
Image c4d_171020_080032_ooi_g_ls9-S7 g : masking 672 positive outlier pixels and 0 negative outlier pixels
Image c4d_180107_025630_ooi_g_ls9-N16 g : masking 3154 positive outlier pixels and 0 negative outlier pixels
Image c4d_160923_032836_ooi_g_ls9-N13 g : masking 364 positive outlier pixels and 0 negative outlier pixels
Image c4d_151215_044147_ooi_g_ls9-S8 g : masking 2499 positive outlier pixels and 257 negative outlier pixels
Image c4d_151211_011636_ooi_g_ls9-S22 g : masking 385 positive outlier pixels and 210 negative outlier pixels
Image c4d_161124_061013_ooi_g_v1-S21 g : masking 889 positive outlier pixels and 0 negative outlier pixels
Image c4d_161126_054500_ooi_g_ls9-S21 g : masking 1235 positive outlier pixels and 0 negative outlier pixels
Image c4d_151204_031543_ooi_g_ls9-S6 g : masking 1051 positive outlier pixels and 0 negative outlier pixels
Image c4d_171020_075834_ooi_r_ls9-S7 r : masking 2753 positive outlier pixels and 0 negative outlier pixels
Image c4d_151108_054533_ooi_r_ls9-N3 r : masking 136 positive outlier pixels and 0 negative outlier pixels
Image c4d_151215_043949_ooi_r_ls9-S8 r : masking 976 positive outlier pixels and 167 negative outlier pixels
Image c4d_180107_025230_ooi_r_ls9-N16 r : masking 147 positive outlier pixels and 0 negative outlier pixels
Image c4d_161207_050351_ooi_r_ls9-S21 r : masking 267 positive outlier pixels and 0 negative outlier pixels
Image c4d_151118_025337_ooi_r_ls9-S6 r : masking 791 positive outlier pixels and 0 negative outlier pixels
Image c4d_171207_050449_ooi_z_ls9-S7 z : masking 432 positive outlier pixels and 0 negative outlier pixels
Image c4d_180123_010615_ooi_z_ls9-N16 z : masking 497 positive outlier pixels and 0 negative outlier pixels
Image c4d_170209_004746_ooi_z_ls9-N16 z : masking 482 positive outlier pixels and 0 negative outlier pixels
Image c4d_141211_041131_ooi_z_ls9-S22 z : masking 153 positive outlier pixels and 0 negative outlier pixels
Image c4d_161218_041236_ooi_z_ls9-S21 z : masking 369 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/outlier-mask-custom-033156m29781.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/outliers-post-custom-033156m29781.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/outliers-masked-pos-custom-033156m29781.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/outliers-masked-neg-custom-033156m29781.jpg
Stage outliers : Wall: 8.07 s, CPU: 6.92 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 259 MB, VmData: 289 MB, maxrss: 0.45494 MB
Stage outliers finished: 2020-06-07T05:29:03.207639
Resources for stage outliers : 5.845 s worker CPU, 6.114 s worker Wall, Wall: 8.075 s, Cores in use: 1.58, Total efficiency (on 4 cores): 39.5 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T05:29:03.209280
Stage halos : Wall: 11.07 s, CPU: 5.69 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 260 MB, VmData: 289 MB, maxrss: 0.45494 MB
Stage halos finished: 2020-06-07T05:29:14.275956
Resources for stage halos : 1.488 s worker CPU, 21.267 s worker Wall, Wall: 11.068 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T05:29:14.278339
PSF sigmas in coadd pixels: ['1.53', '2.56', '1.79', '1.54', '2.04', '1.89', '3.15', '2.63', '2.15']
Using average PSF sigma 2.1434734348086937
Gaussian PSF norm 0.13160638578152256 vs pixelized 0.11403545
average tim pixel scale / coadd scale: 1.0010536639233127
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.92', '2.12', '1.91', '1.54', '1.72', '2.31', '1.80', '1.82']
Using average PSF sigma 1.8934925013716488
Gaussian PSF norm 0.14898120355350142 vs pixelized 0.14517799
average tim pixel scale / coadd scale: 1.001077006694964
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.84', '1.39', '1.74', '1.77', '1.58', '1.71', '1.67', '1.56']
Using average PSF sigma 1.6558517969383901
Gaussian PSF norm 0.17036234299196415 vs pixelized 0.15215096
average tim pixel scale / coadd scale: 1.0010012506462014
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.86 s, CPU: 0.81 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 261 MB, VmData: 289 MB, maxrss: 0.45494 MB
Stage fit_on_coadds finished: 2020-06-07T05:29:15.142907
Resources for stage fit_on_coadds : 1.473 s worker CPU, 1.691 s worker Wall, Wall: 0.866 s, Cores in use: 2.64, Total efficiency (on 4 cores): 66.0 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T05:29:15.146892
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 91 potential peaks
Of 91 potential peaks: 39 in veto map, 12 cut by saddle test, 0 cut by aper test, 40 kept
SED z : 40 new peaks
Found 78 potential peaks
Of 78 potential peaks: 46 in veto map, 12 cut by saddle test, 0 cut by aper test, 20 kept
SED r : 20 new peaks
Found 64 potential peaks
Of 64 potential peaks: 53 in veto map, 8 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 92 potential peaks
Of 92 potential peaks: 67 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept
SED Flat : 11 new peaks
Found 115 potential peaks
Of 115 potential peaks: 91 in veto map, 18 cut by saddle test, 0 cut by aper test, 6 kept
SED Red : 6 new peaks
Adding 80 new sources
Median coadd sky for g : -1.43025945e-05
Median coadd sky for r : -1.3495645e-05
Median coadd sky for z : 0.0006510944
Stage srcs : Wall: 4.60 s, CPU: 4.52 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.45494 MB
Stage srcs finished: 2020-06-07T05:29:19.745539
Resources for stage srcs : 0.238 s worker CPU, 0.250 s worker Wall, Wall: 4.600 s, Cores in use: 1.04, Total efficiency (on 4 cores): 25.9 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/PGC198973-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T05:29:19.847808
Blob 1 of 45, id: 14, sources: 5, size: 159x166, npix 15479, brick X: 129,288, Y: 113,279, one pixel: 205 113
Blob 2 of 45, id: 0, sources: 11, size: 126x122, npix 9218, brick X: 0,126, Y: 0,122, one pixel: 0 0
Blob 3 of 45, id: 20, sources: 7, size: 67x194, npix 4338, brick X: 320,387, Y: 150,344, one pixel: 334 150
Blob 4 of 45, id: 25, sources: 2, size: 43x63, npix 1666, brick X: 265,308, Y: 218,281, one pixel: 281 218
Blob 5 of 45, id: 9, sources: 4, size: 71x52, npix 1541, brick X: 283,354, Y: 57,109, one pixel: 292 57
Blob 4 finished, total: Wall: 2.21 s, CPU: 2.21 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 153 MB, VmData: 191 MB, maxrss: 0.157072 MB
Blob 6 of 45, id: 33, sources: 3, size: 60x49, npix 1429, brick X: 225,285, Y: 302,351, one pixel: 269 302
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (33.13767, -29.77690), pm (-9.8, -8.5), parallax 2.282 with NanoMaggies: g=11.6, r=11.4, z=11.4
Reset brightness to NanoMaggies: g=11.6, r=11.4, z=11.4
Blob 3 finished, total: Wall: 3.54 s, CPU: 3.53 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 147 MB, VmData: 185 MB, maxrss: 0.150284 MB
Blob 7 of 45, id: 38, sources: 5, size: 47x54, npix 1385, brick X: 97,144, Y: 333,387, one pixel: 124 333
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (33.17332, -29.79596), pm (46.6, 22.6), parallax 4.571 with NanoMaggies: g=11.9, r=11.4, z=11
Reset brightness to NanoMaggies: g=10.2, r=9.88, z=9.8
Blob 2 finished, total: Wall: 4.17 s, CPU: 4.16 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 8 of 45, id: 1, sources: 4, size: 53x40, npix 978, brick X: 75,128, Y: 1,41, one pixel: 118 1
Measuring 1 iterative sources
Blob 6 finished, total: Wall: 2.51 s, CPU: 2.50 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151652 MB
Blob 9 of 45, id: 39, sources: 2, size: 37x40, npix 801, brick X: 350,387, Y: 341,381, one pixel: 361 341
Blob 5 finished, total: Wall: 4.63 s, CPU: 4.63 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 10 of 45, id: 2, sources: 2, size: 44x26, npix 776, brick X: 167,211, Y: 8,34, one pixel: 179 8
Blob 7 finished, total: Wall: 4.34 s, CPU: 4.34 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 11 of 45, id: 22, sources: 1, size: 33x32, npix 681, brick X: 99,132, Y: 202,234, one pixel: 116 202
Blob 8 finished, total: Wall: 2.62 s, CPU: 2.62 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151652 MB
Blob 12 of 45, id: 44, sources: 1, size: 32x31, npix 670, brick X: 229,261, Y: 354,385, one pixel: 242 354
Blob 9 finished, total: Wall: 2.52 s, CPU: 2.52 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 13 of 45, id: 21, sources: 2, size: 39x27, npix 658, brick X: 79,118, Y: 163,190, one pixel: 90 163
Blob 11 finished, total: Wall: 1.42 s, CPU: 1.42 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 14 of 45, id: 23, sources: 2, size: 28x42, npix 624, brick X: 63,91, Y: 207,249, one pixel: 77 207
Blob 12 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 15 of 45, id: 15, sources: 1, size: 30x27, npix 567, brick X: 112,142, Y: 115,142, one pixel: 128 115
Blob 10 finished, total: Wall: 2.49 s, CPU: 2.49 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 16 of 45, id: 34, sources: 2, size: 44x24, npix 562, brick X: 25,69, Y: 305,329, one pixel: 52 305
Blob 13 finished, total: Wall: 0.92 s, CPU: 0.92 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 17 of 45, id: 6, sources: 1, size: 26x34, npix 539, brick X: 219,245, Y: 29,63, one pixel: 231 29
Blob 15 finished, total: Wall: 0.41 s, CPU: 0.41 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 18 of 45, id: 30, sources: 1, size: 28x28, npix 487, brick X: 5,33, Y: 259,287, one pixel: 19 259
Blob 14 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 19 of 45, id: 5, sources: 1, size: 27x27, npix 466, brick X: 338,365, Y: 22,49, one pixel: 352 22
Blob 16 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 20 of 45, id: 40, sources: 1, size: 25x28, npix 461, brick X: 24,49, Y: 343,371, one pixel: 33 343
Measuring 1 iterative sources
Blob 18 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 21 of 45, id: 28, sources: 1, size: 32x23, npix 449, brick X: 22,54, Y: 244,267, one pixel: 38 244
Blob 17 finished, total: Wall: 1.98 s, CPU: 1.98 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 22 of 45, id: 43, sources: 1, size: 24x24, npix 362, brick X: 184,208, Y: 354,378, one pixel: 193 354
Blob 21 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 23 of 45, id: 32, sources: 1, size: 25x24, npix 358, brick X: 171,196, Y: 282,306, one pixel: 186 282
Blob 19 finished, total: Wall: 2.72 s, CPU: 2.72 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 24 of 45, id: 3, sources: 1, size: 25x23, npix 354, brick X: 248,273, Y: 20,43, one pixel: 258 20
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.31635, ee1=0.355871, ee2=0.39408
Blob 1 finished, total: Wall: 14.97 s, CPU: 14.97 s, VmPeak: 1014 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.159128 MB
Blob 25 of 45, id: 4, sources: 1, size: 30x23, npix 329, brick X: 147,177, Y: 22,45, one pixel: 155 22
Blob 22 finished, total: Wall: 0.72 s, CPU: 0.72 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 26 of 45, id: 41, sources: 1, size: 21x26, npix 327, brick X: 281,302, Y: 345,371, one pixel: 289 345
Blob 25 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151404 MB
Blob 27 of 45, id: 18, sources: 1, size: 23x23, npix 317, brick X: 362,385, Y: 128,151, one pixel: 371 128
Blob 20 finished, total: Wall: 2.56 s, CPU: 2.56 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 28 of 45, id: 31, sources: 1, size: 23x24, npix 317, brick X: 254,277, Y: 271,295, one pixel: 266 271
Blob 23 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 29 of 45, id: 8, sources: 1, size: 23x22, npix 314, brick X: 101,124, Y: 49,71, one pixel: 111 49
Blob 24 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 1014 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.159128 MB
Blob 30 of 45, id: 11, sources: 1, size: 23x22, npix 303, brick X: 200,223, Y: 74,96, one pixel: 211 74
Blob 26 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151696 MB
Blob 31 of 45, id: 42, sources: 1, size: 22x22, npix 303, brick X: 69,91, Y: 351,373, one pixel: 78 351
Blob 27 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 32 of 45, id: 17, sources: 1, size: 21x23, npix 302, brick X: 12,33, Y: 121,144, one pixel: 21 121
Blob 29 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 1014 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.159128 MB
Blob 33 of 45, id: 37, sources: 1, size: 23x22, npix 302, brick X: 193,216, Y: 329,351, one pixel: 202 329
Blob 28 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 34 of 45, id: 35, sources: 1, size: 21x22, npix 271, brick X: 134,155, Y: 318,340, one pixel: 143 318
Blob 30 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151696 MB
Blob 35 of 45, id: 36, sources: 1, size: 21x21, npix 269, brick X: 93,114, Y: 323,344, one pixel: 102 323
Blob 31 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 36 of 45, id: 16, sources: 1, size: 21x22, npix 252, brick X: 295,316, Y: 118,140, one pixel: 305 118
Blob 32 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 1014 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.159128 MB
Blob 37 of 45, id: 10, sources: 1, size: 21x21, npix 251, brick X: 265,286, Y: 66,87, one pixel: 274 66
Blob 35 finished, total: Wall: 0.23 s, CPU: 0.23 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 38 of 45, id: 27, sources: 1, size: 21x20, npix 248, brick X: 85,106, Y: 237,257, one pixel: 94 237
Blob 34 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151696 MB
Blob 39 of 45, id: 7, sources: 1, size: 20x20, npix 247, brick X: 316,336, Y: 30,50, one pixel: 324 30
Blob 37 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 40 of 45, id: 26, sources: 1, size: 20x20, npix 247, brick X: 9,29, Y: 231,251, one pixel: 17 231
Blob 38 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151696 MB
Blob 41 of 45, id: 29, sources: 1, size: 20x20, npix 219, brick X: 333,353, Y: 246,266, one pixel: 341 246
Blob 33 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 42 of 45, id: 24, sources: 1, size: 20x19, npix 218, brick X: 325,345, Y: 216,235, one pixel: 334 216
Blob 36 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 1014 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.159128 MB
Blob 43 of 45, id: 19, sources: 1, size: 20x19, npix 199, brick X: 54,74, Y: 142,161, one pixel: 63 142
Blob 40 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151696 MB
Blob 44 of 45, id: 12, sources: 1, size: 18x19, npix 198, brick X: 243,261, Y: 74,93, one pixel: 251 74
Blob 43 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151696 MB
Blob 45 of 45, id: 13, sources: 1, size: 18x20, npix 198, brick X: 275,293, Y: 94,114, one pixel: 284 94
Blob 39 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158396 MB
Blob 41 finished, total: Wall: 0.35 s, CPU: 0.35 s, VmPeak: 964 MB, VmSize: 723 MB, VmRSS: 149 MB, VmData: 186 MB, maxrss: 0.1521 MB
Blob 44 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 964 MB, VmSize: 722 MB, VmRSS: 148 MB, VmData: 185 MB, maxrss: 0.151696 MB
Blob 42 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 1014 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.159128 MB
Blob 45 finished, total: Wall: 0.19 s, CPU: 0.19 s, VmPeak: 1013 MB, VmSize: 728 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.158836 MB
Old catalog: 83
New catalog: 67
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/blobs-custom-033156m29781.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/metrics/cus/all-models-custom-033156m29781.fits
Stage fitblobs : Wall: 23.61 s, CPU: 6.21 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 262 MB, VmData: 289 MB, maxrss: 0.45494 MB
Stage fitblobs finished: 2020-06-07T05:29:43.458631
Resources for stage fitblobs : 69.617 s worker CPU, 69.650 s worker Wall, Wall: 23.612 s, Cores in use: 3.21, Total efficiency (on 4 cores): 80.3 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T05:29:43.460452
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/tmp-legacysurvey-custom-033156m29781-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/tmp-legacysurvey-custom-033156m29781-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/tmp-legacysurvey-custom-033156m29781-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/tmp-legacysurvey-custom-033156m29781-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-resid.jpg
Stage coadds : Wall: 6.23 s, CPU: 3.58 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 263 MB, VmData: 290 MB, maxrss: 0.45494 MB
Stage coadds finished: 2020-06-07T05:29:49.685714
Resources for stage coadds : 3.232 s worker CPU, 3.402 s worker Wall, Wall: 6.226 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.4 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T05:29:49.687289
Cut to 1 unWISE tiles
Reading WISE tile 0330m303 band 1
Reading WISE tile 0330m303 band 3
Reading WISE tile 0330m303 band 2
Reading WISE tile 0330m303 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.14 s, CPU: 0.26 s, VmPeak: 1067 MB, VmSize: 1003 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.214136 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.20 s, CPU: 0.33 s, VmPeak: 1002 MB, VmSize: 1002 MB, VmRSS: 151 MB, VmData: 190 MB, maxrss: 0.193252 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.26 s, VmPeak: 999 MB, VmSize: 999 MB, VmRSS: 148 MB, VmData: 186 MB, maxrss: 0.210408 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/033/0330m303/unwise-0330m303-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.13 s, CPU: 0.30 s, VmPeak: 1013 MB, VmSize: 1003 MB, VmRSS: 152 MB, VmData: 190 MB, maxrss: 0.214132 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/tmp-legacysurvey-custom-033156m29781-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/tmp-legacysurvey-custom-033156m29781-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 9.27 s, CPU: 6.09 s, VmPeak: 1036 MB, VmSize: 1025 MB, VmRSS: 263 MB, VmData: 290 MB, maxrss: 0.45494 MB
Stage wise_forced finished: 2020-06-07T05:29:58.954399
Resources for stage wise_forced : 4.992 s worker CPU, 10.311 s worker Wall, Wall: 9.268 s, Cores in use: 1.20, Total efficiency (on 4 cores): 29.9 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T05:29:58.956501
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/coadd/cus/custom-033156m29781/legacysurvey-custom-033156m29781-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/tractor-i/cus/tractor-custom-033156m29781.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/tractor/cus/tractor-custom-033156m29781.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/033/PGC198973/tractor/cus/brick-custom-033156m29781.sha256sum
Stage writecat : Wall: 7.85 s, CPU: 7.72 s, VmPeak: 1157 MB, VmSize: 1029 MB, VmRSS: 265 MB, VmData: 290 MB, maxrss: 0.45494 MB
Stage writecat finished: 2020-06-07T05:30:06.810833
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.855 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.6 %
Stage writecat finished
All done: 94.974 s worker CPU, 1106.502 s worker Wall, Wall: 339.682 s, Cores in use: 0.43, Total efficiency (on 4 cores): 10.8 %
Finished galaxy PGC198973 in 5.811 minutes.