Started working on galaxy PGC937565 at Fri Jun  5 15:29:50 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.658514 -13.4707094 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-05T15:29:51.245119
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '58.658514', '-13.4707094', '--width', '251', '--height', '251', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 58.658514 -13.4707094 --width 251 --height 251 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 58.658514 -13.4707094
Starting process 17795 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 17796 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 17797 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Starting process 17798 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-05T15:29:55.289331
Keeping 22 CCDs:
   c4d_180905_095349_ooi_z_ls9.fits.fz c4d_180905_095349_ooi_z_ls9-N17 z exptime 80.0 propid 2014B-0404 seeing 0.99 MJD 58366.412 object DECaLS_55832_z
   c4d_161103_064554_ooi_g_ls9.fits.fz c4d_161103_064554_ooi_g_ls9-S24 g exptime 90.0 propid 2012B-0001 seeing 1.54 MJD 57695.280 object DES survey hex 584-146 tiling 6
   c4d_161103_064355_ooi_r_ls9.fits.fz c4d_161103_064355_ooi_r_ls9-S24 r exptime 90.0 propid 2012B-0001 seeing 1.41 MJD 57695.279 object DES survey hex 584-146 tiling 6
   c4d_180905_095349_ooi_z_ls9.fits.fz c4d_180905_095349_ooi_z_ls9-N11 z exptime 80.0 propid 2014B-0404 seeing 0.99 MJD 58366.412 object DECaLS_55832_z
   c4d_151116_075155_ooi_g_ls9.fits.fz c4d_151116_075155_ooi_g_ls9-S17 g exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57342.326 object DES survey hex 584-146 tiling 4
   c4d_151108_081625_ooi_r_ls9.fits.fz c4d_151108_081625_ooi_r_ls9-S17 r exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 57334.343 object DES survey hex 584-146 tiling 4
   c4d_151108_081822_ooi_z_ls9.fits.fz c4d_151108_081822_ooi_z_ls9-S17 z exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57334.344 object DES survey hex 584-146 tiling 4
   c4d_170120_031731_ooi_z_ls9.fits.fz c4d_170120_031731_ooi_z_ls9-S24 z exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 57773.136 object DES survey hex 584-146 tiling 6
   c4d_181021_074702_ooi_z_ls9.fits.fz c4d_181021_074702_ooi_z_ls9-S28 z exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 58412.324 object DES survey hex 584-146 tiling 10
   c4d_151215_055550_ooi_g_ls9.fits.fz c4d_151215_055550_ooi_g_ls9-S31 g exptime 90.0 propid 2012B-0001 seeing 1.47 MJD 57371.245 object DES survey hex 584-146 tiling 5
   c4d_151215_055352_ooi_r_ls9.fits.fz c4d_151215_055352_ooi_r_ls9-S31 r exptime 90.0 propid 2012B-0001 seeing 1.33 MJD 57371.244 object DES survey hex 584-146 tiling 5
   c4d_151221_013834_ooi_z_ls9.fits.fz c4d_151221_013834_ooi_z_ls9-S31 z exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 57377.067 object DES survey hex 584-146 tiling 5
   c4d_180109_041904_ooi_r_ls9.fits.fz c4d_180109_041904_ooi_r_ls9-S25 r exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 58127.180 object DES survey hex 584-146 tiling 9
   c4d_180207_004637_ooi_z_ls9.fits.fz c4d_180207_004637_ooi_z_ls9-S25 z exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58156.032 object DES survey hex 584-146 tiling 9
   c4d_180207_021426_ooi_g_ls9.fits.fz c4d_180207_021426_ooi_g_ls9-S25 g exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 58156.093 object DES survey hex 584-146 tiling 9
   c4d_140920_083427_ooi_g_ls9.fits.fz c4d_140920_083427_ooi_g_ls9-N7 g exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 56920.356 object DES survey hex 582-126 tiling 3
   c4d_140920_083630_ooi_r_ls9.fits.fz c4d_140920_083630_ooi_r_ls9-N7 r exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 56920.357 object DES survey hex 582-126 tiling 3
   c4d_140920_083822_ooi_z_ls9.fits.fz c4d_140920_083822_ooi_z_ls9-N7 z exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 56920.358 object DES survey hex 582-126 tiling 3
   c4d_181110_053010_ooi_r_ls9.fits.fz c4d_181110_053010_ooi_r_ls9-N28 r exptime 130.0 propid 2014B-0404 seeing 1.20 MJD 58432.229 object DECaLS_40292_r
   c4d_181003_072940_ooi_z_ls9.fits.fz c4d_181003_072940_ooi_z_ls9-N28 z exptime 203.0 propid 2014B-0404 seeing 1.10 MJD 58394.312 object DECaLS_40292_z
   c4d_181003_060730_ooi_g_ls9.fits.fz c4d_181003_060730_ooi_g_ls9-N28 g exptime 115.0 propid 2014B-0404 seeing 1.07 MJD 58394.255 object DECaLS_40292_g
   c4d_181003_060954_ooi_r_ls9.fits.fz c4d_181003_060954_ooi_r_ls9-N28 r exptime 42.0 propid 2014B-0404 seeing 0.96 MJD 58394.257 object DECaLS_40292_r
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94ff626-g-20161103T064333_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T095349_oi[N11,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94ffa5d-r-20161103T064134_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d57b-g-20151116T074935_oi[S17,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T081403_oi[S17,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95580e8-z-20151108T081602_oi[S17,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9601b4b-z-20181021T074702_oi[S28,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950712c-z-20170120T031514_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957992f-g-20151215T055329_oi[S31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ee1a-r-20151215T055132_oi[S31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95533ce-z-20151221T013615_oi[S31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180207T004637_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20180109T041904_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529c44-g-20180207T021426_oi[S25,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c294-g-20140920T083206_oi[N7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140920T083404_oi[N7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954ecd4-z-20140920T083603_oi[N7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530bc0-z-20181003T072940_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T053010_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T060730_oi[N28,noinherit][2046,4094][real]: DECaLS_
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181003T060954_oi[N28,noinherit][2046,4094][real]: DECaLS_
Stage tims : Wall: 98.92 s, CPU: 3.39 s, VmPeak: 998 MB, VmSize: 998 MB, VmRSS: 184 MB, VmData: 218 MB, maxrss: 0.450516 MB
Stage tims finished: 2020-06-05T15:31:34.208059
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957d57b-g-20151116T074935_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9601b4b-z-20181021T074702_oi[S28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95533ce-z-20151221T013615_oi[S31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954c294-g-20140920T083206_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9530bc0-z-20181003T072940_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952cb89-z-20180905T095349_oi[N11,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95580e8-z-20151108T081602_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957ee1a-r-20151215T055132_oi[S31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9529c44-g-20180207T021426_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953861c-r-20181110T053010_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94ffa5d-r-20161103T064134_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950712c-z-20170120T031514_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9528f25-r-20180109T041904_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954ecd4-z-20140920T083603_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_953651d-r-20181003T060954_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_94ff626-g-20161103T064333_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T081403_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_957992f-g-20151215T055329_oi[S31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95260c6-z-20180207T004637_oi[S25,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954969b-r-20140920T083404_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9536cb0-g-20181003T060730_oi[N28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card]
Resources for stage tims : 6.983 s worker CPU, 347.355 s worker Wall, Wall: 98.920 s, Cores in use: 0.10, Total efficiency (on 4 cores): 2.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-05T15:31:34.355955
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07636.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-07509.fits
Matched 8 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/reference-custom-058658m13470.fits
Stage refs : Wall: 2.29 s, CPU: 1.95 s, VmPeak: 1029 MB, VmSize: 1012 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.450516 MB
Stage refs finished: 2020-06-05T15:31:36.647529
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.293 s, Cores in use: 0.85, Total efficiency (on 4 cores): 21.2 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-05T15:31:36.649081
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/outlier-mask-custom-058658m13470.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/outliers-pre-custom-058658m13470.jpg
Image c4d_161103_064355_ooi_r_ls9-S24 r : masking 437 positive outlier pixels and 0 negative outlier pixels
Image c4d_151215_055352_ooi_r_ls9-S31 r : masking 86 positive outlier pixels and 85 negative outlier pixels
Image c4d_181110_053010_ooi_r_ls9-N28 r : masking 135 positive outlier pixels and 0 negative outlier pixels
Image c4d_151108_081822_ooi_z_ls9-S17 z : masking 264 positive outlier pixels and 58 negative outlier pixels
Image c4d_170120_031731_ooi_z_ls9-S24 z : masking 252 positive outlier pixels and 0 negative outlier pixels
Image c4d_151221_013834_ooi_z_ls9-S31 z : masking 287 positive outlier pixels and 79 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/outlier-mask-custom-058658m13470.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/outliers-post-custom-058658m13470.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/outliers-masked-pos-custom-058658m13470.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/outliers-masked-neg-custom-058658m13470.jpg
Stage outliers : Wall: 1.55 s, CPU: 1.10 s, VmPeak: 1029 MB, VmSize: 1022 MB, VmRSS: 217 MB, VmData: 248 MB, maxrss: 0.450516 MB
Stage outliers finished: 2020-06-05T15:31:38.196074
Resources for stage outliers : 2.011 s worker CPU, 2.041 s worker Wall, Wall: 1.548 s, Cores in use: 2.01, Total efficiency (on 4 cores): 50.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-05T15:31:38.197929
Stage halos : Wall: 3.60 s, CPU: 1.61 s, VmPeak: 1029 MB, VmSize: 1022 MB, VmRSS: 218 MB, VmData: 248 MB, maxrss: 0.450516 MB
Stage halos finished: 2020-06-05T15:31:41.795693
Resources for stage halos : 0.425 s worker CPU, 7.658 s worker Wall, Wall: 3.599 s, Cores in use: 0.57, Total efficiency (on 4 cores): 14.2 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-05T15:31:41.797729
PSF sigmas in coadd pixels: ['2.50', '1.93', '2.39', '1.85', '1.92', '1.74']
Using average PSF sigma 2.0558086415615313
Gaussian PSF norm 0.13721840937472046 vs pixelized 0.11402052
average tim pixel scale / coadd scale: 1.0011059619514768
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.29', '1.65', '2.17', '1.82', '1.73', '1.95', '1.56']
Using average PSF sigma 1.8806491663690679
Gaussian PSF norm 0.14999862644158826 vs pixelized 0.12524164
average tim pixel scale / coadd scale: 1.0011219151034716
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.61', '1.71', '1.46', '2.15', '1.77', '1.66', '1.65', '1.78']
Using average PSF sigma 1.7236322486476254
Gaussian PSF norm 0.16366298089120335 vs pixelized 0.14222406
average tim pixel scale / coadd scale: 1.0010338299961064
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.39 s, CPU: 0.35 s, VmPeak: 1029 MB, VmSize: 1022 MB, VmRSS: 221 MB, VmData: 250 MB, maxrss: 0.450516 MB
Stage fit_on_coadds finished: 2020-06-05T15:31:42.186782
Resources for stage fit_on_coadds : 0.430 s worker CPU, 0.455 s worker Wall, Wall: 0.390 s, Cores in use: 2.01, Total efficiency (on 4 cores): 50.2 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-05T15:31:42.190602
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 151 potential peaks
Of 151 potential peaks: 124 in veto map, 8 cut by saddle test, 0 cut by aper test, 19 kept
SED z : 19 new peaks
Found 129 potential peaks
Of 129 potential peaks: 112 in veto map, 9 cut by saddle test, 0 cut by aper test, 8 kept
SED r : 8 new peaks
Found 84 potential peaks
Of 84 potential peaks: 77 in veto map, 6 cut by saddle test, 1 cut by aper test, 0 kept
SED g : 0 new peaks
Found 129 potential peaks
Of 129 potential peaks: 116 in veto map, 10 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 165 potential peaks
Of 165 potential peaks: 154 in veto map, 11 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 30 new sources
Median coadd sky for g : 0.00014503903
Median coadd sky for r : 0.0005097878
Median coadd sky for z : 0.0010303224
Stage srcs : Wall: 1.48 s, CPU: 1.43 s, VmPeak: 1029 MB, VmSize: 1022 MB, VmRSS: 222 MB, VmData: 250 MB, maxrss: 0.450516 MB
Stage srcs finished: 2020-06-05T15:31:43.670145
Resources for stage srcs : 0.106 s worker CPU, 0.116 s worker Wall, Wall: 1.480 s, Cores in use: 1.04, Total efficiency (on 4 cores): 26.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/PGC937565-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-05T15:31:43.682665
Blob 1 of 6, id: 1, sources: 27, size: 250x251, npix 42746, brick X: 1,251, Y: 0,251, one pixel: 65 0
Blob 2 of 6, id: 2, sources: 2, size: 45x24, npix 630, brick X: 187,232, Y: 0,24, one pixel: 193 0
Blob 3 of 6, id: 5, sources: 1, size: 26x24, npix 486, brick X: 0,26, Y: 227,251, one pixel: 10 227
Blob 4 of 6, id: 3, sources: 1, size: 27x25, npix 396, brick X: 7,34, Y: 44,69, one pixel: 23 44
Blob 5 of 6, id: 4, sources: 1, size: 24x24, npix 364, brick X: 217,241, Y: 186,210, one pixel: 227 186
Blob 2 finished, total: Wall: 0.73 s, CPU: 0.72 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145928 MB
Blob 6 of 6, id: 0, sources: 1, size: 24x18, npix 286, brick X: 4,28, Y: 0,18, one pixel: 9 0
Blob 4 finished, total: Wall: 0.93 s, CPU: 0.88 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146556 MB
Blob 5 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 961 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.145928 MB
Blob 6 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 965 MB, VmSize: 720 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.146556 MB
Blob 3 finished, total: Wall: 2.59 s, CPU: 2.53 s, VmPeak: 962 MB, VmSize: 719 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148156 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.756701, ee1=-0.0355694, ee2=-0.12013
Measuring 17 iterative sources
Blob 1 finished, total: Wall: 37.91 s, CPU: 37.91 s, VmPeak: 967 MB, VmSize: 721 MB, VmRSS: 152 MB, VmData: 184 MB, maxrss: 0.168684 MB
Old catalog: 35
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/blobs-custom-058658m13470.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/metrics/cus/all-models-custom-058658m13470.fits
Stage fitblobs : Wall: 38.49 s, CPU: 0.55 s, VmPeak: 1029 MB, VmSize: 1022 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.450516 MB
Stage fitblobs finished: 2020-06-05T15:32:22.171592
Resources for stage fitblobs : 43.701 s worker CPU, 43.857 s worker Wall, Wall: 38.490 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.7 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-05T15:32:22.174055
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/tmp-legacysurvey-custom-058658m13470-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/tmp-legacysurvey-custom-058658m13470-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/tmp-legacysurvey-custom-058658m13470-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/tmp-legacysurvey-custom-058658m13470-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-resid.jpg
Stage coadds : Wall: 4.05 s, CPU: 3.17 s, VmPeak: 1029 MB, VmSize: 1022 MB, VmRSS: 224 MB, VmData: 251 MB, maxrss: 0.450516 MB
Stage coadds finished: 2020-06-05T15:32:26.226751
Resources for stage coadds : 2.801 s worker CPU, 2.928 s worker Wall, Wall: 4.054 s, Cores in use: 1.47, Total efficiency (on 4 cores): 36.8 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-05T15:32:26.228317
Cut to 1 unWISE tiles
Reading WISE tile 0589m137 band 1
Reading WISE tile 0589m137 band 2
Reading WISE tile 0589m137 band 4
Reading WISE tile 0589m137 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 961 MB, VmSize: 792 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.206728 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 965 MB, VmSize: 798 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.191352 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 962 MB, VmSize: 795 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210472 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/058/0589m137/unwise-0589m137-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 967 MB, VmSize: 805 MB, VmRSS: 160 MB, VmData: 184 MB, maxrss: 0.224488 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/tmp-legacysurvey-custom-058658m13470-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/tmp-legacysurvey-custom-058658m13470-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.42 s, CPU: 1.84 s, VmPeak: 1029 MB, VmSize: 1022 MB, VmRSS: 225 MB, VmData: 251 MB, maxrss: 0.450516 MB
Stage wise_forced finished: 2020-06-05T15:32:31.648838
Resources for stage wise_forced : 3.486 s worker CPU, 10.897 s worker Wall, Wall: 5.422 s, Cores in use: 0.98, Total efficiency (on 4 cores): 24.6 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-05T15:32:31.650646
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/coadd/cus/custom-058658m13470/legacysurvey-custom-058658m13470-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/tractor-i/cus/tractor-custom-058658m13470.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/tractor/cus/tractor-custom-058658m13470.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/058/PGC937565/tractor/cus/brick-custom-058658m13470.sha256sum
Stage writecat : Wall: 0.82 s, CPU: 0.62 s, VmPeak: 1154 MB, VmSize: 1026 MB, VmRSS: 227 MB, VmData: 251 MB, maxrss: 0.450516 MB
Stage writecat finished: 2020-06-05T15:32:32.470361
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.821 s, Cores in use: 0.75, Total efficiency (on 4 cores): 18.8 %
Stage writecat finished
All done: 59.945 s worker CPU, 415.309 s worker Wall, Wall: 157.186 s, Cores in use: 0.48, Total efficiency (on 4 cores): 12.1 %
Finished galaxy PGC937565 in 2.713 minutes.