Started working on galaxy PGC602638 at Wed Aug  5 20:30:43 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.1488315 -39.0261704 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:30:44.810485
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.1488315', '-39.0261704', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.1488315 -39.0261704 --width 263 --height 263 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 36.1488315 -39.0261704
Starting process 40776 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 40777 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 40778 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 40779 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 40780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 40781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 40782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 40783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 40784 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 40785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 40786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 40787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 40788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 40789 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 40790 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 40791 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:30:45.708652
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 27 CCDs:
  c4d_150209_013042_ooi_r_ls9-N22 r expnum 407955 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57062.061 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20150208/c4d_150209_013042_ooi_r_ls9.fits.fz
  c4d_140817_092105_ooi_z_ls9-N22 z expnum 348962 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56886.388 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20140816/c4d_140817_092105_ooi_z_ls9.fits.fz
  c4d_161127_053111_ooi_g_ls9-N21 g expnum 596889 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57719.228 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161126/c4d_161127_053111_ooi_g_ls9.fits.fz
  c4d_161218_043208_ooi_z_ls9-N21 z expnum 601838 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 57740.187 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161217/c4d_161218_043208_ooi_z_ls9.fits.fz
  c4d_141225_032931_ooi_g_ls9-N22 g expnum 391301 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57016.144 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_032931_ooi_g_ls9.fits.fz
  c4d_161127_052917_ooi_r_ls9-N21 r expnum 596888 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57719.227 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161126/c4d_161127_052917_ooi_r_ls9.fits.fz
  c4d_161123_061839_ooi_g_v1-N21 g expnum 595477 exptime 90.0 propid 2012B-0001 seeing 1.84 MJD 57715.261 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.1/CP20161123/c4d_161123_061839_ooi_g_v1.fits.fz
  c4d_151114_050424_ooi_r_ls9-S7 r expnum 492846 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57340.210 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151113/c4d_151114_050424_ooi_r_ls9.fits.fz
  c4d_151101_071519_ooi_z_ls9-S7 z expnum 488890 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57327.301 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151031/c4d_151101_071519_ooi_z_ls9.fits.fz
  c4d_151114_050619_ooi_g_ls9-S7 g expnum 492847 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57340.211 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151113/c4d_151114_050619_ooi_g_ls9.fits.fz
  c4d_161221_035414_ooi_r_ls9-S22 r expnum 602990 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57743.161 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.8.2/CP20161220/c4d_161221_035414_ooi_r_ls9.fits.fz
  c4d_171002_081033_ooi_z_v1-S22 z expnum 683592 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 58028.341 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.1/CP20171001/c4d_171002_081033_ooi_z_v1.fits.fz
  c4d_161221_035612_ooi_g_ls9-S22 g expnum 602991 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57743.162 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.8.2/CP20161220/c4d_161221_035612_ooi_g_ls9.fits.fz
  c4d_160925_041707_ooi_g_ls9-N14 g expnum 576953 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57656.177 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_041707_ooi_g_ls9.fits.fz
  c4d_160923_081409_ooi_r_ls9-N14 r expnum 576227 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57654.342 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160922/c4d_160923_081409_ooi_r_ls9.fits.fz
  c4d_171110_071127_ooi_z_v1-S3 z expnum 694711 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58067.300 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171109/c4d_171110_071127_ooi_z_v1.fits.fz
  c4d_171120_062436_ooi_g_v1-S3 g expnum 698025 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58077.267 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171119/c4d_171120_062436_ooi_g_v1.fits.fz
  c4d_171120_062236_ooi_r_v1-S3 r expnum 698024 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58077.266 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171119/c4d_171120_062236_ooi_r_v1.fits.fz
  c4d_141230_035408_ooi_z_ls9-N2 z expnum 393127 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57021.161 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_035408_ooi_z_ls9.fits.fz
  c4d_141225_033130_ooi_r_ls9-N2 r expnum 391302 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57016.145 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_033130_ooi_r_ls9.fits.fz
  c4d_150116_023941_ooi_g_ls9-N2 g expnum 398761 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 57038.109 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20150115/c4d_150116_023941_ooi_g_ls9.fits.fz
  c4d_160120_024324_ooi_z_ls9-N14 z expnum 513352 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57407.112 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160119/c4d_160120_024324_ooi_z_ls9.fits.fz
  c4d_180205_013633_ooi_g_v1-S23 g expnum 717847 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58154.067 object DES survey hex 348-400 tiling 9 
    decam/CP/V4.1/CP20180204/c4d_180205_013633_ooi_g_v1.fits.fz
  c4d_180122_020238_ooi_z_v1-S23 z expnum 714156 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58140.085 object DES survey hex 348-400 tiling 9 
    decam/CP/V4.1/CP20180121/c4d_180122_020238_ooi_z_v1.fits.fz
  c4d_141118_065223_ooi_g_ls9-S26 g expnum 379049 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 56979.285 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20141117/c4d_141118_065223_ooi_g_ls9.fits.fz
  c4d_141118_065422_ooi_r_ls9-S26 r expnum 379050 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56979.286 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20141117/c4d_141118_065422_ooi_r_ls9.fits.fz
  c4d_150108_015238_ooi_z_ls9-S26 z expnum 395506 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57030.077 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20150107/c4d_150108_015238_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171106_9009a16-z-20171110T071127_oi[S3,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T032710_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9624332-r-20151114T050201_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96154c2-z-20140817T091840_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081149_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170930_8fde346-z-20171002T081033_oi[S22,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961e937-r-20150209T012821_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T061618_oi[N21,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b589-g-20160925T041445_oi[N14,noinherit][2046,4094][real]: DES sur
Clipping 3 pixels with anomalously large oow values: max 0.0596276 vs median 0.0448269
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623448-g-20151114T050401_oi[S7,noinherit][2046,4094][real]: DES surv
Clipping 2 pixels with anomalously large oow values: max 0.0507834 vs median 0.038249
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T042948_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95069cb-g-20161221T035352_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9503662-r-20161127T052652_oi[N21,noinherit][2046,4094][real]: DES sur
Zeroing out 3818 weight-map pixels below quantization error (= median 3.65e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950321a-g-20161127T052852_oi[N21,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 25 weight-map pixels below quantization error (= median 3.27e-06)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-g-20171120T062436_oi[S3,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Zeroing out 0 weight-map pixels below quantization error (= median 0.000225)
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-r-20171120T062236_oi[S3,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T035147_oi[N2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T032908_oi[N2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180122T020238_oi[S23,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627da7-z-20160120T024105_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96187b5-g-20141118T065006_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9506e1c-r-20161221T035153_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961adec-g-20150116T023722_oi[N2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a6d6-r-20141118T065203_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180205T013633_oi[S23,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20150108T015017_oi[S26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T071300_oi[S7,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 82.77 s, CPU: 1.07 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 196 MB, VmData: 228 MB, maxrss: 0.200404 MB
Stage tims finished: 2020-08-05T20:32:08.482504
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9503662-r-20161127T052652_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623448-g-20151114T050401_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Zeroing out 8 weight-map pixels below quantization error (= median 0.000252)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171106_9009a16-z-20171110T071127_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-g-20171120T062436_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950321a-g-20161127T052852_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Zeroing out 1 weight-map pixels below quantization error (= median 6.14e-05)
Zeroing out 49 weight-map pixels below quantization error (= median 3.13e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T032710_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-r-20171120T062236_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9624332-r-20151114T050201_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180122T020238_oi[S23,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170930_8fde346-z-20171002T081033_oi[S22,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T035147_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Zeroing out 7 weight-map pixels below quantization error (= median 0.00024)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95069cb-g-20161221T035352_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a6d6-r-20141118T065203_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T061618_oi[N21,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180205T013633_oi[S23,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961e937-r-20150209T012821_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627da7-z-20160120T024105_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T071300_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b589-g-20160925T041445_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96187b5-g-20141118T065006_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 13.996 s worker CPU, 855.552 s worker Wall, Wall: 82.776 s, Cores in use: 0.18, Total efficiency (on 16 cores): 1.1 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081149_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T032908_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96154c2-z-20140817T091840_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961adec-g-20150116T023722_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9506e1c-r-20161221T035153_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T042948_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20150108T015017_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-05T20:32:08.952887
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09933.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09932.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10061.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09805.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/reference-custom-036148m39026.fits
Stage refs : Wall: 18.09 s, CPU: 1.89 s, VmPeak: 1046 MB, VmSize: 1027 MB, VmRSS: 209 MB, VmData: 240 MB, maxrss: 0.213868 MB
Stage refs finished: 2020-08-05T20:32:27.045616
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.094 s, Cores in use: 0.10, Total efficiency (on 16 cores): 0.7 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:32:27.101920
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/outlier-mask-custom-036148m39026.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/outliers-pre-custom-036148m39026.jpg
Image c4d_161221_035612_ooi_g_ls9-S22 g : masking 1457 positive outlier pixels and 0 negative outlier pixels
Image c4d_161123_061839_ooi_g_v1-N21 g : masking 6705 positive outlier pixels and 0 negative outlier pixels
Image c4d_180205_013633_ooi_g_v1-S23 g : masking 518 positive outlier pixels and 111 negative outlier pixels
Image c4d_171120_062236_ooi_r_v1-S3 r : masking 206 positive outlier pixels and 0 negative outlier pixels
Image c4d_151114_050424_ooi_r_ls9-S7 r : masking 0 positive outlier pixels and 48 negative outlier pixels
Image c4d_161221_035414_ooi_r_ls9-S22 r : masking 841 positive outlier pixels and 0 negative outlier pixels
Image c4d_141118_065422_ooi_r_ls9-S26 r : masking 112 positive outlier pixels and 0 negative outlier pixels
Image c4d_171002_081033_ooi_z_v1-S22 z : masking 600 positive outlier pixels and 0 negative outlier pixels
Image c4d_171110_071127_ooi_z_v1-S3 z : masking 0 positive outlier pixels and 83 negative outlier pixels
Image c4d_140817_092105_ooi_z_ls9-N22 z : masking 121 positive outlier pixels and 0 negative outlier pixels
Image c4d_180122_020238_ooi_z_v1-S23 z : masking 688 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/outlier-mask-custom-036148m39026.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/outliers-post-custom-036148m39026.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/outliers-masked-pos-custom-036148m39026.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/outliers-masked-neg-custom-036148m39026.jpg
Stage outliers : Wall: 1.48 s, CPU: 1.26 s, VmPeak: 1046 MB, VmSize: 1037 MB, VmRSS: 240 MB, VmData: 268 MB, maxrss: 0.245664 MB
Stage outliers finished: 2020-08-05T20:32:28.583501
Resources for stage outliers : 2.567 s worker CPU, 2.567 s worker Wall, Wall: 1.483 s, Cores in use: 2.58, Total efficiency (on 16 cores): 16.1 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:32:28.643091
Stage halos : Wall: 3.45 s, CPU: 0.81 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 240 MB, VmData: 268 MB, maxrss: 0.246152 MB
Stage halos finished: 2020-08-05T20:32:32.090317
Resources for stage halos : 0.800 s worker CPU, 6.555 s worker Wall, Wall: 3.449 s, Cores in use: 0.47, Total efficiency (on 16 cores): 2.9 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:32:32.596977
PSF sigmas in coadd pixels: ['2.03', '1.88', '2.99', '2.15', '1.98', '1.97', '1.91', '2.07', '1.74', '2.11']
Using average PSF sigma 2.0819872346703345
Gaussian PSF norm 0.13549304581521393 vs pixelized 0.11215191
average tim pixel scale / coadd scale: 1.0010665718053702
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.79', '1.93', '1.84', '1.94', '1.67', '1.94', '1.84', '1.85']
Using average PSF sigma 1.8499955089001574
Gaussian PSF norm 0.15248404140266622 vs pixelized 0.13044356
average tim pixel scale / coadd scale: 1.0010831801506037
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.59', '1.52', '1.72', '1.97', '1.69', '1.55', '1.59', '1.63', '1.71']
Using average PSF sigma 1.6639731621932814
Gaussian PSF norm 0.16953085433304063 vs pixelized 0.15147786
average tim pixel scale / coadd scale: 1.0010247378261716
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.39 s, CPU: 0.40 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 242 MB, VmData: 268 MB, maxrss: 0.247856 MB
Stage fit_on_coadds finished: 2020-08-05T20:32:32.990844
Resources for stage fit_on_coadds : 0.683 s worker CPU, 0.683 s worker Wall, Wall: 0.395 s, Cores in use: 2.74, Total efficiency (on 16 cores): 17.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:32:33.003922
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 36 potential peaks
Of 36 potential peaks: 5 in veto map, 5 cut by saddle test, 0 cut by aper test, 26 kept
SED z : 26 new peaks
Found 44 potential peaks
Of 44 potential peaks: 28 in veto map, 6 cut by saddle test, 0 cut by aper test, 10 kept
SED r : 10 new peaks
Found 28 potential peaks
Of 28 potential peaks: 23 in veto map, 4 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 57 potential peaks
Of 57 potential peaks: 41 in veto map, 10 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 56 potential peaks
Of 56 potential peaks: 45 in veto map, 10 cut by saddle test, 0 cut by aper test, 1 kept
SED Red : 1 new peaks
Adding 44 new sources
Median coadd sky for g : -7.118628e-05
Median coadd sky for r : -1.7296788e-05
Median coadd sky for z : 1.188989e-05
Stage srcs : Wall: 0.61 s, CPU: 0.57 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 243 MB, VmData: 268 MB, maxrss: 0.248388 MB
Stage srcs finished: 2020-08-05T20:32:33.614457
Resources for stage srcs : 0.096 s worker CPU, 0.096 s worker Wall, Wall: 0.612 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:32:33.630509
Blob 1 of 20, id: 6, sources: 20, size: 173x138, npix 10330, brick X: 4,177, Y: 45,183, one pixel: 100 45
Blob 2 of 20, id: 4, sources: 4, size: 92x107, npix 5519, brick X: 138,230, Y: 22,129, one pixel: 204 22
Blob 3 of 20, id: 0, sources: 2, size: 62x57, npix 2289, brick X: 0,62, Y: 0,57, one pixel: 0 0
Blob 4 of 20, id: 16, sources: 2, size: 73x61, npix 2071, brick X: 8,81, Y: 196,257, one pixel: 58 196
Blob 5 of 20, id: 17, sources: 4, size: 59x49, npix 1181, brick X: 146,205, Y: 214,263, one pixel: 193 214
Blob 6 of 20, id: 18, sources: 2, size: 27x32, npix 492, brick X: 215,242, Y: 224,256, one pixel: 224 224
Blob 7 of 20, id: 1, sources: 1, size: 36x16, npix 442, brick X: 43,79, Y: 0,16, one pixel: 44 0
Blob 8 of 20, id: 7, sources: 1, size: 29x23, npix 429, brick X: 234,263, Y: 54,77, one pixel: 243 54
Blob 9 of 20, id: 10, sources: 1, size: 25x26, npix 415, brick X: 231,256, Y: 125,151, one pixel: 242 125
Blob 10 of 20, id: 2, sources: 1, size: 25x25, npix 392, brick X: 83,108, Y: 5,30, one pixel: 94 5
Blob 11 of 20, id: 15, sources: 1, size: 24x24, npix 374, brick X: 1,25, Y: 181,205, one pixel: 9 181
Blob 12 of 20, id: 14, sources: 1, size: 25x24, npix 364, brick X: 177,202, Y: 162,186, one pixel: 189 162
Blob 13 of 20, id: 12, sources: 1, size: 25x22, npix 338, brick X: 197,222, Y: 141,163, one pixel: 207 141
Blob 14 of 20, id: 8, sources: 1, size: 23x23, npix 337, brick X: 0,23, Y: 67,90, one pixel: 9 67
Blob 15 of 20, id: 3, sources: 1, size: 21x24, npix 314, brick X: 242,263, Y: 15,39, one pixel: 251 15
Blob 16 of 20, id: 5, sources: 1, size: 22x22, npix 300, brick X: 105,127, Y: 28,50, one pixel: 115 28
Blob 17 of 20, id: 9, sources: 1, size: 24x21, npix 291, brick X: 222,246, Y: 85,106, one pixel: 235 85
Measuring 1 iterative sources
Blob 14 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 969 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156748 MB
Blob 18 of 20, id: 13, sources: 1, size: 20x21, npix 249, brick X: 55,75, Y: 161,182, one pixel: 63 161
Blob 12 finished, total: Wall: 0.81 s, CPU: 0.81 s, VmPeak: 1015 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155312 MB
Blob 19 of 20, id: 19, sources: 1, size: 21x20, npix 230, brick X: 189,210, Y: 239,259, one pixel: 198 239
Blob 15 finished, total: Wall: 0.81 s, CPU: 0.80 s, VmPeak: 1028 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14908 MB
Blob 20 of 20, id: 11, sources: 1, size: 18x18, npix 180, brick X: 8,26, Y: 141,159, one pixel: 16 141
Blob 10 finished, total: Wall: 0.99 s, CPU: 0.99 s, VmPeak: 1029 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148684 MB
Blob 13 finished, total: Wall: 1.01 s, CPU: 1.00 s, VmPeak: 973 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156168 MB
Blob 8 finished, total: Wall: 1.06 s, CPU: 1.06 s, VmPeak: 940 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150804 MB
Blob 20 finished, total: Wall: 0.09 s, CPU: 0.09 s, VmPeak: 1029 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150704 MB
Blob 19 finished, total: Wall: 0.26 s, CPU: 0.26 s, VmPeak: 1028 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14908 MB
Blob 9 finished, total: Wall: 1.12 s, CPU: 1.12 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150676 MB
Blob 11 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 1030 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151076 MB
Blob 16 finished, total: Wall: 1.15 s, CPU: 1.14 s, VmPeak: 1034 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148472 MB
Blob 3 finished, total: Wall: 1.31 s, CPU: 1.31 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150256 MB
Blob 17 finished, total: Wall: 1.00 s, CPU: 1.00 s, VmPeak: 969 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156748 MB
Blob 18 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 1015 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.157 MB
Blob 6 finished, total: Wall: 1.47 s, CPU: 1.47 s, VmPeak: 974 MB, VmSize: 738 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.154924 MB
Blob 7 finished, total: Wall: 1.84 s, CPU: 1.84 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151612 MB
Measuring 5 iterative sources
Blob 5 finished, total: Wall: 2.63 s, CPU: 2.63 s, VmPeak: 970 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156804 MB
Blob 2 finished, total: Wall: 2.83 s, CPU: 2.82 s, VmPeak: 969 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156324 MB
Blob 4 finished, total: Wall: 3.54 s, CPU: 3.54 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.152024 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.63726, ee1=0.747732, ee2=-1.03938
Measuring 4 iterative sources
Blob 1 finished, total: Wall: 15.49 s, CPU: 15.47 s, VmPeak: 970 MB, VmSize: 738 MB, VmRSS: 156 MB, VmData: 187 MB, maxrss: 0.159332 MB
Old catalog: 48
New catalog: 51
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/blobs-custom-036148m39026.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/metrics/cus/all-models-custom-036148m39026.fits
Stage fitblobs : Wall: 15.93 s, CPU: 0.45 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 243 MB, VmData: 268 MB, maxrss: 0.248552 MB
Stage fitblobs finished: 2020-08-05T20:32:49.561788
Resources for stage fitblobs : 39.674 s worker CPU, 39.832 s worker Wall, Wall: 15.933 s, Cores in use: 2.52, Total efficiency (on 16 cores): 15.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:32:49.581457
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/tmp-legacysurvey-custom-036148m39026-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/tmp-legacysurvey-custom-036148m39026-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/tmp-legacysurvey-custom-036148m39026-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/tmp-legacysurvey-custom-036148m39026-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-resid.jpg
Stage coadds : Wall: 2.77 s, CPU: 1.34 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 243 MB, VmData: 268 MB, maxrss: 0.249068 MB
Stage coadds finished: 2020-08-05T20:32:52.349408
Resources for stage coadds : 8.610 s worker CPU, 14.344 s worker Wall, Wall: 2.769 s, Cores in use: 3.59, Total efficiency (on 16 cores): 22.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T20:32:52.369525
Cut to 1 unWISE tiles
Reading WISE tile 0367m394 band 1
Reading WISE tile 0367m394 band 2
Reading WISE tile 0367m394 band 3
Reading WISE tile 0367m394 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 969 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.195292 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1034 MB, VmSize: 809 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.211952 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 969 MB, VmSize: 806 MB, VmRSS: 146 MB, VmData: 171 MB, maxrss: 0.20896 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 940 MB, VmSize: 808 MB, VmRSS: 147 MB, VmData: 173 MB, maxrss: 0.210656 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/tmp-legacysurvey-custom-036148m39026-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/tmp-legacysurvey-custom-036148m39026-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.08 s, CPU: 1.48 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 244 MB, VmData: 268 MB, maxrss: 0.249772 MB
Stage wise_forced finished: 2020-08-05T20:32:55.447582
Resources for stage wise_forced : 3.611 s worker CPU, 4.750 s worker Wall, Wall: 3.079 s, Cores in use: 1.65, Total efficiency (on 16 cores): 10.3 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:32:55.465178
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/coadd/cus/custom-036148m39026/legacysurvey-custom-036148m39026-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/tractor-i/cus/tractor-custom-036148m39026.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/tractor/cus/tractor-custom-036148m39026.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/tractor/cus/brick-custom-036148m39026.sha256sum
Stage writecat : Wall: 3.45 s, CPU: 1.39 s, VmPeak: 1170 MB, VmSize: 1042 MB, VmRSS: 246 MB, VmData: 268 MB, maxrss: 0.382648 MB
Stage writecat finished: 2020-08-05T20:32:58.913423
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.450 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-writecat.p
All done: 70.040 s worker CPU, 924.382 s worker Wall, Wall: 133.237 s, Cores in use: 0.61, Total efficiency (on 16 cores): 3.8 %
Finished galaxy PGC602638 in 2.267 minutes.
Started working on galaxy PGC602638 at Wed Aug  5 22:15:44 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.1488315 -39.0261704 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T22:15:46.427344
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.1488315', '-39.0261704', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.1488315 -39.0261704 --width 263 --height 263 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 36.1488315 -39.0261704
Starting process 59702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 59704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 59706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 59708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 59710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059404 MB
Starting process 59712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB
Starting process 59714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059412 MB
Starting process 59715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 59717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 59720 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 59722 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 59724 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 59726 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 59728 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 59730 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 59731 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 59733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 59738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 59739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 59737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 59740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 59742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 59743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 59745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 59746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 59747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 59748 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 59749 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 59750 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 59751 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 59752 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 59753 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T22:15:46.936582
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 27 CCDs:
  c4d_150209_013042_ooi_r_ls9-N22 r expnum 407955 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57062.061 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20150208/c4d_150209_013042_ooi_r_ls9.fits.fz
  c4d_140817_092105_ooi_z_ls9-N22 z expnum 348962 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56886.388 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20140816/c4d_140817_092105_ooi_z_ls9.fits.fz
  c4d_161127_053111_ooi_g_ls9-N21 g expnum 596889 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57719.228 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161126/c4d_161127_053111_ooi_g_ls9.fits.fz
  c4d_161218_043208_ooi_z_ls9-N21 z expnum 601838 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 57740.187 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161217/c4d_161218_043208_ooi_z_ls9.fits.fz
  c4d_141225_032931_ooi_g_ls9-N22 g expnum 391301 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57016.144 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_032931_ooi_g_ls9.fits.fz
  c4d_161127_052917_ooi_r_ls9-N21 r expnum 596888 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57719.227 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161126/c4d_161127_052917_ooi_r_ls9.fits.fz
  c4d_161123_061839_ooi_g_v1-N21 g expnum 595477 exptime 90.0 propid 2012B-0001 seeing 1.84 MJD 57715.261 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.1/CP20161123/c4d_161123_061839_ooi_g_v1.fits.fz
  c4d_151114_050424_ooi_r_ls9-S7 r expnum 492846 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57340.210 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151113/c4d_151114_050424_ooi_r_ls9.fits.fz
  c4d_151101_071519_ooi_z_ls9-S7 z expnum 488890 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57327.301 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151031/c4d_151101_071519_ooi_z_ls9.fits.fz
  c4d_151114_050619_ooi_g_ls9-S7 g expnum 492847 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57340.211 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151113/c4d_151114_050619_ooi_g_ls9.fits.fz
  c4d_161221_035414_ooi_r_ls9-S22 r expnum 602990 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57743.161 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.8.2/CP20161220/c4d_161221_035414_ooi_r_ls9.fits.fz
  c4d_171002_081033_ooi_z_v1-S22 z expnum 683592 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 58028.341 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.1/CP20171001/c4d_171002_081033_ooi_z_v1.fits.fz
  c4d_161221_035612_ooi_g_ls9-S22 g expnum 602991 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57743.162 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.8.2/CP20161220/c4d_161221_035612_ooi_g_ls9.fits.fz
  c4d_160925_041707_ooi_g_ls9-N14 g expnum 576953 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57656.177 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_041707_ooi_g_ls9.fits.fz
  c4d_160923_081409_ooi_r_ls9-N14 r expnum 576227 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57654.342 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160922/c4d_160923_081409_ooi_r_ls9.fits.fz
  c4d_171110_071127_ooi_z_v1-S3 z expnum 694711 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58067.300 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171109/c4d_171110_071127_ooi_z_v1.fits.fz
  c4d_171120_062436_ooi_g_v1-S3 g expnum 698025 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58077.267 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171119/c4d_171120_062436_ooi_g_v1.fits.fz
  c4d_171120_062236_ooi_r_v1-S3 r expnum 698024 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58077.266 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171119/c4d_171120_062236_ooi_r_v1.fits.fz
  c4d_141230_035408_ooi_z_ls9-N2 z expnum 393127 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57021.161 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_035408_ooi_z_ls9.fits.fz
  c4d_141225_033130_ooi_r_ls9-N2 r expnum 391302 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57016.145 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_033130_ooi_r_ls9.fits.fz
  c4d_150116_023941_ooi_g_ls9-N2 g expnum 398761 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 57038.109 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20150115/c4d_150116_023941_ooi_g_ls9.fits.fz
  c4d_160120_024324_ooi_z_ls9-N14 z expnum 513352 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57407.112 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160119/c4d_160120_024324_ooi_z_ls9.fits.fz
  c4d_180205_013633_ooi_g_v1-S23 g expnum 717847 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58154.067 object DES survey hex 348-400 tiling 9 
    decam/CP/V4.1/CP20180204/c4d_180205_013633_ooi_g_v1.fits.fz
  c4d_180122_020238_ooi_z_v1-S23 z expnum 714156 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58140.085 object DES survey hex 348-400 tiling 9 
    decam/CP/V4.1/CP20180121/c4d_180122_020238_ooi_z_v1.fits.fz
  c4d_141118_065223_ooi_g_ls9-S26 g expnum 379049 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 56979.285 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20141117/c4d_141118_065223_ooi_g_ls9.fits.fz
  c4d_141118_065422_ooi_r_ls9-S26 r expnum 379050 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56979.286 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20141117/c4d_141118_065422_ooi_r_ls9.fits.fz
  c4d_150108_015238_ooi_z_ls9-S26 z expnum 395506 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57030.077 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20150107/c4d_150108_015238_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a6d6-r-20141118T065203_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b589-g-20160925T041445_oi[N14,noinherit][2046,4094][real]: DES sur
Clipping 3 pixels with anomalously large oow values: max 0.0596276 vs median 0.0448269
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081149_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96154c2-z-20140817T091840_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T035147_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961e937-r-20150209T012821_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627da7-z-20160120T024105_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T042948_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T061618_oi[N21,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96187b5-g-20141118T065006_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-r-20171120T062236_oi[S3,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-g-20171120T062436_oi[S3,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T032710_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171106_9009a16-z-20171110T071127_oi[S3,noinherit][2046,4094][real]: DES
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9624332-r-20151114T050201_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9503662-r-20161127T052652_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95069cb-g-20161221T035352_oi[S22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180122T020238_oi[S23,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T032908_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623448-g-20151114T050401_oi[S7,noinherit][2046,4094][real]: DES surv
Clipping 2 pixels with anomalously large oow values: max 0.0507834 vs median 0.038249
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950321a-g-20161127T052852_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961adec-g-20150116T023722_oi[N2,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180205T013633_oi[S23,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20150108T015017_oi[S26,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170930_8fde346-z-20171002T081033_oi[S22,noinherit][2046,4094][real]: DE
Started working on galaxy PGC602638 at Mon Aug 10 09:10:41 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.14942274186421 -39.02660436770868 --width 263 --height 263 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T09:10:42.683587
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '36.14942274186421', '-39.02660436770868', '--width', '263', '--height', '263', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 36.14942274186421 -39.02660436770868 --width 263 --height 263 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 36.14942274186421 -39.02660436770868
Starting process 30225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 30229 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 30232 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 30236 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 30240 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059524 MB
Starting process 30246 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 30249 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 30255 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T09:10:43.257231
Keeping 27 CCDs:
  c4d_150209_013042_ooi_r_ls9-N22 r expnum 407955 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57062.061 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20150208/c4d_150209_013042_ooi_r_ls9.fits.fz
  c4d_140817_092105_ooi_z_ls9-N22 z expnum 348962 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 56886.388 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20140816/c4d_140817_092105_ooi_z_ls9.fits.fz
  c4d_161127_053111_ooi_g_ls9-N21 g expnum 596889 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57719.228 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161126/c4d_161127_053111_ooi_g_ls9.fits.fz
  c4d_161218_043208_ooi_z_ls9-N21 z expnum 601838 exptime 90.0 propid 2012B-0001 seeing 0.94 MJD 57740.187 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161217/c4d_161218_043208_ooi_z_ls9.fits.fz
  c4d_141225_032931_ooi_g_ls9-N22 g expnum 391301 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57016.144 object DES survey hex 370-390 tiling 2 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_032931_ooi_g_ls9.fits.fz
  c4d_161127_052917_ooi_r_ls9-N21 r expnum 596888 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57719.227 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.8.2/CP20161126/c4d_161127_052917_ooi_r_ls9.fits.fz
  c4d_161123_061839_ooi_g_v1-N21 g expnum 595477 exptime 90.0 propid 2012B-0001 seeing 1.84 MJD 57715.261 object DES survey hex 370-390 tiling 6 
    decam/CP/V4.1/CP20161123/c4d_161123_061839_ooi_g_v1.fits.fz
  c4d_151114_050424_ooi_r_ls9-S7 r expnum 492846 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57340.210 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151113/c4d_151114_050424_ooi_r_ls9.fits.fz
  c4d_151101_071519_ooi_z_ls9-S7 z expnum 488890 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57327.301 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151031/c4d_151101_071519_ooi_z_ls9.fits.fz
  c4d_151114_050619_ooi_g_ls9-S7 g expnum 492847 exptime 90.0 propid 2012B-0001 seeing 1.32 MJD 57340.211 object DES survey hex 348-400 tiling 4 
    decam/CP/V4.8.2a/CP20151113/c4d_151114_050619_ooi_g_ls9.fits.fz
  c4d_161221_035414_ooi_r_ls9-S22 r expnum 602990 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 57743.161 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.8.2/CP20161220/c4d_161221_035414_ooi_r_ls9.fits.fz
  c4d_171002_081033_ooi_z_v1-S22 z expnum 683592 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 58028.341 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.1/CP20171001/c4d_171002_081033_ooi_z_v1.fits.fz
  c4d_161221_035612_ooi_g_ls9-S22 g expnum 602991 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 57743.162 object DES survey hex 348-400 tiling 7 
    decam/CP/V4.8.2/CP20161220/c4d_161221_035612_ooi_g_ls9.fits.fz
  c4d_160925_041707_ooi_g_ls9-N14 g expnum 576953 exptime 90.0 propid 2012B-0001 seeing 1.21 MJD 57656.177 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160924/c4d_160925_041707_ooi_g_ls9.fits.fz
  c4d_160923_081409_ooi_r_ls9-N14 r expnum 576227 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57654.342 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160922/c4d_160923_081409_ooi_r_ls9.fits.fz
  c4d_171110_071127_ooi_z_v1-S3 z expnum 694711 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58067.300 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171109/c4d_171110_071127_ooi_z_v1.fits.fz
  c4d_171120_062436_ooi_g_v1-S3 g expnum 698025 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58077.267 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171119/c4d_171120_062436_ooi_g_v1.fits.fz
  c4d_171120_062236_ooi_r_v1-S3 r expnum 698024 exptime 90.0 propid 2012B-0001 seeing 1.19 MJD 58077.266 object DES survey hex 370-390 tiling 8 
    decam/CP/V4.1/CP20171119/c4d_171120_062236_ooi_r_v1.fits.fz
  c4d_141230_035408_ooi_z_ls9-N2 z expnum 393127 exptime 90.0 propid 2012B-0001 seeing 0.95 MJD 57021.161 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20141229/c4d_141230_035408_ooi_z_ls9.fits.fz
  c4d_141225_033130_ooi_r_ls9-N2 r expnum 391302 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57016.145 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20141224/c4d_141225_033130_ooi_r_ls9.fits.fz
  c4d_150116_023941_ooi_g_ls9-N2 g expnum 398761 exptime 90.0 propid 2012B-0001 seeing 1.27 MJD 57038.109 object DES survey hex 370-390 tiling 1 
    decam/CP/V4.8.2a/CP20150115/c4d_150116_023941_ooi_g_ls9.fits.fz
  c4d_160120_024324_ooi_z_ls9-N14 z expnum 513352 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57407.112 object DES survey hex 370-390 tiling 5 
    decam/CP/V4.8.2a/CP20160119/c4d_160120_024324_ooi_z_ls9.fits.fz
  c4d_180205_013633_ooi_g_v1-S23 g expnum 717847 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 58154.067 object DES survey hex 348-400 tiling 9 
    decam/CP/V4.1/CP20180204/c4d_180205_013633_ooi_g_v1.fits.fz
  c4d_180122_020238_ooi_z_v1-S23 z expnum 714156 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 58140.085 object DES survey hex 348-400 tiling 9 
    decam/CP/V4.1/CP20180121/c4d_180122_020238_ooi_z_v1.fits.fz
  c4d_141118_065223_ooi_g_ls9-S26 g expnum 379049 exptime 90.0 propid 2012B-0001 seeing 1.30 MJD 56979.285 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20141117/c4d_141118_065223_ooi_g_ls9.fits.fz
  c4d_141118_065422_ooi_r_ls9-S26 r expnum 379050 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 56979.286 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20141117/c4d_141118_065422_ooi_r_ls9.fits.fz
  c4d_150108_015238_ooi_z_ls9-S26 z expnum 395506 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57030.077 object DES survey hex 370-390 tiling 3 
    decam/CP/V4.8.2a/CP20150107/c4d_150108_015238_ooi_z_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950321a-g-20161127T052852_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T032710_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961e937-r-20150209T012821_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96154c2-z-20140817T091840_oi[N22,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9503662-r-20161127T052652_oi[N21,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9624332-r-20151114T050201_oi[S7,noinherit][2046,4094][real]: DES surv
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T061618_oi[N21,noinherit][2046,4094][real]: DE
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T042948_oi[N21,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623448-g-20151114T050401_oi[S7,noinherit][2046,4094][real]: DES surv
Clipping 2 pixels with anomalously large oow values: max 0.0507834 vs median 0.038249
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95069cb-g-20161221T035352_oi[S22,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b589-g-20160925T041445_oi[N14,noinherit][2046,4094][real]: DES sur
Clipping 3 pixels with anomalously large oow values: max 0.0596276 vs median 0.0448269
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081149_oi[N14,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171106_9009a16-z-20171110T071127_oi[S3,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170930_8fde346-z-20171002T081033_oi[S22,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-r-20171120T062236_oi[S3,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-g-20171120T062436_oi[S3,noinherit][2046,4094][real]: DES
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T035147_oi[N2,noinherit][2046,4094][real]: DES surv
Zeroing out 3804 weight-map pixels below quantization error (= median 3.65e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T032908_oi[N2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9506e1c-r-20161221T035153_oi[S22,noinherit][2046,4094][real]: DES sur
Zeroing out 25 weight-map pixels below quantization error (= median 3.27e-06)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961adec-g-20150116T023722_oi[N2,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627da7-z-20160120T024105_oi[N14,noinherit][2046,4094][real]: DES sur
Zeroing out 8 weight-map pixels below quantization error (= median 0.000252)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180122T020238_oi[S23,noinherit][2046,4094][real]: DE
Zeroing out 0 weight-map pixels below quantization error (= median 0.000225)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T071300_oi[S7,noinherit][2046,4094][real]: DES surv
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96187b5-g-20141118T065006_oi[S26,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a6d6-r-20141118T065203_oi[S26,noinherit][2046,4094][real]: DES sur
Zeroing out 1 weight-map pixels below quantization error (= median 6.14e-05)
The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180205T013633_oi[S23,noinherit][2046,4094][real]: DE
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20150108T015017_oi[S26,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 146.54 s, CPU: 1.38 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 194 MB, VmData: 228 MB, maxrss: 0.199076 MB
Stage tims finished: 2020-08-10T09:13:09.793041
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96154c2-z-20140817T091840_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20170930_8fde346-z-20171002T081033_oi[S22,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961adec-g-20150116T023722_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9503662-r-20161127T052652_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623448-g-20151114T050401_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9627da7-z-20160120T024105_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 49 weight-map pixels below quantization error (= median 3.14e-06)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961e937-r-20150209T012821_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b589-g-20160925T041445_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-g-20171120T062436_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20180118_90b208c-z-20180122T020238_oi[S23,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a5f3-g-20141225T032710_oi[N22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95069cb-g-20161221T035352_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20141230T035147_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_96187b5-g-20141118T065006_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES16B_20161121_8e237e6-g-20161123T061618_oi[N21,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9623afc-z-20151101T071300_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95044db-z-20161218T042948_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171106_9009a16-z-20171110T071127_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961c811-r-20141225T032908_oi[N2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961a6d6-r-20141118T065203_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Zeroing out 7 weight-map pixels below quantization error (= median 0.00024)
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9624332-r-20151114T050201_oi[S7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_962b673-r-20160923T081149_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES17B_20171113_901ed81-r-20171120T062236_oi[S3,noinherit][2046,4094][real]: DES [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DES18A_20180202_90c310f-g-20180205T013633_oi[S23,noinherit][2046,4094][real]: DE [astropy.io.fits.card]
Resources for stage tims : 10.164 s worker CPU, 1062.516 s worker Wall, Wall: 146.537 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_950321a-g-20161127T052852_oi[N21,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9506e1c-r-20161221T035153_oi[S22,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_961d4c2-z-20150108T015017_oi[S26,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-10T09:13:09.844461
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09933.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09932.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10061.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-09805.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/reference-custom-036149m39026.fits
Stage refs : Wall: 18.34 s, CPU: 1.55 s, VmPeak: 1040 MB, VmSize: 1021 MB, VmRSS: 208 MB, VmData: 240 MB, maxrss: 0.212548 MB
Stage refs finished: 2020-08-10T09:13:28.184110
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.341 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.1 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T09:13:28.240132
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/outlier-mask-custom-036149m39026.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/outliers-pre-custom-036149m39026.jpg
Image c4d_161123_061839_ooi_g_v1-N21 g : masking 7286 positive outlier pixels and 0 negative outlier pixels
Image c4d_161221_035612_ooi_g_ls9-S22 g : masking 1490 positive outlier pixels and 0 negative outlier pixels
Image c4d_180205_013633_ooi_g_v1-S23 g : masking 370 positive outlier pixels and 0 negative outlier pixels
Image c4d_151114_050424_ooi_r_ls9-S7 r : masking 0 positive outlier pixels and 53 negative outlier pixels
Image c4d_161221_035414_ooi_r_ls9-S22 r : masking 841 positive outlier pixels and 0 negative outlier pixels
Image c4d_171120_062236_ooi_r_v1-S3 r : masking 194 positive outlier pixels and 0 negative outlier pixels
Image c4d_140817_092105_ooi_z_ls9-N22 z : masking 119 positive outlier pixels and 0 negative outlier pixels
Image c4d_171110_071127_ooi_z_v1-S3 z : masking 0 positive outlier pixels and 82 negative outlier pixels
Image c4d_180122_020238_ooi_z_v1-S23 z : masking 595 positive outlier pixels and 0 negative outlier pixels
Image c4d_171002_081033_ooi_z_v1-S22 z : masking 611 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/outlier-mask-custom-036149m39026.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/outliers-post-custom-036149m39026.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/outliers-masked-pos-custom-036149m39026.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/outliers-masked-neg-custom-036149m39026.jpg
Stage outliers : Wall: 1.80 s, CPU: 1.52 s, VmPeak: 1040 MB, VmSize: 1031 MB, VmRSS: 235 MB, VmData: 264 MB, maxrss: 0.240724 MB
Stage outliers finished: 2020-08-10T09:13:30.038443
Resources for stage outliers : 2.770 s worker CPU, 2.776 s worker Wall, Wall: 1.799 s, Cores in use: 2.39, Total efficiency (on 8 cores): 29.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T09:13:30.376900
Stage halos : Wall: 2.15 s, CPU: 0.41 s, VmPeak: 1040 MB, VmSize: 1031 MB, VmRSS: 235 MB, VmData: 265 MB, maxrss: 0.241076 MB
Stage halos finished: 2020-08-10T09:13:32.525017
Resources for stage halos : 0.818 s worker CPU, 4.243 s worker Wall, Wall: 2.149 s, Cores in use: 0.57, Total efficiency (on 8 cores): 7.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T09:13:32.583383
PSF sigmas in coadd pixels: ['2.03', '1.88', '2.99', '2.15', '1.98', '1.97', '1.91', '2.07', '1.74', '2.11']
Using average PSF sigma 2.0819872346703345
Gaussian PSF norm 0.13549304581521393 vs pixelized 0.1121574
average tim pixel scale / coadd scale: 1.0010665718053702
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['1.79', '1.93', '1.84', '1.94', '1.67', '1.94', '1.84', '1.85']
Using average PSF sigma 1.8499955089001574
Gaussian PSF norm 0.15248404140266622 vs pixelized 0.13044615
average tim pixel scale / coadd scale: 1.0010831801506037
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.59', '1.52', '1.72', '1.97', '1.69', '1.55', '1.59', '1.63', '1.71']
Using average PSF sigma 1.6639731621932814
Gaussian PSF norm 0.16953085433304063 vs pixelized 0.15148139
average tim pixel scale / coadd scale: 1.0010247378261716
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.45 s, CPU: 0.44 s, VmPeak: 1040 MB, VmSize: 1031 MB, VmRSS: 237 MB, VmData: 265 MB, maxrss: 0.243004 MB
Stage fit_on_coadds finished: 2020-08-10T09:13:33.035865
Resources for stage fit_on_coadds : 0.642 s worker CPU, 0.651 s worker Wall, Wall: 0.454 s, Cores in use: 2.38, Total efficiency (on 8 cores): 29.8 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T09:13:33.049498
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 36 potential peaks
Of 36 potential peaks: 7 in veto map, 4 cut by saddle test, 0 cut by aper test, 25 kept
SED z : 25 new peaks
Found 43 potential peaks
Of 43 potential peaks: 27 in veto map, 5 cut by saddle test, 0 cut by aper test, 11 kept
SED r : 11 new peaks
Found 31 potential peaks
Of 31 potential peaks: 25 in veto map, 5 cut by saddle test, 0 cut by aper test, 1 kept
SED g : 1 new peaks
Found 57 potential peaks
Of 57 potential peaks: 43 in veto map, 7 cut by saddle test, 0 cut by aper test, 7 kept
SED Flat : 7 new peaks
Found 57 potential peaks
Of 57 potential peaks: 48 in veto map, 9 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 44 new sources
Median coadd sky for g : -8.056298e-05
Median coadd sky for r : -2.0900417e-05
Median coadd sky for z : 6.0141606e-06
Stage srcs : Wall: 0.60 s, CPU: 0.57 s, VmPeak: 1040 MB, VmSize: 1031 MB, VmRSS: 238 MB, VmData: 265 MB, maxrss: 0.243528 MB
Stage srcs finished: 2020-08-10T09:13:33.654395
Resources for stage srcs : 0.076 s worker CPU, 0.076 s worker Wall, Wall: 0.606 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T09:13:33.669087
Blob 1 of 21, id: 6, sources: 18, size: 168x137, npix 10221, brick X: 16,184, Y: 51,188, one pixel: 106 51
Blob 2 of 21, id: 4, sources: 3, size: 92x107, npix 5517, brick X: 144,236, Y: 28,135, one pixel: 210 28
Blob 3 of 21, id: 0, sources: 2, size: 69x63, npix 2835, brick X: 0,69, Y: 0,63, one pixel: 0 0
Blob 4 of 21, id: 16, sources: 2, size: 74x62, npix 2064, brick X: 14,88, Y: 201,263, one pixel: 68 201
Blob 5 of 21, id: 1, sources: 4, size: 71x36, npix 1349, brick X: 44,115, Y: 0,36, one pixel: 46 0
Blob 6 of 21, id: 15, sources: 2, size: 32x42, npix 769, brick X: 0,32, Y: 169,211, one pixel: 4 169
Blob 7 of 21, id: 18, sources: 2, size: 39x22, npix 557, brick X: 158,197, Y: 230,252, one pixel: 167 230
Blob 8 of 21, id: 19, sources: 2, size: 26x32, npix 480, brick X: 222,248, Y: 230,262, one pixel: 230 230
Blob 9 of 21, id: 10, sources: 1, size: 26x26, npix 416, brick X: 237,263, Y: 131,157, one pixel: 248 131
Blob 3 finished, total: Wall: 1.31 s, CPU: 1.30 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145596 MB
Blob 10 of 21, id: 14, sources: 1, size: 25x24, npix 364, brick X: 183,208, Y: 168,192, one pixel: 195 168
Blob 7 finished, total: Wall: 1.74 s, CPU: 1.52 s, VmPeak: 1025 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14824 MB
Blob 11 of 21, id: 8, sources: 1, size: 24x23, npix 348, brick X: 6,30, Y: 73,96, one pixel: 15 73
Blob 8 finished, total: Wall: 1.81 s, CPU: 1.59 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.1439 MB
Blob 12 of 21, id: 7, sources: 1, size: 23x22, npix 340, brick X: 240,263, Y: 60,82, one pixel: 249 60
Blob 6 finished, total: Wall: 2.06 s, CPU: 2.06 s, VmPeak: 968 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143316 MB
Blob 13 of 21, id: 12, sources: 1, size: 25x22, npix 339, brick X: 203,228, Y: 147,169, one pixel: 213 147
Blob 11 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145584 MB
Blob 14 of 21, id: 5, sources: 1, size: 23x22, npix 312, brick X: 111,134, Y: 34,56, one pixel: 121 34
Blob 9 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145596 MB
Blob 15 of 21, id: 9, sources: 1, size: 24x21, npix 299, brick X: 228,252, Y: 91,112, one pixel: 241 91
Blob 10 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 1025 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14824 MB
Blob 16 of 21, id: 17, sources: 1, size: 21x21, npix 260, brick X: 190,211, Y: 220,241, one pixel: 199 220
Measuring 1 iterative sources
Measuring 5 iterative sources
Measuring 1 iterative sources
Blob 13 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145584 MB
Blob 17 of 21, id: 13, sources: 1, size: 21x21, npix 241, brick X: 61,82, Y: 167,188, one pixel: 70 167
Blob 15 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 1025 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14824 MB
Blob 18 of 21, id: 20, sources: 1, size: 21x18, npix 225, brick X: 195,216, Y: 245,263, one pixel: 204 245
Blob 12 finished, total: Wall: 1.27 s, CPU: 1.27 s, VmPeak: 968 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143316 MB
Blob 19 of 21, id: 3, sources: 1, size: 15x21, npix 205, brick X: 248,263, Y: 22,43, one pixel: 257 22
Blob 14 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145596 MB
Blob 20 of 21, id: 11, sources: 1, size: 17x18, npix 162, brick X: 15,32, Y: 147,165, one pixel: 23 147
Blob 16 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145776 MB
Blob 21 of 21, id: 2, sources: 1, size: 17x15, npix 141, brick X: 108,125, Y: 0,15, one pixel: 114 0
Blob 20 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145776 MB
Blob 17 finished, total: Wall: 0.59 s, CPU: 0.59 s, VmPeak: 1025 MB, VmSize: 728 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14824 MB
Blob 2 finished, total: Wall: 3.99 s, CPU: 3.99 s, VmPeak: 1006 MB, VmSize: 724 MB, VmRSS: 141 MB, VmData: 179 MB, maxrss: 0.144596 MB
Blob 18 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 968 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143316 MB
Blob 19 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145596 MB
Blob 4 finished, total: Wall: 4.47 s, CPU: 4.46 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148424 MB
Blob 5 finished, total: Wall: 4.74 s, CPU: 4.74 s, VmPeak: 1027 MB, VmSize: 726 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148176 MB
Blob 21 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 967 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145776 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.45565, ee1=0.669042, ee2=-0.930087
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 14.27 s, CPU: 14.27 s, VmPeak: 1027 MB, VmSize: 727 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.15038 MB
Old catalog: 48
New catalog: 53
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/blobs-custom-036149m39026.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/metrics/cus/all-models-custom-036149m39026.fits
Stage fitblobs : Wall: 14.86 s, CPU: 0.61 s, VmPeak: 1040 MB, VmSize: 1031 MB, VmRSS: 238 MB, VmData: 265 MB, maxrss: 0.243692 MB
Stage fitblobs finished: 2020-08-10T09:13:48.530672
Resources for stage fitblobs : 44.080 s worker CPU, 44.653 s worker Wall, Wall: 14.863 s, Cores in use: 3.01, Total efficiency (on 8 cores): 37.6 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T09:13:48.543059
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/tmp-legacysurvey-custom-036149m39026-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/tmp-legacysurvey-custom-036149m39026-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/tmp-legacysurvey-custom-036149m39026-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/tmp-legacysurvey-custom-036149m39026-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-resid.jpg
Stage coadds : Wall: 1.48 s, CPU: 0.65 s, VmPeak: 1040 MB, VmSize: 1031 MB, VmRSS: 238 MB, VmData: 265 MB, maxrss: 0.244208 MB
Stage coadds finished: 2020-08-10T09:13:50.026577
Resources for stage coadds : 4.311 s worker CPU, 4.802 s worker Wall, Wall: 1.484 s, Cores in use: 3.34, Total efficiency (on 8 cores): 41.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T09:13:50.042947
Cut to 1 unWISE tiles
Reading WISE tile 0367m394 band 1
Reading WISE tile 0367m394 band 2
Reading WISE tile 0367m394 band 3
Reading WISE tile 0367m394 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 1006 MB, VmSize: 807 MB, VmRSS: 150 MB, VmData: 178 MB, maxrss: 0.19124 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1025 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.213308 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 967 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.208388 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/036/0367m394/unwise-0367m394-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1027 MB, VmSize: 806 MB, VmRSS: 149 MB, VmData: 177 MB, maxrss: 0.213544 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/tmp-legacysurvey-custom-036149m39026-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/tmp-legacysurvey-custom-036149m39026-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.00 s, CPU: 0.53 s, VmPeak: 1040 MB, VmSize: 1031 MB, VmRSS: 239 MB, VmData: 265 MB, maxrss: 0.244912 MB
Stage wise_forced finished: 2020-08-10T09:13:52.047267
Resources for stage wise_forced : 3.382 s worker CPU, 4.631 s worker Wall, Wall: 2.005 s, Cores in use: 1.95, Total efficiency (on 8 cores): 24.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T09:13:52.062681
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/coadd/cus/custom-036149m39026/legacysurvey-custom-036149m39026-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/tractor-i/cus/tractor-custom-036149m39026.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/tractor/cus/tractor-custom-036149m39026.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/tractor/cus/brick-custom-036149m39026.sha256sum
Stage writecat : Wall: 1.77 s, CPU: 0.70 s, VmPeak: 1164 MB, VmSize: 1036 MB, VmRSS: 241 MB, VmData: 265 MB, maxrss: 0.377768 MB
Stage writecat finished: 2020-08-10T09:13:53.833558
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.772 s, Cores in use: 0.40, Total efficiency (on 8 cores): 4.9 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/036/PGC602638/PGC602638-largegalaxy-writecat.p
All done: 66.245 s worker CPU, 1124.349 s worker Wall, Wall: 190.653 s, Cores in use: 0.39, Total efficiency (on 8 cores): 4.9 %
Finished galaxy PGC602638 in 3.208 minutes.