Started working on galaxy PGC786523 at Wed Aug  5 19:39:29 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.4323355 -24.747551 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T19:39:33.183960
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.4323355', '-24.747551', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.4323355 -24.747551 --width 245 --height 245 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.4323355 -24.747551
Starting process 61339 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB
Starting process 61341 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 61343 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 61345 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 61347 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 61349 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 61351 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 61353 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 61355 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 61357 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 61359 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 61361 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 61363 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 61365 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 61367 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 61369 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T19:39:34.076271
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 23 CCDs:
  c4d_151106_033655_ooi_r_ls9-N14 r expnum 490282 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57332.149 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20151105/c4d_151106_033655_ooi_r_ls9.fits.fz
  c4d_141211_042510_ooi_z_ls9-N14 z expnum 386330 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57002.183 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20141210/c4d_141211_042510_ooi_z_ls9.fits.fz
  c4d_151108_032624_ooi_g_ls9-N14 g expnum 491064 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57334.142 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_032624_ooi_g_ls9.fits.fz
  c4d_171224_032533_ooi_z_ls9-N31 z expnum 706812 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58111.143 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171223/c4d_171224_032533_ooi_z_ls9.fits.fz
  c4d_171123_052419_ooi_r_ls9-N31 r expnum 698859 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 58080.225 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171122/c4d_171123_052419_ooi_r_ls9.fits.fz
  c4d_171123_052816_ooi_g_ls9-N31 g expnum 698861 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58080.228 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171122/c4d_171123_052816_ooi_g_ls9.fits.fz
  c4d_171011_075322_ooi_z_ls9-S20 z expnum 685848 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 58037.329 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_075322_ooi_z_ls9.fits.fz
  c4d_161203_015450_ooi_r_ls9-S20 r expnum 598959 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 57725.078 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2/CP20161202/c4d_161203_015450_ooi_r_ls9.fits.fz
  c4d_161203_020048_ooi_g_ls9-S20 g expnum 598962 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 57725.082 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2/CP20161202/c4d_161203_020048_ooi_g_ls9.fits.fz
  c4d_150114_020403_ooi_r_ls9-N12 r expnum 397730 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57036.085 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20150113/c4d_150114_020403_ooi_r_ls9.fits.fz
  c4d_151106_033256_ooi_g_ls9-N12 g expnum 490280 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57332.146 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20151105/c4d_151106_033256_ooi_g_ls9.fits.fz
  c4d_141231_032245_ooi_z_ls9-N12 z expnum 393521 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57022.139 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20141230/c4d_141231_032245_ooi_z_ls9.fits.fz
  c4d_180116_015511_ooi_g_ls9-S20 g expnum 712475 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 58134.080 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180115/c4d_180116_015511_ooi_g_ls9.fits.fz
  c4d_180116_015112_ooi_r_ls9-S20 r expnum 712473 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 58134.077 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180115/c4d_180116_015112_ooi_r_ls9.fits.fz
  c4d_180127_010014_ooi_z_ls9-S20 z expnum 716058 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58145.042 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180126/c4d_180127_010014_ooi_z_ls9.fits.fz
  c4d_161203_015252_ooi_z_ls9-S24 z expnum 598958 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57725.077 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161202/c4d_161203_015252_ooi_z_ls9.fits.fz
  c4d_161109_062341_ooi_g_ls9-S24 g expnum 591515 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57701.265 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161108/c4d_161109_062341_ooi_g_ls9.fits.fz
  c4d_161109_062142_ooi_r_ls9-S24 r expnum 591514 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57701.263 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161108/c4d_161109_062142_ooi_r_ls9.fits.fz
  c4d_150913_084328_ooi_r_ls9-S11 r expnum 474404 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57278.362 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_084328_ooi_r_ls9.fits.fz
  c4d_150913_084518_ooi_g_ls9-S11 g expnum 474405 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57278.363 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_084518_ooi_g_ls9.fits.fz
  c4d_150817_101222_ooi_z_ls9-S11 z expnum 464605 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57251.424 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150816/c4d_150817_101222_ooi_z_ls9.fits.fz
  c4d_151023_061100_ooi_z_ls9-S27 z expnum 486785 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57318.256 object DES survey hex 292-258 tiling 5 
    decam/CP/V4.8.2a/CP20151022/c4d_151023_061100_ooi_z_ls9.fits.fz
  c4d_151108_034804_ooi_r_ls9-S27 r expnum 491074 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57334.157 object DES survey hex 292-258 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_034804_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150114T020143_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9504be0-r-20161203T015230_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T052419_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010014_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95048f6-g-20161203T015828_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180116T015511_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T052816_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T075322_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9502cdc-z-20161203T015031_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141231T032026_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T032404_oi[N14,noinherit][2046,4094][real]: DES sur
Clipping 2 pixels with anomalously large oow values: max 0.0487011 vs median 0.0372313
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9554133-z-20141211T042249_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180116T015112_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151106T033038_oi[N12,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524f0b-z-20171224T032533_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9563c11-r-20151106T033434_oi[N14,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9500ef2-g-20161109T062119_oi[S24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95589f7-r-20150913T084056_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501365-r-20161109T061921_oi[S24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T034544_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151023T060840_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95638ac-g-20150913T084254_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9567936-z-20150817T101004_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 69.26 s, CPU: 1.10 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 190 MB, VmData: 222 MB, maxrss: 0.194716 MB
Stage tims finished: 2020-08-05T19:40:43.340930
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9502cdc-z-20161203T015031_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95048f6-g-20161203T015828_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9554133-z-20141211T042249_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180116T015112_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151106T033038_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524f0b-z-20171224T032533_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9504be0-r-20161203T015230_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501365-r-20161109T061921_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T052419_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95589f7-r-20150913T084056_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T075322_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151023T060840_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141231T032026_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T034544_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180116T015511_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 12.466 s worker CPU, 596.543 s worker Wall, Wall: 69.266 s, Cores in use: 0.20, Total efficiency (on 16 cores): 1.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T032404_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150114T020143_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9500ef2-g-20161109T062119_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T052816_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95638ac-g-20150913T084254_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010014_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9567936-z-20150817T101004_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-05T19:40:43.701850
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08650.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/reference-custom-029432m24747.fits
Stage refs : Wall: 11.58 s, CPU: 2.29 s, VmPeak: 1045 MB, VmSize: 1025 MB, VmRSS: 202 MB, VmData: 233 MB, maxrss: 0.207044 MB
Stage refs finished: 2020-08-05T19:40:55.284116
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9563c11-r-20151106T033434_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 11.584 s, Cores in use: 0.20, Total efficiency (on 16 cores): 1.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T19:40:55.694521
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outlier-mask-custom-029432m24747.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-pre-custom-029432m24747.jpg
Image c4d_161109_062341_ooi_g_ls9-S24 g : masking 311 positive outlier pixels and 0 negative outlier pixels
Image c4d_151106_033256_ooi_g_ls9-N12 g : masking 0 positive outlier pixels and 103 negative outlier pixels
Image c4d_171123_052816_ooi_g_ls9-N31 g : masking 273 positive outlier pixels and 0 negative outlier pixels
Image c4d_180116_015511_ooi_g_ls9-S20 g : masking 266 positive outlier pixels and 0 negative outlier pixels
Image c4d_141231_032245_ooi_z_ls9-N12 z : masking 646 positive outlier pixels and 0 negative outlier pixels
Image c4d_180127_010014_ooi_z_ls9-S20 z : masking 282 positive outlier pixels and 0 negative outlier pixels
Image c4d_150817_101222_ooi_z_ls9-S11 z : masking 210 positive outlier pixels and 46 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outlier-mask-custom-029432m24747.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-post-custom-029432m24747.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-masked-pos-custom-029432m24747.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-masked-neg-custom-029432m24747.jpg
Stage outliers : Wall: 2.27 s, CPU: 2.06 s, VmPeak: 1045 MB, VmSize: 1035 MB, VmRSS: 226 MB, VmData: 254 MB, maxrss: 0.23122 MB
Stage outliers finished: 2020-08-05T19:40:57.965902
Resources for stage outliers : 1.650 s worker CPU, 1.650 s worker Wall, Wall: 2.273 s, Cores in use: 1.63, Total efficiency (on 16 cores): 10.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T19:40:58.013135
Stage halos : Wall: 0.25 s, CPU: 0.25 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.231648 MB
Stage halos finished: 2020-08-05T19:40:58.265932
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.254 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T19:40:58.540587
PSF sigmas in coadd pixels: ['1.82', '1.65', '2.27', '1.79', '2.23', '1.73', '1.85']
Using average PSF sigma 1.904492084096859
Gaussian PSF norm 0.14812074785159954 vs pixelized 0.129206
average tim pixel scale / coadd scale: 1.0010407354114954
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.03', '1.88', '2.08', '1.73', '2.42', '1.79', '1.95', '1.89']
Using average PSF sigma 1.9698798148627572
Gaussian PSF norm 0.14320406232170663 vs pixelized 0.13773586
average tim pixel scale / coadd scale: 1.0010598234935373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.58', '1.95', '1.61', '1.92', '1.74', '1.85', '1.83']
Using average PSF sigma 1.804289918452766
Gaussian PSF norm 0.15634670952203908 vs pixelized 0.1378717
average tim pixel scale / coadd scale: 1.0010128852356766
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.31 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234168 MB
Stage fit_on_coadds finished: 2020-08-05T19:40:58.848240
Resources for stage fit_on_coadds : 0.393 s worker CPU, 0.393 s worker Wall, Wall: 0.309 s, Cores in use: 2.28, Total efficiency (on 16 cores): 14.3 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T19:40:58.860047
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 19 potential peaks
Of 19 potential peaks: 5 in veto map, 2 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 37 potential peaks
Of 37 potential peaks: 15 in veto map, 5 cut by saddle test, 0 cut by aper test, 17 kept
SED r : 17 new peaks
Found 26 potential peaks
Of 26 potential peaks: 18 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 44 potential peaks
Of 44 potential peaks: 31 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 49 potential peaks
Of 49 potential peaks: 39 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 39 new sources
Median coadd sky for g : -7.83939e-05
Median coadd sky for r : -8.070638e-05
Median coadd sky for z : -5.0598857e-05
Stage srcs : Wall: 0.53 s, CPU: 0.50 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234744 MB
Stage srcs finished: 2020-08-05T19:40:59.391467
Resources for stage srcs : 0.064 s worker CPU, 0.064 s worker Wall, Wall: 0.533 s, Cores in use: 1.07, Total efficiency (on 16 cores): 6.7 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T19:40:59.414962
Blob 1 of 22, id: 2, sources: 12, size: 115x156, npix 9169, brick X: 68,183, Y: 21,177, one pixel: 140 21
Blob 2 of 22, id: 16, sources: 3, size: 28x52, npix 891, brick X: 146,174, Y: 186,238, one pixel: 158 186
Blob 3 of 22, id: 10, sources: 3, size: 36x42, npix 818, brick X: 0,36, Y: 137,179, one pixel: 15 137
Blob 4 of 22, id: 11, sources: 2, size: 32x36, npix 817, brick X: 213,245, Y: 143,179, one pixel: 227 143
Blob 5 of 22, id: 9, sources: 1, size: 34x34, npix 760, brick X: 27,61, Y: 95,129, one pixel: 42 95
Blob 6 of 22, id: 3, sources: 1, size: 29x37, npix 721, brick X: 214,243, Y: 38,75, one pixel: 225 38
Blob 7 of 22, id: 0, sources: 2, size: 29x34, npix 685, brick X: 0,29, Y: 0,34, one pixel: 0 0
Blob 8 of 22, id: 12, sources: 2, size: 35x35, npix 672, brick X: 147,182, Y: 147,182, one pixel: 156 147
Blob 9 of 22, id: 4, sources: 1, size: 24x26, npix 391, brick X: 171,195, Y: 51,77, one pixel: 180 51
Blob 10 of 22, id: 15, sources: 1, size: 29x22, npix 378, brick X: 96,125, Y: 179,201, one pixel: 112 179
Blob 11 of 22, id: 8, sources: 2, size: 15x33, npix 322, brick X: 230,245, Y: 93,126, one pixel: 238 93
Blob 12 of 22, id: 1, sources: 1, size: 21x23, npix 300, brick X: 62,83, Y: 2,25, one pixel: 70 2
Blob 13 of 22, id: 6, sources: 1, size: 21x22, npix 299, brick X: 212,233, Y: 72,94, one pixel: 221 72
Blob 14 of 22, id: 5, sources: 1, size: 23x22, npix 294, brick X: 12,35, Y: 60,82, one pixel: 21 60
Blob 15 of 22, id: 21, sources: 1, size: 22x21, npix 289, brick X: 194,216, Y: 219,240, one pixel: 203 219
Blob 16 of 22, id: 7, sources: 1, size: 22x21, npix 272, brick X: 78,100, Y: 85,106, one pixel: 87 85
Blob 17 of 22, id: 17, sources: 1, size: 21x22, npix 272, brick X: 206,227, Y: 191,213, one pixel: 215 191
Blob 15 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.1477 MB
Blob 18 of 22, id: 13, sources: 1, size: 21x21, npix 251, brick X: 50,71, Y: 154,175, one pixel: 59 154
Blob 16 finished, total: Wall: 0.40 s, CPU: 0.40 s, VmPeak: 969 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146216 MB
Blob 19 of 22, id: 18, sources: 1, size: 20x19, npix 227, brick X: 20,40, Y: 193,212, one pixel: 28 193
Measuring 1 iterative sources
Blob 13 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148716 MB
Blob 18 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 969 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146216 MB
Blob 14 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147932 MB
Blob 20 of 22, id: 19, sources: 1, size: 20x19, npix 227, brick X: 51,71, Y: 203,222, one pixel: 59 203
Blob 21 of 22, id: 14, sources: 1, size: 19x18, npix 189, brick X: 186,205, Y: 172,190, one pixel: 195 172
Blob 22 of 22, id: 20, sources: 1, size: 18x18, npix 171, brick X: 6,24, Y: 207,225, one pixel: 14 207
Blob 12 finished, total: Wall: 0.79 s, CPU: 0.79 s, VmPeak: 974 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148052 MB
Blob 9 finished, total: Wall: 0.95 s, CPU: 0.95 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148336 MB
Blob 11 finished, total: Wall: 0.96 s, CPU: 0.96 s, VmPeak: 936 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148488 MB
Blob 19 finished, total: Wall: 0.25 s, CPU: 0.24 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.1491 MB
Blob 17 finished, total: Wall: 0.68 s, CPU: 0.68 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147916 MB
Blob 5 finished, total: Wall: 1.07 s, CPU: 1.06 s, VmPeak: 969 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148436 MB
Blob 7 finished, total: Wall: 1.09 s, CPU: 1.08 s, VmPeak: 974 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.14676 MB
Blob 22 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 974 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148344 MB
Blob 10 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148148 MB
Blob 21 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148356 MB
Blob 8 finished, total: Wall: 1.39 s, CPU: 1.39 s, VmPeak: 970 MB, VmSize: 732 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146528 MB
Blob 20 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 969 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.1481 MB
Blob 3 finished, total: Wall: 1.82 s, CPU: 1.81 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.147988 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.09 s, CPU: 2.09 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148624 MB
Blob 4 finished, total: Wall: 2.51 s, CPU: 2.51 s, VmPeak: 940 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14892 MB
Blob 6 finished, total: Wall: 2.53 s, CPU: 2.52 s, VmPeak: 971 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14834 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.53011, ee1=-0.124939, ee2=0.748029
Measuring 8 iterative sources
Blob 1 finished, total: Wall: 13.10 s, CPU: 13.09 s, VmPeak: 969 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151356 MB
Old catalog: 41
New catalog: 48
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/blobs-custom-029432m24747.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/all-models-custom-029432m24747.fits
Stage fitblobs : Wall: 13.70 s, CPU: 0.44 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234908 MB
Stage fitblobs finished: 2020-08-05T19:41:13.111182
Resources for stage fitblobs : 34.614 s worker CPU, 34.689 s worker Wall, Wall: 13.698 s, Cores in use: 2.56, Total efficiency (on 16 cores): 16.0 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T19:41:13.137860
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-resid.jpg
Stage coadds : Wall: 2.82 s, CPU: 1.48 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235424 MB
Stage coadds finished: 2020-08-05T19:41:15.957776
Resources for stage coadds : 7.445 s worker CPU, 12.549 s worker Wall, Wall: 2.821 s, Cores in use: 3.16, Total efficiency (on 16 cores): 19.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-05T19:41:15.975923
Cut to 1 unWISE tiles
Reading WISE tile 0297m243 band 2
Reading WISE tile 0297m243 band 1
Reading WISE tile 0297m243 band 4
Reading WISE tile 0297m243 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 955 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.198148 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 936 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.208128 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 950 MB, VmSize: 809 MB, VmRSS: 148 MB, VmData: 174 MB, maxrss: 0.21138 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 960 MB, VmSize: 809 MB, VmRSS: 149 MB, VmData: 174 MB, maxrss: 0.213272 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 3.36 s, CPU: 1.56 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 231 MB, VmData: 256 MB, maxrss: 0.236128 MB
Stage wise_forced finished: 2020-08-05T19:41:19.331653
Resources for stage wise_forced : 3.328 s worker CPU, 5.875 s worker Wall, Wall: 3.357 s, Cores in use: 1.46, Total efficiency (on 16 cores): 9.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T19:41:19.345845
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/tractor-i/cus/tractor-custom-029432m24747.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/tractor/cus/tractor-custom-029432m24747.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/tractor/cus/brick-custom-029432m24747.sha256sum
Stage writecat : Wall: 0.81 s, CPU: 0.66 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 232 MB, VmData: 256 MB, maxrss: 0.369132 MB
Stage writecat finished: 2020-08-05T19:41:20.151535
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.807 s, Cores in use: 0.82, Total efficiency (on 16 cores): 5.1 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-writecat.p
All done: 59.965 s worker CPU, 651.767 s worker Wall, Wall: 106.095 s, Cores in use: 0.67, Total efficiency (on 16 cores): 4.2 %
Finished galaxy PGC786523 in 1.854 minutes.
Started working on galaxy PGC786523 at Wed Aug  5 20:20:50 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.4323355 -24.747551 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:20:53.283824
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.4323355', '-24.747551', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.4323355 -24.747551 --width 245 --height 245 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.4323355 -24.747551
Starting process 5480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 5481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 5483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 5485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 5487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 5489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 5490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 5492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 5494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 5496 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 5498 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 5502 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5503 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5504 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5505 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5506 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5507 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 5508 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 5509 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 5510 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 5511 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 5512 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 5514 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 5515 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 5516 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 5517 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 5518 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 5519 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 5520 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 5522 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 5523 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 5524 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:20:55.369398
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 23 CCDs:
  c4d_151106_033655_ooi_r_ls9-N14 r expnum 490282 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57332.149 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20151105/c4d_151106_033655_ooi_r_ls9.fits.fz
  c4d_141211_042510_ooi_z_ls9-N14 z expnum 386330 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57002.183 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20141210/c4d_141211_042510_ooi_z_ls9.fits.fz
  c4d_151108_032624_ooi_g_ls9-N14 g expnum 491064 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57334.142 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_032624_ooi_g_ls9.fits.fz
  c4d_171224_032533_ooi_z_ls9-N31 z expnum 706812 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58111.143 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171223/c4d_171224_032533_ooi_z_ls9.fits.fz
  c4d_171123_052419_ooi_r_ls9-N31 r expnum 698859 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 58080.225 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171122/c4d_171123_052419_ooi_r_ls9.fits.fz
  c4d_171123_052816_ooi_g_ls9-N31 g expnum 698861 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58080.228 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171122/c4d_171123_052816_ooi_g_ls9.fits.fz
  c4d_171011_075322_ooi_z_ls9-S20 z expnum 685848 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 58037.329 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_075322_ooi_z_ls9.fits.fz
  c4d_161203_015450_ooi_r_ls9-S20 r expnum 598959 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 57725.078 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2/CP20161202/c4d_161203_015450_ooi_r_ls9.fits.fz
  c4d_161203_020048_ooi_g_ls9-S20 g expnum 598962 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 57725.082 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2/CP20161202/c4d_161203_020048_ooi_g_ls9.fits.fz
  c4d_150114_020403_ooi_r_ls9-N12 r expnum 397730 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57036.085 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20150113/c4d_150114_020403_ooi_r_ls9.fits.fz
  c4d_151106_033256_ooi_g_ls9-N12 g expnum 490280 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57332.146 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20151105/c4d_151106_033256_ooi_g_ls9.fits.fz
  c4d_141231_032245_ooi_z_ls9-N12 z expnum 393521 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57022.139 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20141230/c4d_141231_032245_ooi_z_ls9.fits.fz
  c4d_180116_015511_ooi_g_ls9-S20 g expnum 712475 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 58134.080 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180115/c4d_180116_015511_ooi_g_ls9.fits.fz
  c4d_180116_015112_ooi_r_ls9-S20 r expnum 712473 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 58134.077 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180115/c4d_180116_015112_ooi_r_ls9.fits.fz
  c4d_180127_010014_ooi_z_ls9-S20 z expnum 716058 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58145.042 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180126/c4d_180127_010014_ooi_z_ls9.fits.fz
  c4d_161203_015252_ooi_z_ls9-S24 z expnum 598958 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57725.077 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161202/c4d_161203_015252_ooi_z_ls9.fits.fz
  c4d_161109_062341_ooi_g_ls9-S24 g expnum 591515 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57701.265 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161108/c4d_161109_062341_ooi_g_ls9.fits.fz
  c4d_161109_062142_ooi_r_ls9-S24 r expnum 591514 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57701.263 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161108/c4d_161109_062142_ooi_r_ls9.fits.fz
  c4d_150913_084328_ooi_r_ls9-S11 r expnum 474404 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57278.362 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_084328_ooi_r_ls9.fits.fz
  c4d_150913_084518_ooi_g_ls9-S11 g expnum 474405 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57278.363 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_084518_ooi_g_ls9.fits.fz
  c4d_150817_101222_ooi_z_ls9-S11 z expnum 464605 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57251.424 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150816/c4d_150817_101222_ooi_z_ls9.fits.fz
  c4d_151023_061100_ooi_z_ls9-S27 z expnum 486785 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57318.256 object DES survey hex 292-258 tiling 5 
    decam/CP/V4.8.2a/CP20151022/c4d_151023_061100_ooi_z_ls9.fits.fz
  c4d_151108_034804_ooi_r_ls9-S27 r expnum 491074 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57334.157 object DES survey hex 292-258 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_034804_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T034544_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95638ac-g-20150913T084254_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151023T060840_oi[S27,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9504be0-r-20161203T015230_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151106T033038_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9502cdc-z-20161203T015031_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95048f6-g-20161203T015828_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T075322_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141231T032026_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T052419_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150114T020143_oi[N12,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T032404_oi[N14,noinherit][2046,4094][real]: DES sur
Clipping 2 pixels with anomalously large oow values: max 0.0487011 vs median 0.0372313
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95589f7-r-20150913T084056_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501365-r-20161109T061921_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180116T015511_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010014_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9567936-z-20150817T101004_oi[S11,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9500ef2-g-20161109T062119_oi[S24,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T052816_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9554133-z-20141211T042249_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180116T015112_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524f0b-z-20171224T032533_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9563c11-r-20151106T033434_oi[N14,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 99.15 s, CPU: 2.37 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 190 MB, VmData: 222 MB, maxrss: 0.1947 MB
Stage tims finished: 2020-08-05T20:22:34.519635
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151023T060840_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151106T033038_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95048f6-g-20161203T015828_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T052419_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9567936-z-20150817T101004_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010014_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501365-r-20161109T061921_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9554133-z-20141211T042249_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T052816_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9500ef2-g-20161109T062119_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180116T015112_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9563c11-r-20151106T033434_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180116T015511_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524f0b-z-20171224T032533_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 16.121 s worker CPU, 1149.059 s worker Wall, Wall: 99.152 s, Cores in use: 0.19, Total efficiency (on 32 cores): 0.6 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9504be0-r-20161203T015230_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95638ac-g-20150913T084254_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9502cdc-z-20161203T015031_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141231T032026_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95589f7-r-20150913T084056_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T034544_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150114T020143_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T20:22:34.564108
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08650.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/reference-custom-029432m24747.fits
Stage refs : Wall: 9.57 s, CPU: 1.22 s, VmPeak: 1045 MB, VmSize: 1025 MB, VmRSS: 202 MB, VmData: 233 MB, maxrss: 0.207024 MB
Stage refs finished: 2020-08-05T20:22:44.135831
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 9.574 s, Cores in use: 0.13, Total efficiency (on 32 cores): 0.4 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-refs.p
Running stage outliers
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T075322_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T032404_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage outliers at 2020-08-05T20:22:44.595130
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outlier-mask-custom-029432m24747.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-pre-custom-029432m24747.jpg
Image c4d_171123_052816_ooi_g_ls9-N31 g : masking 273 positive outlier pixels and 0 negative outlier pixels
Image c4d_151106_033256_ooi_g_ls9-N12 g : masking 0 positive outlier pixels and 103 negative outlier pixels
Image c4d_180116_015511_ooi_g_ls9-S20 g : masking 266 positive outlier pixels and 0 negative outlier pixels
Image c4d_161109_062341_ooi_g_ls9-S24 g : masking 311 positive outlier pixels and 0 negative outlier pixels
Image c4d_141231_032245_ooi_z_ls9-N12 z : masking 646 positive outlier pixels and 0 negative outlier pixels
Image c4d_180127_010014_ooi_z_ls9-S20 z : masking 282 positive outlier pixels and 0 negative outlier pixels
Image c4d_150817_101222_ooi_z_ls9-S11 z : masking 210 positive outlier pixels and 46 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outlier-mask-custom-029432m24747.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-post-custom-029432m24747.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-masked-pos-custom-029432m24747.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/outliers-masked-neg-custom-029432m24747.jpg
Stage outliers : Wall: 1.97 s, CPU: 1.73 s, VmPeak: 1045 MB, VmSize: 1035 MB, VmRSS: 225 MB, VmData: 254 MB, maxrss: 0.230412 MB
Stage outliers finished: 2020-08-05T20:22:46.561424
Resources for stage outliers : 1.696 s worker CPU, 1.911 s worker Wall, Wall: 1.969 s, Cores in use: 1.74, Total efficiency (on 32 cores): 5.4 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:22:46.953732
Stage halos : Wall: 0.23 s, CPU: 0.22 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 225 MB, VmData: 254 MB, maxrss: 0.230844 MB
Stage halos finished: 2020-08-05T20:22:47.181208
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.230 s, Cores in use: 0.99, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:22:47.667636
PSF sigmas in coadd pixels: ['1.82', '1.65', '2.27', '1.79', '2.23', '1.73', '1.85']
Using average PSF sigma 1.904492084096859
Gaussian PSF norm 0.14812074785159954 vs pixelized 0.129206
average tim pixel scale / coadd scale: 1.0010407354114954
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.03', '1.88', '2.08', '1.73', '2.42', '1.79', '1.95', '1.89']
Using average PSF sigma 1.9698798148627572
Gaussian PSF norm 0.14320406232170663 vs pixelized 0.13773586
average tim pixel scale / coadd scale: 1.0010598234935373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.58', '1.95', '1.61', '1.92', '1.74', '1.85', '1.83']
Using average PSF sigma 1.804289918452766
Gaussian PSF norm 0.15634670952203908 vs pixelized 0.1378717
average tim pixel scale / coadd scale: 1.0010128852356766
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.32 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.2341 MB
Stage fit_on_coadds finished: 2020-08-05T20:22:48.015285
Resources for stage fit_on_coadds : 0.344 s worker CPU, 0.345 s worker Wall, Wall: 0.350 s, Cores in use: 1.90, Total efficiency (on 32 cores): 5.9 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:22:48.031948
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 19 potential peaks
Of 19 potential peaks: 5 in veto map, 2 cut by saddle test, 0 cut by aper test, 12 kept
SED z : 12 new peaks
Found 37 potential peaks
Of 37 potential peaks: 15 in veto map, 5 cut by saddle test, 0 cut by aper test, 17 kept
SED r : 17 new peaks
Found 26 potential peaks
Of 26 potential peaks: 18 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 44 potential peaks
Of 44 potential peaks: 31 in veto map, 9 cut by saddle test, 0 cut by aper test, 4 kept
SED Flat : 4 new peaks
Found 49 potential peaks
Of 49 potential peaks: 39 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept
SED Red : 3 new peaks
Adding 39 new sources
Median coadd sky for g : -7.839396e-05
Median coadd sky for r : -8.07064e-05
Median coadd sky for z : -5.059879e-05
Stage srcs : Wall: 1.21 s, CPU: 1.15 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234588 MB
Stage srcs finished: 2020-08-05T20:22:49.244446
Resources for stage srcs : 0.067 s worker CPU, 0.067 s worker Wall, Wall: 1.215 s, Cores in use: 1.01, Total efficiency (on 32 cores): 3.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:22:49.325417
Blob 1 of 22, id: 2, sources: 12, size: 115x156, npix 9169, brick X: 68,183, Y: 21,177, one pixel: 140 21
Blob 2 of 22, id: 16, sources: 3, size: 28x52, npix 891, brick X: 146,174, Y: 186,238, one pixel: 158 186
Blob 3 of 22, id: 10, sources: 3, size: 36x42, npix 818, brick X: 0,36, Y: 137,179, one pixel: 15 137
Blob 4 of 22, id: 11, sources: 2, size: 32x36, npix 817, brick X: 213,245, Y: 143,179, one pixel: 227 143
Blob 5 of 22, id: 9, sources: 1, size: 34x34, npix 760, brick X: 27,61, Y: 95,129, one pixel: 42 95
Blob 6 of 22, id: 3, sources: 1, size: 29x37, npix 721, brick X: 214,243, Y: 38,75, one pixel: 225 38
Blob 7 of 22, id: 0, sources: 2, size: 29x34, npix 685, brick X: 0,29, Y: 0,34, one pixel: 0 0
Blob 8 of 22, id: 12, sources: 2, size: 35x35, npix 672, brick X: 147,182, Y: 147,182, one pixel: 156 147
Blob 9 of 22, id: 4, sources: 1, size: 24x26, npix 391, brick X: 171,195, Y: 51,77, one pixel: 180 51
Blob 10 of 22, id: 15, sources: 1, size: 29x22, npix 378, brick X: 96,125, Y: 179,201, one pixel: 112 179
Blob 11 of 22, id: 8, sources: 2, size: 15x33, npix 322, brick X: 230,245, Y: 93,126, one pixel: 238 93
Blob 12 of 22, id: 1, sources: 1, size: 21x23, npix 300, brick X: 62,83, Y: 2,25, one pixel: 70 2
Blob 13 of 22, id: 6, sources: 1, size: 21x22, npix 299, brick X: 212,233, Y: 72,94, one pixel: 221 72
Blob 14 of 22, id: 5, sources: 1, size: 23x22, npix 294, brick X: 12,35, Y: 60,82, one pixel: 21 60
Blob 15 of 22, id: 21, sources: 1, size: 22x21, npix 289, brick X: 194,216, Y: 219,240, one pixel: 203 219
Blob 16 of 22, id: 7, sources: 1, size: 22x21, npix 272, brick X: 78,100, Y: 85,106, one pixel: 87 85
Blob 17 of 22, id: 17, sources: 1, size: 21x22, npix 272, brick X: 206,227, Y: 191,213, one pixel: 215 191
Blob 18 of 22, id: 13, sources: 1, size: 21x21, npix 251, brick X: 50,71, Y: 154,175, one pixel: 59 154
Blob 19 of 22, id: 18, sources: 1, size: 20x19, npix 227, brick X: 20,40, Y: 193,212, one pixel: 28 193
Blob 20 of 22, id: 19, sources: 1, size: 20x19, npix 227, brick X: 51,71, Y: 203,222, one pixel: 59 203
Blob 21 of 22, id: 14, sources: 1, size: 19x18, npix 189, brick X: 186,205, Y: 172,190, one pixel: 195 172
Blob 22 of 22, id: 20, sources: 1, size: 18x18, npix 171, brick X: 6,24, Y: 207,225, one pixel: 14 207
Blob 22 finished, total: Wall: 0.24 s, CPU: 0.24 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148024 MB
Blob 16 finished, total: Wall: 0.28 s, CPU: 0.26 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093416 MB
Blob 19 finished, total: Wall: 0.28 s, CPU: 0.25 s, VmPeak: 935 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14854 MB
Blob 18 finished, total: Wall: 0.31 s, CPU: 0.29 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 142 MB, maxrss: 0.096472 MB
Blob 15 finished, total: Wall: 0.35 s, CPU: 0.32 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147872 MB
Measuring 1 iterative sources
Blob 17 finished, total: Wall: 0.49 s, CPU: 0.48 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147868 MB
Blob 14 finished, total: Wall: 0.62 s, CPU: 0.60 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147492 MB
Blob 9 finished, total: Wall: 0.65 s, CPU: 0.63 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147576 MB
Blob 21 finished, total: Wall: 0.66 s, CPU: 0.63 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147844 MB
Blob 5 finished, total: Wall: 0.69 s, CPU: 0.67 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.09482 MB
Blob 12 finished, total: Wall: 0.70 s, CPU: 0.67 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14772 MB
Blob 13 finished, total: Wall: 0.74 s, CPU: 0.71 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.095824 MB
Blob 10 finished, total: Wall: 0.75 s, CPU: 0.73 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148368 MB
Blob 20 finished, total: Wall: 0.74 s, CPU: 0.71 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094624 MB
Blob 7 finished, total: Wall: 0.85 s, CPU: 0.82 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092768 MB
Blob 11 finished, total: Wall: 0.87 s, CPU: 0.85 s, VmPeak: 936 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.1482 MB
Blob 8 finished, total: Wall: 1.05 s, CPU: 1.03 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094144 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.49 s, CPU: 1.47 s, VmPeak: 959 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147688 MB
Blob 2 finished, total: Wall: 1.91 s, CPU: 1.89 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093964 MB
Blob 6 finished, total: Wall: 2.13 s, CPU: 2.11 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148356 MB
Blob 4 finished, total: Wall: 2.30 s, CPU: 2.28 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148552 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.53011, ee1=-0.124939, ee2=0.748028
Measuring 8 iterative sources
Blob 1 finished, total: Wall: 14.40 s, CPU: 14.39 s, VmPeak: 684 MB, VmSize: 684 MB, VmRSS: 110 MB, VmData: 155 MB, maxrss: 0.112896 MB
Old catalog: 41
New catalog: 48
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/blobs-custom-029432m24747.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/metrics/cus/all-models-custom-029432m24747.fits
Stage fitblobs : Wall: 15.56 s, CPU: 1.13 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234752 MB
Stage fitblobs finished: 2020-08-05T20:23:04.886518
Resources for stage fitblobs : 32.345 s worker CPU, 33.685 s worker Wall, Wall: 15.563 s, Cores in use: 2.15, Total efficiency (on 32 cores): 6.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:23:04.909588
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-resid.jpg
Stage coadds : Wall: 3.46 s, CPU: 0.66 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235268 MB
Stage coadds finished: 2020-08-05T20:23:08.372100
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 34.013 s worker CPU, 57.361 s worker Wall, Wall: 3.465 s, Cores in use: 10.01, Total efficiency (on 32 cores): 31.3 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:23:08.484638
Cut to 1 unWISE tiles
Reading WISE tile 0297m243 band 2
Reading WISE tile 0297m243 band 1
Reading WISE tile 0297m243 band 3
Reading WISE tile 0297m243 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 955 MB, VmSize: 813 MB, VmRSS: 152 MB, VmData: 178 MB, maxrss: 0.195808 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 940 MB, VmSize: 810 MB, VmRSS: 150 MB, VmData: 180 MB, maxrss: 0.205804 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 935 MB, VmSize: 806 MB, VmRSS: 145 MB, VmData: 171 MB, maxrss: 0.208252 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 812 MB, VmSize: 812 MB, VmRSS: 153 MB, VmData: 180 MB, maxrss: 0.210492 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.51 s, CPU: 1.59 s, VmPeak: 1045 MB, VmSize: 1036 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235972 MB
Stage wise_forced finished: 2020-08-05T20:23:12.994641
Resources for stage wise_forced : 3.341 s worker CPU, 6.075 s worker Wall, Wall: 4.512 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:23:13.013972
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/tractor-i/cus/tractor-custom-029432m24747.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/tractor/cus/tractor-custom-029432m24747.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/tractor/cus/brick-custom-029432m24747.sha256sum
Stage writecat : Wall: 1.80 s, CPU: 1.01 s, VmPeak: 1168 MB, VmSize: 1040 MB, VmRSS: 232 MB, VmData: 256 MB, maxrss: 0.368976 MB
Stage writecat finished: 2020-08-05T20:23:14.815308
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 1.804 s, Cores in use: 0.56, Total efficiency (on 32 cores): 1.8 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC786523/PGC786523-largegalaxy-writecat.p
All done: 87.933 s worker CPU, 1248.511 s worker Wall, Wall: 139.475 s, Cores in use: 0.71, Total efficiency (on 32 cores): 2.2 %
Finished galaxy PGC786523 in 2.413 minutes.
Started working on galaxy PGC786523 at Mon Aug 10 08:19:59 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.43253431815562 -24.747742327620056 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-10T08:20:00.301551
legacypipe git version: DR9.5.11-watershed-6-g6a2880fc
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.43253431815562', '-24.747742327620056', '--width', '245', '--height', '245', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.43253431815562 -24.747742327620056 --width 245 --height 245 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 29.43253431815562 -24.747742327620056
Starting process 33457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB
Starting process 33458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 33460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 33461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 33463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 33464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 33468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 33469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-10T08:20:00.841596
Keeping 23 CCDs:
  c4d_151106_033655_ooi_r_ls9-N14 r expnum 490282 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 57332.149 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20151105/c4d_151106_033655_ooi_r_ls9.fits.fz
  c4d_141211_042510_ooi_z_ls9-N14 z expnum 386330 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57002.183 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20141210/c4d_141211_042510_ooi_z_ls9.fits.fz
  c4d_151108_032624_ooi_g_ls9-N14 g expnum 491064 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57334.142 object DES survey hex 311-247 tiling 2 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_032624_ooi_g_ls9.fits.fz
  c4d_171224_032533_ooi_z_ls9-N31 z expnum 706812 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58111.143 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171223/c4d_171224_032533_ooi_z_ls9.fits.fz
  c4d_171123_052419_ooi_r_ls9-N31 r expnum 698859 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 58080.225 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171122/c4d_171123_052419_ooi_r_ls9.fits.fz
  c4d_171123_052816_ooi_g_ls9-N31 g expnum 698861 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 58080.228 object DES survey hex 295-237 tiling 8 
    decam/CP/V4.8.2a/CP20171122/c4d_171123_052816_ooi_g_ls9.fits.fz
  c4d_171011_075322_ooi_z_ls9-S20 z expnum 685848 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 58037.329 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2a/CP20171010/c4d_171011_075322_ooi_z_ls9.fits.fz
  c4d_161203_015450_ooi_r_ls9-S20 r expnum 598959 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 57725.078 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2/CP20161202/c4d_161203_015450_ooi_r_ls9.fits.fz
  c4d_161203_020048_ooi_g_ls9-S20 g expnum 598962 exptime 90.0 propid 2012B-0001 seeing 1.40 MJD 57725.082 object DES survey hex 292-258 tiling 7 
    decam/CP/V4.8.2/CP20161202/c4d_161203_020048_ooi_g_ls9.fits.fz
  c4d_150114_020403_ooi_r_ls9-N12 r expnum 397730 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 57036.085 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20150113/c4d_150114_020403_ooi_r_ls9.fits.fz
  c4d_151106_033256_ooi_g_ls9-N12 g expnum 490280 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57332.146 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20151105/c4d_151106_033256_ooi_g_ls9.fits.fz
  c4d_141231_032245_ooi_z_ls9-N12 z expnum 393521 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57022.139 object DES survey hex 295-237 tiling 3 
    decam/CP/V4.8.2a/CP20141230/c4d_141231_032245_ooi_z_ls9.fits.fz
  c4d_180116_015511_ooi_g_ls9-S20 g expnum 712475 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 58134.080 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180115/c4d_180116_015511_ooi_g_ls9.fits.fz
  c4d_180116_015112_ooi_r_ls9-S20 r expnum 712473 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 58134.077 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180115/c4d_180116_015112_ooi_r_ls9.fits.fz
  c4d_180127_010014_ooi_z_ls9-S20 z expnum 716058 exptime 90.0 propid 2012B-0001 seeing 1.18 MJD 58145.042 object DES survey hex 292-258 tiling 9 
    decam/CP/V4.8.2a/CP20180126/c4d_180127_010014_ooi_z_ls9.fits.fz
  c4d_161203_015252_ooi_z_ls9-S24 z expnum 598958 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57725.077 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161202/c4d_161203_015252_ooi_z_ls9.fits.fz
  c4d_161109_062341_ooi_g_ls9-S24 g expnum 591515 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57701.265 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161108/c4d_161109_062341_ooi_g_ls9.fits.fz
  c4d_161109_062142_ooi_r_ls9-S24 r expnum 591514 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57701.263 object DES survey hex 292-258 tiling 6 
    decam/CP/V4.8.2/CP20161108/c4d_161109_062142_ooi_r_ls9.fits.fz
  c4d_150913_084328_ooi_r_ls9-S11 r expnum 474404 exptime 90.0 propid 2012B-0001 seeing 1.20 MJD 57278.362 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_084328_ooi_r_ls9.fits.fz
  c4d_150913_084518_ooi_g_ls9-S11 g expnum 474405 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57278.363 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150912/c4d_150913_084518_ooi_g_ls9.fits.fz
  c4d_150817_101222_ooi_z_ls9-S11 z expnum 464605 exptime 90.0 propid 2012B-0001 seeing 1.14 MJD 57251.424 object DES survey hex 292-258 tiling 4 
    decam/CP/V4.8.2a/CP20150816/c4d_150817_101222_ooi_z_ls9.fits.fz
  c4d_151023_061100_ooi_z_ls9-S27 z expnum 486785 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57318.256 object DES survey hex 292-258 tiling 5 
    decam/CP/V4.8.2a/CP20151022/c4d_151023_061100_ooi_z_ls9.fits.fz
  c4d_151108_034804_ooi_r_ls9-S27 r expnum 491074 exptime 90.0 propid 2012B-0001 seeing 1.16 MJD 57334.157 object DES survey hex 292-258 tiling 5 
    decam/CP/V4.8.2a/CP20151107/c4d_151108_034804_ooi_r_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T075322_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9504be0-r-20161203T015230_oi[S20,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9554133-z-20141211T042249_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T052419_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T052816_oi[N31,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9563c11-r-20151106T033434_oi[N14,noinherit][2046,4094][real]: DES sur
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T032404_oi[N14,noinherit][2046,4094][real]: DES sur
Clipping 2 pixels with anomalously large oow values: max 0.0487011 vs median 0.0372313
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524f0b-z-20171224T032533_oi[N31,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95048f6-g-20161203T015828_oi[S20,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150114T020143_oi[N12,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180116T015511_oi[S20,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010014_oi[S20,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180116T015112_oi[S20,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141231T032026_oi[N12,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9502cdc-z-20161203T015031_oi[S24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151106T033038_oi[N12,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9500ef2-g-20161109T062119_oi[S24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501365-r-20161109T061921_oi[S24,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151023T060840_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95638ac-g-20150913T084254_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95589f7-r-20150913T084056_oi[S11,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T034544_oi[S27,noinherit][2046,4094][real]: DES sur
Warning: splinesky does not have sky-template version/run/scale values
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9567936-z-20150817T101004_oi[S11,noinherit][2046,4094][real]: DES sur
Stage tims : Wall: 122.01 s, CPU: 1.03 s, VmPeak: 1008 MB, VmSize: 1008 MB, VmRSS: 188 MB, VmData: 222 MB, maxrss: 0.19286 MB
Stage tims finished: 2020-08-10T08:22:02.854148
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9504be0-r-20161203T015230_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95048f6-g-20161203T015828_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9500ef2-g-20161109T062119_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_951fbc0-z-20171011T075322_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9551b36-r-20150114T020143_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9501365-r-20161109T061921_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9524f0b-z-20171224T032533_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9502cdc-z-20161203T015031_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9560459-z-20151023T060840_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9554133-z-20141211T042249_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_952946a-r-20180116T015112_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95638ac-g-20150913T084254_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95282f4-g-20171123T052816_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9525b6d-z-20180127T010014_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95589f7-r-20150913T084056_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9563c11-r-20151106T033434_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95297f5-g-20180116T015511_oi[S20,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Resources for stage tims : 9.110 s worker CPU, 720.620 s worker Wall, Wall: 122.014 s, Cores in use: 0.08, Total efficiency (on 8 cores): 1.0 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9527f3c-r-20171123T052419_oi[N31,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9559743-z-20141231T032026_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95645c8-r-20151108T034544_oi[S27,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151108T032404_oi[N14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_958078a-g-20151106T033038_oi[N12,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_9567936-z-20150817T101004_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card]
Running stage refs at 2020-08-10T08:22:03.271113
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08650.fits
Matched 1 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/reference-custom-029432m24747.fits
Stage refs : Wall: 9.44 s, CPU: 1.45 s, VmPeak: 1039 MB, VmSize: 1019 MB, VmRSS: 200 MB, VmData: 233 MB, maxrss: 0.204992 MB
Stage refs finished: 2020-08-10T08:22:12.715926
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 9.446 s, Cores in use: 0.15, Total efficiency (on 8 cores): 1.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-10T08:22:13.142884
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/outlier-mask-custom-029432m24747.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/outliers-pre-custom-029432m24747.jpg
Image c4d_171123_052816_ooi_g_ls9-N31 g : masking 276 positive outlier pixels and 0 negative outlier pixels
Image c4d_161109_062341_ooi_g_ls9-S24 g : masking 418 positive outlier pixels and 0 negative outlier pixels
Image c4d_180116_015511_ooi_g_ls9-S20 g : masking 285 positive outlier pixels and 0 negative outlier pixels
Image c4d_141231_032245_ooi_z_ls9-N12 z : masking 646 positive outlier pixels and 0 negative outlier pixels
Image c4d_180127_010014_ooi_z_ls9-S20 z : masking 279 positive outlier pixels and 0 negative outlier pixels
Image c4d_150817_101222_ooi_z_ls9-S11 z : masking 223 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/outlier-mask-custom-029432m24747.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/outliers-post-custom-029432m24747.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/outliers-masked-pos-custom-029432m24747.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/outliers-masked-neg-custom-029432m24747.jpg
Stage outliers : Wall: 1.60 s, CPU: 1.21 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 222 MB, VmData: 252 MB, maxrss: 0.2275 MB
Stage outliers finished: 2020-08-10T08:22:14.743739
Resources for stage outliers : 1.810 s worker CPU, 1.811 s worker Wall, Wall: 1.602 s, Cores in use: 1.89, Total efficiency (on 8 cores): 23.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-10T08:22:14.790500
Stage halos : Wall: 0.48 s, CPU: 0.48 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 223 MB, VmData: 253 MB, maxrss: 0.22792 MB
Stage halos finished: 2020-08-10T08:22:15.272548
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.483 s, Cores in use: 0.99, Total efficiency (on 8 cores): 12.4 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-10T08:22:15.653834
PSF sigmas in coadd pixels: ['1.82', '1.65', '2.27', '1.79', '2.23', '1.73', '1.85']
Using average PSF sigma 1.904492084096859
Gaussian PSF norm 0.14812074785159954 vs pixelized 0.12920919
average tim pixel scale / coadd scale: 1.0010407354114954
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.03', '1.88', '2.08', '1.73', '2.42', '1.79', '1.95', '1.89']
Using average PSF sigma 1.9698798148627572
Gaussian PSF norm 0.14320406232170663 vs pixelized 0.1377365
average tim pixel scale / coadd scale: 1.0010598234935373
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.95', '1.58', '1.95', '1.61', '1.92', '1.74', '1.85', '1.83']
Using average PSF sigma 1.804289918452766
Gaussian PSF norm 0.15634670952203908 vs pixelized 0.13787407
average tim pixel scale / coadd scale: 1.0010128852356766
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.33 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 224 MB, VmData: 253 MB, maxrss: 0.229808 MB
Stage fit_on_coadds finished: 2020-08-10T08:22:16.001411
Resources for stage fit_on_coadds : 0.411 s worker CPU, 0.411 s worker Wall, Wall: 0.349 s, Cores in use: 2.13, Total efficiency (on 8 cores): 26.6 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-10T08:22:16.014395
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 18 potential peaks
Of 18 potential peaks: 5 in veto map, 2 cut by saddle test, 0 cut by aper test, 11 kept
SED z : 11 new peaks
Found 38 potential peaks
Of 38 potential peaks: 15 in veto map, 5 cut by saddle test, 0 cut by aper test, 18 kept
SED r : 18 new peaks
Found 25 potential peaks
Of 25 potential peaks: 19 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 45 potential peaks
Of 45 potential peaks: 33 in veto map, 9 cut by saddle test, 0 cut by aper test, 3 kept
SED Flat : 3 new peaks
Found 48 potential peaks
Of 48 potential peaks: 39 in veto map, 7 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 37 new sources
Median coadd sky for g : -8.671657e-05
Median coadd sky for r : -9.0590926e-05
Median coadd sky for z : -1.0215783e-05
Stage srcs : Wall: 0.81 s, CPU: 0.77 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 225 MB, VmData: 253 MB, maxrss: 0.2302 MB
Stage srcs finished: 2020-08-10T08:22:16.821036
Resources for stage srcs : 0.079 s worker CPU, 0.079 s worker Wall, Wall: 0.808 s, Cores in use: 1.05, Total efficiency (on 8 cores): 13.2 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-10T08:22:16.833001
Blob 1 of 21, id: 2, sources: 11, size: 115x156, npix 9145, brick X: 70,185, Y: 24,180, one pixel: 143 24
Blob 2 of 21, id: 9, sources: 4, size: 38x43, npix 972, brick X: 0,38, Y: 139,182, one pixel: 18 139
Blob 3 of 21, id: 15, sources: 3, size: 28x52, npix 895, brick X: 148,176, Y: 189,241, one pixel: 160 189
Blob 4 of 21, id: 0, sources: 2, size: 32x37, npix 796, brick X: 0,32, Y: 0,37, one pixel: 3 0
Blob 5 of 21, id: 8, sources: 1, size: 33x34, npix 759, brick X: 30,63, Y: 98,132, one pixel: 43 98
Blob 6 of 21, id: 10, sources: 2, size: 30x35, npix 745, brick X: 215,245, Y: 146,181, one pixel: 228 146
Blob 7 of 21, id: 3, sources: 1, size: 29x36, npix 716, brick X: 216,245, Y: 41,77, one pixel: 227 41
Blob 8 of 21, id: 11, sources: 2, size: 35x36, npix 684, brick X: 149,184, Y: 149,185, one pixel: 159 149
Blob 9 of 21, id: 4, sources: 1, size: 24x26, npix 400, brick X: 173,197, Y: 54,80, one pixel: 182 54
Blob 5 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142924 MB
Blob 10 of 21, id: 14, sources: 1, size: 28x22, npix 367, brick X: 99,127, Y: 181,203, one pixel: 116 181
Blob 8 finished, total: Wall: 1.34 s, CPU: 1.34 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144928 MB
Blob 11 of 21, id: 5, sources: 1, size: 23x22, npix 294, brick X: 14,37, Y: 62,84, one pixel: 25 62
Blob 9 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142924 MB
Blob 12 of 21, id: 6, sources: 1, size: 22x22, npix 294, brick X: 214,236, Y: 75,97, one pixel: 223 75
Blob 4 finished, total: Wall: 1.82 s, CPU: 1.82 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14502 MB
Blob 13 of 21, id: 1, sources: 1, size: 21x23, npix 291, brick X: 65,86, Y: 4,27, one pixel: 73 4
Measuring 1 iterative sources
Measuring 1 iterative sources
Blob 12 finished, total: Wall: 0.61 s, CPU: 0.61 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14502 MB
Blob 14 of 21, id: 20, sources: 1, size: 22x22, npix 282, brick X: 196,218, Y: 221,243, one pixel: 206 221
Blob 10 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144928 MB
Blob 15 of 21, id: 16, sources: 1, size: 22x22, npix 273, brick X: 208,230, Y: 193,215, one pixel: 219 193
Blob 3 finished, total: Wall: 2.51 s, CPU: 2.51 s, VmPeak: 964 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145456 MB
Blob 6 finished, total: Wall: 2.51 s, CPU: 2.51 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144736 MB
Blob 16 of 21, id: 7, sources: 1, size: 21x21, npix 270, brick X: 81,102, Y: 88,109, one pixel: 89 88
Blob 17 of 21, id: 12, sources: 1, size: 21x20, npix 258, brick X: 52,73, Y: 157,177, one pixel: 61 157
Blob 11 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142924 MB
Blob 18 of 21, id: 17, sources: 1, size: 20x20, npix 229, brick X: 22,42, Y: 195,215, one pixel: 31 195
Blob 14 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144928 MB
Blob 19 of 21, id: 18, sources: 1, size: 21x20, npix 220, brick X: 53,74, Y: 205,225, one pixel: 62 205
Blob 17 finished, total: Wall: 0.29 s, CPU: 0.29 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142924 MB
Blob 20 of 21, id: 13, sources: 1, size: 19x19, npix 199, brick X: 189,208, Y: 174,193, one pixel: 197 174
Blob 16 finished, total: Wall: 0.36 s, CPU: 0.36 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144736 MB
Blob 21 of 21, id: 19, sources: 1, size: 18x17, npix 162, brick X: 8,26, Y: 210,227, one pixel: 16 210
Blob 2 finished, total: Wall: 2.92 s, CPU: 2.92 s, VmPeak: 968 MB, VmSize: 727 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144868 MB
Blob 21 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 727 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144868 MB
Blob 7 finished, total: Wall: 3.15 s, CPU: 3.14 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144656 MB
Blob 13 finished, total: Wall: 0.73 s, CPU: 0.73 s, VmPeak: 971 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.14502 MB
Blob 15 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 964 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145456 MB
Blob 18 finished, total: Wall: 0.55 s, CPU: 0.55 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144928 MB
Blob 20 finished, total: Wall: 0.46 s, CPU: 0.46 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145584 MB
Blob 19 finished, total: Wall: 0.67 s, CPU: 0.67 s, VmPeak: 968 MB, VmSize: 726 MB, VmRSS: 140 MB, VmData: 181 MB, maxrss: 0.142924 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.29491, ee1=-0.0979964, ee2=0.652493
Measuring 7 iterative sources
Blob 1 finished, total: Wall: 10.21 s, CPU: 10.20 s, VmPeak: 963 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 180 MB, maxrss: 0.146576 MB
Old catalog: 39
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/blobs-custom-029432m24747.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/metrics/cus/all-models-custom-029432m24747.fits
Stage fitblobs : Wall: 10.73 s, CPU: 0.56 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 225 MB, VmData: 253 MB, maxrss: 0.230364 MB
Stage fitblobs finished: 2020-08-10T08:22:27.566366
Resources for stage fitblobs : 33.100 s worker CPU, 33.200 s worker Wall, Wall: 10.734 s, Cores in use: 3.14, Total efficiency (on 8 cores): 39.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-10T08:22:27.577861
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-resid.jpg
Stage coadds : Wall: 1.27 s, CPU: 0.55 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 225 MB, VmData: 253 MB, maxrss: 0.23088 MB
Stage coadds finished: 2020-08-10T08:22:28.843031
Resources for stage coadds : 4.089 s worker CPU, 4.326 s worker Wall, Wall: 1.266 s, Cores in use: 3.66, Total efficiency (on 8 cores): 45.8 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-10T08:22:28.855096
Cut to 1 unWISE tiles
Reading WISE tile 0297m243 band 1
Reading WISE tile 0297m243 band 2
Reading WISE tile 0297m243 band 3
Reading WISE tile 0297m243 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 964 MB, VmSize: 806 MB, VmRSS: 148 MB, VmData: 177 MB, maxrss: 0.194856 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 963 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.211472 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 968 MB, VmSize: 803 MB, VmRSS: 146 MB, VmData: 174 MB, maxrss: 0.210396 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0297m243/unwise-0297m243-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 968 MB, VmSize: 803 MB, VmRSS: 145 MB, VmData: 174 MB, maxrss: 0.207968 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/tmp-legacysurvey-custom-029432m24747-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.43 s, CPU: 0.51 s, VmPeak: 1039 MB, VmSize: 1029 MB, VmRSS: 226 MB, VmData: 253 MB, maxrss: 0.231584 MB
Stage wise_forced finished: 2020-08-10T08:22:31.286712
Resources for stage wise_forced : 3.144 s worker CPU, 5.197 s worker Wall, Wall: 2.433 s, Cores in use: 1.50, Total efficiency (on 8 cores): 18.8 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-10T08:22:31.299637
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/coadd/cus/custom-029432m24747/legacysurvey-custom-029432m24747-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/tractor-i/cus/tractor-custom-029432m24747.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/tractor/cus/tractor-custom-029432m24747.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/tractor/cus/brick-custom-029432m24747.sha256sum
Stage writecat : Wall: 0.78 s, CPU: 0.59 s, VmPeak: 1161 MB, VmSize: 1033 MB, VmRSS: 228 MB, VmData: 253 MB, maxrss: 0.364572 MB
Stage writecat finished: 2020-08-10T08:22:32.078451
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.780 s, Cores in use: 0.76, Total efficiency (on 8 cores): 9.5 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC786523/PGC786523-largegalaxy-writecat.p
All done: 51.745 s worker CPU, 765.646 s worker Wall, Wall: 151.273 s, Cores in use: 0.39, Total efficiency (on 8 cores): 4.9 %
Finished galaxy PGC786523 in 2.558 minutes.