Started working on galaxy PGC1902495 at Wed Aug  5 20:36:21 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.13921200000004 30.405582399999997 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T20:36:23.267011
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.13921200000004', '30.405582399999997', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.13921200000004 30.405582399999997 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 276.13921200000004 30.405582399999997
Starting process 2456 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 2457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 2462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 2463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 2464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 2465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 2466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 2467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 2468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 2473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 2472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T20:36:24.019774
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 3 CCDs:
  c4d_160408_100855_ooi_z_ls9-S5 z expnum 535343 exptime 201.0 propid 2014B-0404 seeing 1.55 MJD 57486.420 object DECaLS_34662_z 
    decam/CP/V4.8.2a/CP20160407/c4d_160408_100855_ooi_z_ls9.fits.fz
  c4d_160408_091305_ooi_r_ls9-S5 r expnum 535319 exptime 250.0 propid 2014B-0404 seeing 1.64 MJD 57486.381 object DECaLS_18790_r 
    decam/CP/V4.8.2a/CP20160407/c4d_160408_091305_ooi_r_ls9.fits.fz
  c4d_160803_022806_ooi_g_ls9-S5 g expnum 558495 exptime 129.0 propid 2014B-0404 seeing 1.49 MJD 57603.101 object DECaLS_18790_g 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_022806_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S5,noinherit][2046,4094][real]: DECaLS_1
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 22.88 s, CPU: 0.98 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.175524 MB
Stage tims finished: 2020-08-05T20:36:46.898216
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 1.582 s worker CPU, 58.254 s worker Wall, Wall: 22.880 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-05T20:36:46.913183
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03234.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03105.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03106.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02978.fits
Matched 22 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/reference-custom-276139p30405.fits
Stage refs : Wall: 18.27 s, CPU: 10.97 s, VmPeak: 1132 MB, VmSize: 1126 MB, VmRSS: 291 MB, VmData: 320 MB, maxrss: 0.29782 MB
Stage refs finished: 2020-08-05T20:37:05.183209
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.272 s, Cores in use: 0.60, Total efficiency (on 16 cores): 3.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T20:37:05.197092
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outlier-mask-custom-276139p30405.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-pre-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outlier-mask-custom-276139p30405.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-post-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-masked-pos-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-masked-neg-custom-276139p30405.jpg
Stage outliers : Wall: 1.07 s, CPU: 0.72 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 299 MB, VmData: 326 MB, maxrss: 0.30632 MB
Stage outliers finished: 2020-08-05T20:37:06.262155
Resources for stage outliers : 0.225 s worker CPU, 0.288 s worker Wall, Wall: 1.066 s, Cores in use: 0.89, Total efficiency (on 16 cores): 5.5 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T20:37:06.273928
Stage halos : Wall: 0.31 s, CPU: 0.20 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 299 MB, VmData: 326 MB, maxrss: 0.306412 MB
Stage halos finished: 2020-08-05T20:37:06.587118
Resources for stage halos : 0.184 s worker CPU, 0.282 s worker Wall, Wall: 0.315 s, Cores in use: 1.21, Total efficiency (on 16 cores): 7.6 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T20:37:06.601348
PSF sigmas in coadd pixels: ['2.43']
Using average PSF sigma 2.4252081719796412
Gaussian PSF norm 0.11631776398955919 vs pixelized 0.10700808
average tim pixel scale / coadd scale: 1.0013475015276032
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66']
Using average PSF sigma 2.663857358068689
Gaussian PSF norm 0.10589710853677181 vs pixelized 0.093063876
average tim pixel scale / coadd scale: 1.0014733700401626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.51']
Using average PSF sigma 2.514509627260593
Gaussian PSF norm 0.11218680124172102 vs pixelized 0.09695696
average tim pixel scale / coadd scale: 1.0013681963505578
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.09 s, CPU: 0.06 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 301 MB, VmData: 326 MB, maxrss: 0.30788 MB
Stage fit_on_coadds finished: 2020-08-05T20:37:06.690917
Resources for stage fit_on_coadds : 0.037 s worker CPU, 0.051 s worker Wall, Wall: 0.091 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T20:37:06.701149
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 27619 potential peaks
Of 27619 potential peaks: 27610 in veto map, 3 cut by saddle test, 0 cut by aper test, 6 kept
SED z : 6 new peaks
Found 9868 potential peaks
Of 9868 potential peaks: 9853 in veto map, 4 cut by saddle test, 0 cut by aper test, 11 kept
SED r : 11 new peaks
Found 26 potential peaks
Of 26 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept
SED g : 6 new peaks
Found 179 potential peaks
Of 179 potential peaks: 175 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 167 potential peaks
Of 167 potential peaks: 163 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 23 new sources
Median coadd sky for g : 6.448198e-05
Median coadd sky for r : 0.00024275655
Median coadd sky for z : 0.00041006424
Stage srcs : Wall: 1.03 s, CPU: 0.48 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 301 MB, VmData: 326 MB, maxrss: 0.308356 MB
Stage srcs finished: 2020-08-05T20:37:07.729639
Resources for stage srcs : 0.759 s worker CPU, 0.759 s worker Wall, Wall: 1.030 s, Cores in use: 1.20, Total efficiency (on 16 cores): 7.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T20:37:07.745266
Blob 1 of 8, id: 2, sources: 38, size: 269x269, npix 52700, brick X: 0,269, Y: 0,269, one pixel: 144 0
Blob 2 of 8, id: 6, sources: 1, size: 40x40, npix 1110, brick X: 10,50, Y: 87,127, one pixel: 27 87
Blob 3 of 8, id: 4, sources: 1, size: 29x40, npix 737, brick X: 0,29, Y: 33,73, one pixel: 8 33
Blob 4 of 8, id: 5, sources: 1, size: 29x29, npix 547, brick X: 40,69, Y: 61,90, one pixel: 51 61
Blob 5 of 8, id: 0, sources: 2, size: 25x21, npix 378, brick X: 19,44, Y: 0,21, one pixel: 26 0
Blob 6 of 8, id: 7, sources: 1, size: 24x25, npix 376, brick X: 9,33, Y: 162,187, one pixel: 19 162
Blob 7 of 8, id: 3, sources: 1, size: 25x24, npix 368, brick X: 44,69, Y: 9,33, one pixel: 55 9
Blob 8 of 8, id: 1, sources: 2, size: 25x15, npix 264, brick X: 70,95, Y: 0,15, one pixel: 72 0
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14358, 30.39546), pm (-4.5, 4.4), parallax -0.062 with NanoMaggies: g=20.3, r=19.4, z=18.7
Reset brightness to NanoMaggies: g=20.5, r=19.5, z=19
Blob 8 finished, total: Wall: 0.08 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 731 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147488 MB
Blob 6 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.093976 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14831, 30.39121), pm (-6.4, -3.3), parallax 0.118 with NanoMaggies: g=17.9, r=17.3, z=17.2
Reset brightness to NanoMaggies: g=17.9, r=17.3, z=17.2
Blob 5 finished, total: Wall: 0.29 s, CPU: 0.28 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 111 MB, VmData: 164 MB, maxrss: 0.113436 MB
Measuring 2 iterative sources
Blob 7 finished, total: Wall: 0.51 s, CPU: 0.50 s, VmPeak: 693 MB, VmSize: 693 MB, VmRSS: 110 MB, VmData: 164 MB, maxrss: 0.112148 MB
Blob 3 finished, total: Wall: 0.55 s, CPU: 0.54 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 111 MB, VmData: 165 MB, maxrss: 0.113984 MB
Blob 4 finished, total: Wall: 0.67 s, CPU: 0.66 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093512 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.40 s, CPU: 1.38 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.093836 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (275.98801, 30.44140), pm (-16.3, -20.5), parallax 2.328 with NanoMaggies: g=8.76, r=7.79, z=7.33
Reset brightness to NanoMaggies: g=8.76, r=7.79, z=7.33
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15976, 30.42951), pm (-1.2, 8.9), parallax 2.461 with NanoMaggies: g=9.74, r=9.77, z=9.96
Reset brightness to NanoMaggies: g=9.74, r=9.77, z=9.96
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.08168, 30.42853), pm (-3.1, -10.6), parallax 0.776 with NanoMaggies: g=12.2, r=11.2, z=10.7
Reset brightness to NanoMaggies: g=12.2, r=11.2, z=10.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.13118, 30.39517), pm (1.5, 3.3), parallax 0.590 with NanoMaggies: g=15.6, r=15.2, z=14.6
Reset brightness to NanoMaggies: g=15.2, r=14.8, z=14.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.11913, 30.40166), pm (-0.5, -4.1), parallax 0.607 with NanoMaggies: g=15.5, r=15.1, z=15
Reset brightness to NanoMaggies: g=15.5, r=15.1, z=15
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.12673, 30.39314), pm (7.1, -1.0), parallax 0.924 with NanoMaggies: g=17.4, r=16.5, z=16.1
Reset brightness to NanoMaggies: g=17.4, r=16.5, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15099, 30.42163), pm (-6.2, -8.0), parallax 0.153 with NanoMaggies: g=17.1, r=16.8, z=16.8
Reset brightness to NanoMaggies: g=17.1, r=16.8, z=16.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.12501, 30.41167), pm (-2.9, -5.4), parallax 0.245 with NanoMaggies: g=17.7, r=17.2, z=17
Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.55488, ee1=-0.656073, ee2=0.231297
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.13890, 30.41765), pm (-0.8, -3.5), parallax 0.245 with NanoMaggies: g=(flux -1.49e+04), r=18, z=17.8
Reset brightness to NanoMaggies: g=18.6, r=18, z=17.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14081, 30.41861), pm (-1.3, -2.0), parallax 0.314 with NanoMaggies: g=18.8, r=18.1, z=17.8
Reset brightness to NanoMaggies: g=18.8, r=18.1, z=17.8
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 23.25 s, CPU: 23.24 s, VmPeak: 716 MB, VmSize: 697 MB, VmRSS: 130 MB, VmData: 168 MB, maxrss: 0.15344 MB
Old catalog: 50
New catalog: 53
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/blobs-custom-276139p30405.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/all-models-custom-276139p30405.fits
Stage fitblobs : Wall: 24.78 s, CPU: 1.39 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 303 MB, VmData: 327 MB, maxrss: 0.310276 MB
Stage fitblobs finished: 2020-08-05T20:37:32.523554
Resources for stage fitblobs : 27.045 s worker CPU, 27.441 s worker Wall, Wall: 24.780 s, Cores in use: 1.15, Total efficiency (on 16 cores): 7.2 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T20:37:32.543266
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-resid.jpg
Stage coadds : Wall: 4.26 s, CPU: 1.32 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 306 MB, VmData: 330 MB, maxrss: 0.313836 MB
Stage coadds finished: 2020-08-05T20:37:36.803284
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 17.567 s worker CPU, 26.833 s worker Wall, Wall: 4.262 s, Cores in use: 4.43, Total efficiency (on 16 cores): 27.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T20:37:36.826129
Cut to 1 unWISE tiles
Reading WISE tile 2765p302 band 1
Reading WISE tile 2765p302 band 2
Reading WISE tile 2765p302 band 3
Reading WISE tile 2765p302 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 803 MB, VmSize: 803 MB, VmRSS: 143 MB, VmData: 175 MB, maxrss: 0.185764 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 798 MB, VmSize: 798 MB, VmRSS: 137 MB, VmData: 170 MB, maxrss: 0.197652 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.21078 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 952 MB, VmSize: 803 MB, VmRSS: 143 MB, VmData: 172 MB, maxrss: 0.206712 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.71 s, CPU: 1.14 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 307 MB, VmData: 330 MB, maxrss: 0.314356 MB
Stage wise_forced finished: 2020-08-05T20:37:39.540651
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.224 s worker CPU, 4.277 s worker Wall, Wall: 2.716 s, Cores in use: 1.61, Total efficiency (on 16 cores): 10.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T20:37:39.559152
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/tractor-i/cus/tractor-custom-276139p30405.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/tractor/cus/tractor-custom-276139p30405.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/tractor/cus/brick-custom-276139p30405.sha256sum
Stage writecat : Wall: 1.17 s, CPU: 0.88 s, VmPeak: 1268 MB, VmSize: 1140 MB, VmRSS: 309 MB, VmData: 330 MB, maxrss: 0.44728 MB
Stage writecat finished: 2020-08-05T20:37:40.733204
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.175 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-writecat.p
All done: 50.626 s worker CPU, 118.188 s worker Wall, Wall: 76.737 s, Cores in use: 0.90, Total efficiency (on 16 cores): 5.6 %
Finished galaxy PGC1902495 in 1.340 minutes.
Started working on galaxy PGC1902495 at Wed Aug  5 22:01:09 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.13921200000004 30.405582399999997 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T22:01:11.559832
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.13921200000004', '30.405582399999997', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.13921200000004 30.405582399999997 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 276.13921200000004 30.405582399999997
Starting process 19457 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 19458 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 19459 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 19460 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 19461 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 19462 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 19463 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 19464 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 19465 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 19466 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 19467 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19468 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19469 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 19470 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 19471 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 19472 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 19473 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 19474 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 19475 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 19476 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 19477 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 19478 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 19479 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 19480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 19481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 19482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 19483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 19485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 19484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 19486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Starting process 19488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB
Starting process 19487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T22:01:12.246190
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 3 CCDs:
  c4d_160408_100855_ooi_z_ls9-S5 z expnum 535343 exptime 201.0 propid 2014B-0404 seeing 1.55 MJD 57486.420 object DECaLS_34662_z 
    decam/CP/V4.8.2a/CP20160407/c4d_160408_100855_ooi_z_ls9.fits.fz
  c4d_160408_091305_ooi_r_ls9-S5 r expnum 535319 exptime 250.0 propid 2014B-0404 seeing 1.64 MJD 57486.381 object DECaLS_18790_r 
    decam/CP/V4.8.2a/CP20160407/c4d_160408_091305_ooi_r_ls9.fits.fz
  c4d_160803_022806_ooi_g_ls9-S5 g expnum 558495 exptime 129.0 propid 2014B-0404 seeing 1.49 MJD 57603.101 object DECaLS_18790_g 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_022806_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S5,noinherit][2046,4094][real]: DECaLS_1
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Warning: splinesky does not have sky-template version/run/scale values
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 23.06 s, CPU: 1.13 s, VmPeak: 1010 MB, VmSize: 1010 MB, VmRSS: 171 MB, VmData: 204 MB, maxrss: 0.175448 MB
Stage tims finished: 2020-08-05T22:01:35.302973
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 1.632 s worker CPU, 60.221 s worker Wall, Wall: 23.059 s, Cores in use: 0.12, Total efficiency (on 32 cores): 0.4 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-tims.p
Running stage refs
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T22:01:35.316329
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03234.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03105.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03106.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02978.fits
Matched 22 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/reference-custom-276139p30405.fits
Stage refs : Wall: 18.53 s, CPU: 10.63 s, VmPeak: 1132 MB, VmSize: 1126 MB, VmRSS: 291 MB, VmData: 320 MB, maxrss: 0.297972 MB
Stage refs finished: 2020-08-05T22:01:53.841781
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 18.528 s, Cores in use: 0.57, Total efficiency (on 32 cores): 1.8 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T22:01:53.860722
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outlier-mask-custom-276139p30405.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-pre-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outlier-mask-custom-276139p30405.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-post-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-masked-pos-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/outliers-masked-neg-custom-276139p30405.jpg
Stage outliers : Wall: 1.27 s, CPU: 0.92 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 299 MB, VmData: 326 MB, maxrss: 0.306232 MB
Stage outliers finished: 2020-08-05T22:01:55.132486
Resources for stage outliers : 0.235 s worker CPU, 0.309 s worker Wall, Wall: 1.274 s, Cores in use: 0.91, Total efficiency (on 32 cores): 2.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T22:01:55.152792
Stage halos : Wall: 0.60 s, CPU: 0.44 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 299 MB, VmData: 326 MB, maxrss: 0.30636 MB
Stage halos finished: 2020-08-05T22:01:55.754182
Resources for stage halos : 0.197 s worker CPU, 0.421 s worker Wall, Wall: 0.604 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T22:01:55.887648
PSF sigmas in coadd pixels: ['2.43']
Using average PSF sigma 2.4252081719796412
Gaussian PSF norm 0.11631776398955919 vs pixelized 0.10700808
average tim pixel scale / coadd scale: 1.0013475015276032
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66']
Using average PSF sigma 2.663857358068689
Gaussian PSF norm 0.10589710853677181 vs pixelized 0.093063876
average tim pixel scale / coadd scale: 1.0014733700401626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.51']
Using average PSF sigma 2.514509627260593
Gaussian PSF norm 0.11218680124172102 vs pixelized 0.09695696
average tim pixel scale / coadd scale: 1.0013681963505578
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.16 s, CPU: 0.07 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 301 MB, VmData: 326 MB, maxrss: 0.307824 MB
Stage fit_on_coadds finished: 2020-08-05T22:01:56.044729
Resources for stage fit_on_coadds : 0.048 s worker CPU, 0.064 s worker Wall, Wall: 0.159 s, Cores in use: 0.75, Total efficiency (on 32 cores): 2.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T22:01:56.081836
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 27619 potential peaks
Of 27619 potential peaks: 27610 in veto map, 3 cut by saddle test, 0 cut by aper test, 6 kept
SED z : 6 new peaks
Found 9868 potential peaks
Of 9868 potential peaks: 9853 in veto map, 4 cut by saddle test, 0 cut by aper test, 11 kept
SED r : 11 new peaks
Found 26 potential peaks
Of 26 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 6 kept
SED g : 6 new peaks
Found 179 potential peaks
Of 179 potential peaks: 175 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 167 potential peaks
Of 167 potential peaks: 163 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 23 new sources
Median coadd sky for g : 6.448198e-05
Median coadd sky for r : 0.00024275655
Median coadd sky for z : 0.00041006424
Stage srcs : Wall: 2.28 s, CPU: 1.56 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 301 MB, VmData: 326 MB, maxrss: 0.308388 MB
Stage srcs finished: 2020-08-05T22:01:58.359234
Resources for stage srcs : 0.910 s worker CPU, 0.938 s worker Wall, Wall: 2.280 s, Cores in use: 1.08, Total efficiency (on 32 cores): 3.4 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T22:01:58.373809
Blob 1 of 8, id: 2, sources: 38, size: 269x269, npix 52700, brick X: 0,269, Y: 0,269, one pixel: 144 0
Blob 2 of 8, id: 6, sources: 1, size: 40x40, npix 1110, brick X: 10,50, Y: 87,127, one pixel: 27 87
Blob 3 of 8, id: 4, sources: 1, size: 29x40, npix 737, brick X: 0,29, Y: 33,73, one pixel: 8 33
Blob 4 of 8, id: 5, sources: 1, size: 29x29, npix 547, brick X: 40,69, Y: 61,90, one pixel: 51 61
Blob 5 of 8, id: 0, sources: 2, size: 25x21, npix 378, brick X: 19,44, Y: 0,21, one pixel: 26 0
Blob 6 of 8, id: 7, sources: 1, size: 24x25, npix 376, brick X: 9,33, Y: 162,187, one pixel: 19 162
Blob 7 of 8, id: 3, sources: 1, size: 25x24, npix 368, brick X: 44,69, Y: 9,33, one pixel: 55 9
Blob 8 of 8, id: 1, sources: 2, size: 25x15, npix 264, brick X: 70,95, Y: 0,15, one pixel: 72 0
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14358, 30.39546), pm (-4.5, 4.4), parallax -0.062 with NanoMaggies: g=20.3, r=19.4, z=18.7
Reset brightness to NanoMaggies: g=20.5, r=19.5, z=19
Blob 8 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 85 MB, VmData: 137 MB, maxrss: 0.087256 MB
Blob 6 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147204 MB
Measuring 2 iterative sources
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14831, 30.39121), pm (-6.4, -3.3), parallax 0.118 with NanoMaggies: g=17.9, r=17.3, z=17.2
Reset brightness to NanoMaggies: g=17.9, r=17.3, z=17.2
Blob 5 finished, total: Wall: 0.37 s, CPU: 0.36 s, VmPeak: 666 MB, VmSize: 666 MB, VmRSS: 88 MB, VmData: 137 MB, maxrss: 0.090308 MB
Blob 7 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 956 MB, VmSize: 731 MB, VmRSS: 144 MB, VmData: 180 MB, maxrss: 0.147372 MB
Blob 3 finished, total: Wall: 0.56 s, CPU: 0.54 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.090904 MB
Blob 4 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092144 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.67 s, CPU: 1.62 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 89 MB, VmData: 138 MB, maxrss: 0.091088 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (275.98801, 30.44140), pm (-16.3, -20.5), parallax 2.328 with NanoMaggies: g=8.76, r=7.79, z=7.33
Reset brightness to NanoMaggies: g=8.76, r=7.79, z=7.33
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15976, 30.42951), pm (-1.2, 8.9), parallax 2.461 with NanoMaggies: g=9.74, r=9.77, z=9.96
Reset brightness to NanoMaggies: g=9.74, r=9.77, z=9.96
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.08168, 30.42853), pm (-3.1, -10.6), parallax 0.776 with NanoMaggies: g=12.2, r=11.2, z=10.7
Reset brightness to NanoMaggies: g=12.2, r=11.2, z=10.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.13118, 30.39517), pm (1.5, 3.3), parallax 0.590 with NanoMaggies: g=15.6, r=15.2, z=14.6
Reset brightness to NanoMaggies: g=15.2, r=14.8, z=14.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.11913, 30.40166), pm (-0.5, -4.1), parallax 0.607 with NanoMaggies: g=15.5, r=15.1, z=15
Reset brightness to NanoMaggies: g=15.5, r=15.1, z=15
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.12673, 30.39314), pm (7.1, -1.0), parallax 0.924 with NanoMaggies: g=17.4, r=16.5, z=16.1
Reset brightness to NanoMaggies: g=17.4, r=16.5, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15099, 30.42163), pm (-6.2, -8.0), parallax 0.153 with NanoMaggies: g=17.1, r=16.8, z=16.8
Reset brightness to NanoMaggies: g=17.1, r=16.8, z=16.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.12501, 30.41167), pm (-2.9, -5.4), parallax 0.245 with NanoMaggies: g=17.7, r=17.2, z=17
Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.55488, ee1=-0.656073, ee2=0.231297
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.13890, 30.41765), pm (-0.8, -3.5), parallax 0.245 with NanoMaggies: g=(flux -1.49e+04), r=18, z=17.8
Reset brightness to NanoMaggies: g=18.6, r=18, z=17.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14081, 30.41861), pm (-1.3, -2.0), parallax 0.314 with NanoMaggies: g=18.8, r=18.1, z=17.8
Reset brightness to NanoMaggies: g=18.8, r=18.1, z=17.8
Measuring 6 iterative sources
Blob 1 finished, total: Wall: 23.52 s, CPU: 23.49 s, VmPeak: 721 MB, VmSize: 694 MB, VmRSS: 127 MB, VmData: 166 MB, maxrss: 0.153496 MB
Old catalog: 50
New catalog: 53
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/blobs-custom-276139p30405.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/metrics/cus/all-models-custom-276139p30405.fits
Stage fitblobs : Wall: 24.01 s, CPU: 0.45 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 303 MB, VmData: 327 MB, maxrss: 0.310308 MB
Stage fitblobs finished: 2020-08-05T22:02:22.388723
Resources for stage fitblobs : 27.896 s worker CPU, 28.065 s worker Wall, Wall: 24.017 s, Cores in use: 1.18, Total efficiency (on 32 cores): 3.7 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T22:02:22.406678
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-resid.jpg
Stage coadds : Wall: 3.99 s, CPU: 0.73 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 306 MB, VmData: 330 MB, maxrss: 0.313772 MB
Stage coadds finished: 2020-08-05T22:02:26.394143
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 34.373 s worker CPU, 66.571 s worker Wall, Wall: 3.990 s, Cores in use: 8.80, Total efficiency (on 32 cores): 27.5 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T22:02:26.413800
Cut to 1 unWISE tiles
Reading WISE tile 2765p302 band 1
Reading WISE tile 2765p302 band 2
Reading WISE tile 2765p302 band 3
Reading WISE tile 2765p302 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204484 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 803 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 175 MB, maxrss: 0.186552 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 809 MB, VmRSS: 147 MB, VmData: 174 MB, maxrss: 0.210808 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 800 MB, VmSize: 800 MB, VmRSS: 139 MB, VmData: 172 MB, maxrss: 0.199444 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.59 s, CPU: 0.90 s, VmPeak: 1136 MB, VmSize: 1136 MB, VmRSS: 307 MB, VmData: 330 MB, maxrss: 0.314284 MB
Stage wise_forced finished: 2020-08-05T22:02:31.006766
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 3.486 s worker CPU, 7.323 s worker Wall, Wall: 4.595 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T22:02:31.024838
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/tractor-i/cus/tractor-custom-276139p30405.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/tractor/cus/tractor-custom-276139p30405.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/tractor/cus/brick-custom-276139p30405.sha256sum
Stage writecat : Wall: 0.73 s, CPU: 0.57 s, VmPeak: 1268 MB, VmSize: 1140 MB, VmRSS: 309 MB, VmData: 330 MB, maxrss: 0.447184 MB
Stage writecat finished: 2020-08-05T22:02:31.757300
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.735 s, Cores in use: 0.78, Total efficiency (on 32 cores): 2.4 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/276/PGC1902495/PGC1902495-largegalaxy-writecat.p
All done: 68.783 s worker CPU, 163.918 s worker Wall, Wall: 79.538 s, Cores in use: 1.09, Total efficiency (on 32 cores): 3.4 %
Finished galaxy PGC1902495 in 1.377 minutes.
Started working on galaxy PGC1902495 at Fri Aug  7 09:50:19 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.1390232622686 30.40599141845848 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-07T09:50:20.382772
legacypipe git version: DR9.5.11-watershed-3-gd509eaaf
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '276.1390232622686', '30.40599141845848', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 276.1390232622686 30.40599141845848 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 276.1390232622686 30.40599141845848
Starting process 57732 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB
Starting process 57733 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57734 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57735 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 57736 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 57737 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB
Starting process 57738 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB
Starting process 57739 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57740 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 57741 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 57742 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 57743 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 57744 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 57746 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 57745 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB
Starting process 57747 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-07T09:50:20.935036
Keeping 3 CCDs:
  c4d_160408_100855_ooi_z_ls9-S5 z expnum 535343 exptime 201.0 propid 2014B-0404 seeing 1.55 MJD 57486.420 object DECaLS_34662_z 
    decam/CP/V4.8.2a/CP20160407/c4d_160408_100855_ooi_z_ls9.fits.fz
  c4d_160408_091305_ooi_r_ls9-S5 r expnum 535319 exptime 250.0 propid 2014B-0404 seeing 1.64 MJD 57486.381 object DECaLS_18790_r 
    decam/CP/V4.8.2a/CP20160407/c4d_160408_091305_ooi_r_ls9.fits.fz
  c4d_160803_022806_ooi_g_ls9-S5 g expnum 558495 exptime 129.0 propid 2014B-0404 seeing 1.49 MJD 57603.101 object DECaLS_18790_g 
    decam/CP/V4.8.2a/CP20160802/c4d_160803_022806_ooi_g_ls9.fits.fz
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S5,noinherit][2046,4094][real]: DECaLS_1
The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3
Stage tims : Wall: 47.22 s, CPU: 0.86 s, VmPeak: 1003 MB, VmSize: 1003 MB, VmRSS: 170 MB, VmData: 203 MB, maxrss: 0.173912 MB
Stage tims finished: 2020-08-07T09:51:08.153462
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_956f863-r-20160408T090801_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_95b90ac-g-20160803T022506_oi[S5,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card]
Resources for stage tims : 1.521 s worker CPU, 135.581 s worker Wall, Wall: 47.220 s, Cores in use: 0.05, Total efficiency (on 16 cores): 0.3 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-tims.p
Running stage refs
Warning: splinesky does not have sky-template version/run/scale values
WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention:
DECALS_DR9_954d4d0-z-20160408T100444_oi[S5,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card]
Running stage refs at 2020-08-07T09:51:08.176899
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03234.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03105.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03106.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02978.fits
Matched 22 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/reference-custom-276139p30405.fits
Stage refs : Wall: 30.13 s, CPU: 10.43 s, VmPeak: 1125 MB, VmSize: 1120 MB, VmRSS: 290 MB, VmData: 320 MB, maxrss: 0.296476 MB
Stage refs finished: 2020-08-07T09:51:38.303506
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 30.128 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-07T09:51:38.316561
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/outlier-mask-custom-276139p30405.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/outliers-pre-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/outlier-mask-custom-276139p30405.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/outliers-post-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/outliers-masked-pos-custom-276139p30405.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/outliers-masked-neg-custom-276139p30405.jpg
Stage outliers : Wall: 0.80 s, CPU: 0.45 s, VmPeak: 1129 MB, VmSize: 1129 MB, VmRSS: 297 MB, VmData: 326 MB, maxrss: 0.30448 MB
Stage outliers finished: 2020-08-07T09:51:39.119400
Resources for stage outliers : 0.215 s worker CPU, 0.323 s worker Wall, Wall: 0.804 s, Cores in use: 0.83, Total efficiency (on 16 cores): 5.2 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-07T09:51:39.160875
Stage halos : Wall: 0.33 s, CPU: 0.19 s, VmPeak: 1129 MB, VmSize: 1129 MB, VmRSS: 298 MB, VmData: 326 MB, maxrss: 0.304916 MB
Stage halos finished: 2020-08-07T09:51:39.493505
Resources for stage halos : 0.167 s worker CPU, 0.288 s worker Wall, Wall: 0.334 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.7 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-07T09:51:39.517538
PSF sigmas in coadd pixels: ['2.43']
Using average PSF sigma 2.4252081719796412
Gaussian PSF norm 0.11631776398955919 vs pixelized 0.107012644
average tim pixel scale / coadd scale: 1.0013475015276032
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.66']
Using average PSF sigma 2.663857358068689
Gaussian PSF norm 0.10589710853677181 vs pixelized 0.093063526
average tim pixel scale / coadd scale: 1.0014733700401626
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['2.51']
Using average PSF sigma 2.514509627260593
Gaussian PSF norm 0.11218680124172102 vs pixelized 0.0969622
average tim pixel scale / coadd scale: 1.0013681963505578
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.13 s, CPU: 0.06 s, VmPeak: 1129 MB, VmSize: 1129 MB, VmRSS: 299 MB, VmData: 326 MB, maxrss: 0.306384 MB
Stage fit_on_coadds finished: 2020-08-07T09:51:39.649391
Resources for stage fit_on_coadds : 0.032 s worker CPU, 0.032 s worker Wall, Wall: 0.133 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.4 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-07T09:51:39.666070
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 29023 potential peaks
Of 29023 potential peaks: 29017 in veto map, 2 cut by saddle test, 0 cut by aper test, 4 kept
SED z : 4 new peaks
Found 11265 potential peaks
Of 11265 potential peaks: 11251 in veto map, 4 cut by saddle test, 0 cut by aper test, 10 kept
SED r : 10 new peaks
Found 27 potential peaks
Of 27 potential peaks: 18 in veto map, 2 cut by saddle test, 0 cut by aper test, 7 kept
SED g : 7 new peaks
Found 189 potential peaks
Of 189 potential peaks: 185 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept
SED Flat : 1 new peaks
Found 179 potential peaks
Of 179 potential peaks: 175 in veto map, 4 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 22 new sources
Median coadd sky for g : 5.763678e-05
Median coadd sky for r : 0.0001293671
Median coadd sky for z : 0.00037947026
Stage srcs : Wall: 1.08 s, CPU: 0.48 s, VmPeak: 1129 MB, VmSize: 1129 MB, VmRSS: 300 MB, VmData: 326 MB, maxrss: 0.306932 MB
Stage srcs finished: 2020-08-07T09:51:40.749797
Resources for stage srcs : 0.834 s worker CPU, 0.834 s worker Wall, Wall: 1.085 s, Cores in use: 1.21, Total efficiency (on 16 cores): 7.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-07T09:51:40.827806
Blob 1 of 7, id: 1, sources: 37, size: 269x269, npix 53899, brick X: 0,269, Y: 0,269, one pixel: 141 0
Blob 2 of 7, id: 5, sources: 1, size: 39x41, npix 1116, brick X: 8,47, Y: 81,122, one pixel: 27 81
Blob 3 of 7, id: 3, sources: 2, size: 27x39, npix 675, brick X: 0,27, Y: 28,67, one pixel: 6 28
Blob 4 of 7, id: 4, sources: 1, size: 29x29, npix 556, brick X: 38,67, Y: 55,84, one pixel: 50 55
Blob 5 of 7, id: 6, sources: 1, size: 25x24, npix 366, brick X: 6,31, Y: 157,181, one pixel: 16 157
Blob 6 of 7, id: 2, sources: 1, size: 25x23, npix 365, brick X: 42,67, Y: 4,27, one pixel: 52 4
Blob 7 of 7, id: 0, sources: 2, size: 23x16, npix 241, brick X: 18,41, Y: 0,16, one pixel: 22 0
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14831, 30.39121), pm (-6.4, -3.3), parallax 0.118 with NanoMaggies: g=17.9, r=17.3, z=17.2
Reset brightness to NanoMaggies: g=17.9, r=17.3, z=17.2
Blob 7 finished, total: Wall: 0.26 s, CPU: 0.25 s, VmPeak: 945 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145428 MB
Blob 5 finished, total: Wall: 0.27 s, CPU: 0.26 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093236 MB
Blob 6 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093296 MB
Blob 4 finished, total: Wall: 0.68 s, CPU: 0.67 s, VmPeak: 952 MB, VmSize: 725 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144292 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.092572 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 1.42 s, CPU: 1.41 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.095256 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.12501, 30.41167), pm (-2.9, -5.4), parallax 0.245 with NanoMaggies: g=(flux -2.8e+05), r=5.21, z=17
Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (275.98801, 30.44140), pm (-16.3, -20.5), parallax 2.328 with NanoMaggies: g=8.76, r=7.79, z=7.33
Reset brightness to NanoMaggies: g=8.76, r=7.79, z=7.33
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15976, 30.42951), pm (-1.2, 8.9), parallax 2.461 with NanoMaggies: g=9.74, r=9.77, z=9.96
Reset brightness to NanoMaggies: g=9.74, r=9.77, z=9.96
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.08168, 30.42853), pm (-3.1, -10.6), parallax 0.776 with NanoMaggies: g=12.2, r=11.2, z=10.7
Reset brightness to NanoMaggies: g=12.2, r=11.2, z=10.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.13118, 30.39517), pm (1.5, 3.3), parallax 0.590 with NanoMaggies: g=15.4, r=15.3, z=14.6
Reset brightness to NanoMaggies: g=15.2, r=14.8, z=14.6
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.11913, 30.40166), pm (-0.5, -4.1), parallax 0.607 with NanoMaggies: g=15.5, r=15.1, z=15
Reset brightness to NanoMaggies: g=15.5, r=15.1, z=15
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.12673, 30.39314), pm (7.1, -1.0), parallax 0.924 with NanoMaggies: g=17.4, r=16.5, z=16.1
Reset brightness to NanoMaggies: g=17.4, r=16.5, z=16.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.15099, 30.42163), pm (-6.2, -8.0), parallax 0.153 with NanoMaggies: g=17.1, r=16.8, z=16.8
Reset brightness to NanoMaggies: g=17.1, r=16.8, z=16.8
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=0.612803, ee1=-0.374317, ee2=0.161384
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.14081, 30.41861), pm (-1.3, -2.0), parallax 0.314 with NanoMaggies: g=18.8, r=18.1, z=17.8
Reset brightness to NanoMaggies: g=18.8, r=18.1, z=17.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (276.13890, 30.41765), pm (-0.8, -3.5), parallax 0.245 with NanoMaggies: g=(flux -342), r=18, z=17.8
Reset brightness to NanoMaggies: g=18.6, r=18, z=17.8
Measuring 5 iterative sources
Blob 1 finished, total: Wall: 22.68 s, CPU: 22.68 s, VmPeak: 721 MB, VmSize: 695 MB, VmRSS: 125 MB, VmData: 163 MB, maxrss: 0.154264 MB
Old catalog: 49
New catalog: 50
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/blobs-custom-276139p30405.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/metrics/cus/all-models-custom-276139p30405.fits
Stage fitblobs : Wall: 25.19 s, CPU: 0.45 s, VmPeak: 1129 MB, VmSize: 1129 MB, VmRSS: 301 MB, VmData: 327 MB, maxrss: 0.308584 MB
Stage fitblobs finished: 2020-08-07T09:52:06.016735
Resources for stage fitblobs : 26.911 s worker CPU, 27.126 s worker Wall, Wall: 25.191 s, Cores in use: 1.09, Total efficiency (on 16 cores): 6.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-07T09:52:06.121470
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-resid.jpg
Stage coadds : Wall: 2.85 s, CPU: 0.56 s, VmPeak: 1129 MB, VmSize: 1129 MB, VmRSS: 305 MB, VmData: 330 MB, maxrss: 0.312184 MB
Stage coadds finished: 2020-08-07T09:52:08.968879
Resources for stage coadds : 17.091 s worker CPU, 18.024 s worker Wall, Wall: 2.849 s, Cores in use: 6.20, Total efficiency (on 16 cores): 38.7 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-07T09:52:08.997075
Cut to 1 unWISE tiles
Reading WISE tile 2765p302 band 3
Reading WISE tile 2765p302 band 1
Reading WISE tile 2765p302 band 2
Reading WISE tile 2765p302 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 957 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 176 MB, maxrss: 0.188308 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 856 MB, VmSize: 856 MB, VmRSS: 201 MB, VmData: 234 MB, maxrss: 0.205496 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 945 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205212 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/276/2765p302/unwise-2765p302-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 952 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.206664 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/tmp-legacysurvey-custom-276139p30405-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 10.85 s, CPU: 0.51 s, VmPeak: 1129 MB, VmSize: 1129 MB, VmRSS: 305 MB, VmData: 330 MB, maxrss: 0.312696 MB
Stage wise_forced finished: 2020-08-07T09:52:19.842342
Resources for stage wise_forced : 3.183 s worker CPU, 13.391 s worker Wall, Wall: 10.847 s, Cores in use: 0.34, Total efficiency (on 16 cores): 2.1 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-07T09:52:19.859561
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/coadd/cus/custom-276139p30405/legacysurvey-custom-276139p30405-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/tractor-i/cus/tractor-custom-276139p30405.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/tractor/cus/tractor-custom-276139p30405.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/tractor/cus/brick-custom-276139p30405.sha256sum
Stage writecat : Wall: 1.48 s, CPU: 0.63 s, VmPeak: 1262 MB, VmSize: 1134 MB, VmRSS: 307 MB, VmData: 330 MB, maxrss: 0.445556 MB
Stage writecat finished: 2020-08-07T09:52:21.340594
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.483 s, Cores in use: 0.42, Total efficiency (on 16 cores): 2.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/276/PGC1902495/PGC1902495-largegalaxy-writecat.p
All done: 49.957 s worker CPU, 195.602 s worker Wall, Wall: 120.427 s, Cores in use: 0.54, Total efficiency (on 16 cores): 3.4 %
Finished galaxy PGC1902495 in 2.044 minutes.