Started working on galaxy DR8-2227p420-92 at Wed Aug  5 21:17:31 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 222.650119186511 41.8835059079373 --width 303 --height 303 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-05T21:17:34.034452
legacypipe git version: DR9.5.10-12-gf22e529f
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '222.650119186511', '41.8835059079373', '--width', '303', '--height', '303', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 222.650119186511 41.8835059079373 --width 303 --height 303 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 222.650119186511 41.8835059079373
Starting process 6480 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 6481 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 6482 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 6483 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB
Starting process 6484 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB
Starting process 6485 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 6486 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB
Starting process 6487 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 6488 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 6489 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 6490 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 6491 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6493 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6494 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6492 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 6495 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-05T21:17:34.928060
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Keeping 9 CCDs:
  k4m_160327_100831_ooi_zd_ls9-CCD3 z expnum 79033 exptime 80.105 propid 2016A-0453 seeing 0.73 MJD 57474.423 object MzLS_613675_z 
    mosaic/CP/V4.3/CP20160326/k4m_160327_100831_ooi_zd_ls9.fits.fz
  k4m_170329_101238_ooi_zd_ls9-CCD4 z expnum 117835 exptime 117.104 propid 2016A-0453 seeing 1.96 MJD 57841.425 object MzLS_612740_z 
    mosaic/CP/V4.3/CP20170328/k4m_170329_101238_ooi_zd_ls9.fits.fz
  k4m_160401_092017_ooi_zd_ls9-CCD3 z expnum 80123 exptime 80.104 propid 2016A-0453 seeing 1.30 MJD 57479.389 object MzLS_614608_z 
    mosaic/CP/V4.3/CP20160331/k4m_160401_092017_ooi_zd_ls9.fits.fz
  ksb_170223_120852_ooi_g_ls9-CCD3 g expnum 78070115 exptime 125.193 propid BASS seeing 2.43 MJD 57807.506 object 17103 
    90prime/CP/V2.3/CP20170222/ksb_170223_120852_ooi_g_ls9.fits.fz
  ksb_170324_104419_ooi_r_ls9-CCD3 r expnum 78360219 exptime 100.475 propid BASS seeing 1.69 MJD 57836.447 object 17103 
    90prime/CP/V2.3/CP20170323/ksb_170324_104419_ooi_r_ls9.fits.fz
  ksb_160403_073920_ooi_r_ls9-CCD2 r expnum 74810163 exptime 80.7 propid BASS seeing 1.24 MJD 57481.319 object 17091 
    90prime/CP/V2.3/CP20160402/ksb_160403_073920_ooi_r_ls9.fits.fz
  ksb_160213_124637_ooi_g_ls9-CCD2 g expnum 74310263 exptime 75.1 propid 2015A-0801 seeing 1.41 MJD 57431.532 object 17091 
    90prime/CP/V2.3/CP20160212/ksb_160213_124637_ooi_g_ls9.fits.fz
  ksb_160513_071009_ooi_r_ls9-CCD2 r expnum 75210114 exptime 73.7 propid BASS seeing 1.17 MJD 57521.299 object 17092 
    90prime/CP/V2.3/CP20160512/ksb_160513_071009_ooi_r_ls9.fits.fz
  ksb_170518_065258_ooi_g_ls9-CCD2 g expnum 78910061 exptime 89.73 propid 2015A-0801 seeing 1.54 MJD 57891.287 object 17092 
    90prime/CP/V2.3/CP20170517/ksb_170518_065258_ooi_g_ls9.fits.fz
Faked up EXPNUM 74310263
Faked up EXPNUM 74310263
Faked up EXPNUM 74310263
90prime get_fwhm: self.fwhm = 3.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 728 906 and amp range 0 2015 and image y 900 1078 and amp range 0 2047
Range in image: x 0 179 , y 0 179 (with image size 179 x 179)
dzp -0.008523628 -> scaling image by 0.992180183483648
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 74810163
Faked up EXPNUM 74810163
Faked up EXPNUM 74810163
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 716 893 and amp range 0 2015 and image y 910 1089 and amp range 0 2047
Range in image: x 0 178 , y 0 180 (with image size 178 x 180)
dzp -0.006045583 -> scaling image by 0.9944472857505693
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 5.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 399 709 and amp range 0 2005 and image y 585 893 and amp range 0 2039
Range in image: x 0 311 , y 0 309 (with image size 311 x 309)
dzp -0.005856539 -> scaling image by 0.9946204500110131
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78360219
Faked up EXPNUM 78360219
Faked up EXPNUM 78360219
90prime get_fwhm: self.fwhm = 3.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2987 3162 and amp range 2016 4031 and image y 2489 2665 and amp range 2048 4095
Range in image: x 0 176 , y 0 177 (with image size 176 x 177)
dzp -0.035697103 -> scaling image by 0.9676563679910417
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 7.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1524 1831 and amp range 0 2047 and image y 1054 1359 and amp range 0 2021
Range in image: x 0 308 , y 0 306 (with image size 308 x 306)
dzp -0.018417627 -> scaling image by 0.9831798050134541
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78070115
Faked up EXPNUM 78070115
Faked up EXPNUM 78070115
90prime get_fwhm: self.fwhm = 5.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2977 3153 and amp range 2016 4031 and image y 2494 2671 and amp range 2048 4095
Range in image: x 0 177 , y 0 178 (with image size 177 x 178)
dzp -0.02530836 -> scaling image by 0.9769597156943128
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
mosaic get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3108 3412 and amp range 2006 4053 and image y 274 578 and amp range 0 2039
Range in image: x 0 305 , y 0 305 (with image size 305 x 305)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 78910061
Faked up EXPNUM 78910061
Faked up EXPNUM 78910061
90prime get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2731 2908 and amp range 2016 4031 and image y 2905 3083 and amp range 2048 4095
Range in image: x 0 178 , y 0 179 (with image size 178 x 179)
dzp 0.010008041 -> scaling image by 1.0092603604948323
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Faked up EXPNUM 75210114
Faked up EXPNUM 75210114
Faked up EXPNUM 75210114
90prime get_fwhm: self.fwhm = 2.59
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2726 2904 and amp range 2016 4031 and image y 2897 3075 and amp range 2048 4095
Range in image: x 0 179 , y 0 179 (with image size 179 x 179)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Stage tims : Wall: 18.29 s, CPU: 0.95 s, VmPeak: 957 MB, VmSize: 957 MB, VmRSS: 175 MB, VmData: 208 MB, maxrss: 0.179568 MB
Stage tims finished: 2020-08-05T21:17:53.221199
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage tims : 4.664 s worker CPU, 44.431 s worker Wall, Wall: 18.295 s, Cores in use: 0.31, Total efficiency (on 16 cores): 1.9 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-tims.p
Running stage refs
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage refs at 2020-08-05T21:17:53.241546
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02191.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01936.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02062.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02063.fits
Matched 2 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/reference-custom-222650p41883.fits
Stage refs : Wall: 8.00 s, CPU: 1.53 s, VmPeak: 988 MB, VmSize: 972 MB, VmRSS: 191 MB, VmData: 222 MB, maxrss: 0.195232 MB
Stage refs finished: 2020-08-05T21:18:01.236617
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 7.997 s, Cores in use: 0.19, Total efficiency (on 16 cores): 1.2 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-05T21:18:01.316619
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/outlier-mask-custom-222650p41883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/outliers-pre-custom-222650p41883.jpg
Image k4m_170329_101238_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 130 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/outlier-mask-custom-222650p41883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/outliers-post-custom-222650p41883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/outliers-masked-pos-custom-222650p41883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/outliers-masked-neg-custom-222650p41883.jpg
Stage outliers : Wall: 1.12 s, CPU: 0.86 s, VmPeak: 988 MB, VmSize: 981 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.214172 MB
Stage outliers finished: 2020-08-05T21:18:02.440468
Resources for stage outliers : 0.859 s worker CPU, 0.961 s worker Wall, Wall: 1.125 s, Cores in use: 1.53, Total efficiency (on 16 cores): 9.6 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-05T21:18:02.497944
Stage halos : Wall: 0.34 s, CPU: 0.34 s, VmPeak: 988 MB, VmSize: 981 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.214268 MB
Stage halos finished: 2020-08-05T21:18:02.836106
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.340 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-05T21:18:02.911056
PSF sigmas in coadd pixels: ['3.95', '2.29', '2.50']
Using average PSF sigma 2.9126628391385636
Gaussian PSF norm 0.09685116587586542 vs pixelized 0.081291385
average tim pixel scale / coadd scale: 1.7299480338133018
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.75', '2.01', '1.91']
Using average PSF sigma 2.2207094857479954
Gaussian PSF norm 0.127029129016784 vs pixelized 0.10138667
average tim pixel scale / coadd scale: 1.7299229734157788
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.18', '3.18', '2.11']
Using average PSF sigma 2.1576214709928356
Gaussian PSF norm 0.13074341146784726 vs pixelized 0.12453872
average tim pixel scale / coadd scale: 0.9909492694303563
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.23 s, CPU: 0.19 s, VmPeak: 988 MB, VmSize: 981 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.217104 MB
Stage fit_on_coadds finished: 2020-08-05T21:18:03.142234
Resources for stage fit_on_coadds : 0.186 s worker CPU, 0.186 s worker Wall, Wall: 0.233 s, Cores in use: 1.62, Total efficiency (on 16 cores): 10.1 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-05T21:18:03.152882
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 24 kept
SED z : 24 new peaks
Found 22 potential peaks
Of 22 potential peaks: 20 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 17 potential peaks
Of 17 potential peaks: 13 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 39 potential peaks
Of 39 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 41 potential peaks
Of 41 potential peaks: 35 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 37 new sources
Median coadd sky for g : 5.447449e-05
Median coadd sky for r : 9.930912e-05
Median coadd sky for z : 0.00019563812
Stage srcs : Wall: 0.48 s, CPU: 0.45 s, VmPeak: 988 MB, VmSize: 981 MB, VmRSS: 212 MB, VmData: 239 MB, maxrss: 0.21758 MB
Stage srcs finished: 2020-08-05T21:18:03.636763
Resources for stage srcs : 0.095 s worker CPU, 0.095 s worker Wall, Wall: 0.485 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-05T21:18:03.649007
Blob 1 of 25, id: 8, sources: 4, size: 85x116, npix 6231, brick X: 114,199, Y: 90,206, one pixel: 160 90
Blob 2 of 25, id: 3, sources: 3, size: 78x53, npix 2204, brick X: 81,159, Y: 22,75, one pixel: 91 22
Blob 3 of 25, id: 0, sources: 4, size: 49x47, npix 1364, brick X: 151,200, Y: 0,47, one pixel: 171 0
Blob 4 of 25, id: 6, sources: 2, size: 48x33, npix 933, brick X: 87,135, Y: 79,112, one pixel: 120 79
Blob 5 of 25, id: 23, sources: 2, size: 61x21, npix 925, brick X: 185,246, Y: 282,303, one pixel: 224 282
Blob 6 of 25, id: 7, sources: 2, size: 41x40, npix 881, brick X: 248,289, Y: 89,129, one pixel: 276 89
Blob 7 of 25, id: 21, sources: 2, size: 30x46, npix 811, brick X: 52,82, Y: 248,294, one pixel: 70 248
Blob 8 of 25, id: 9, sources: 2, size: 45x34, npix 781, brick X: 8,53, Y: 91,125, one pixel: 18 91
Blob 9 of 25, id: 14, sources: 1, size: 29x36, npix 646, brick X: 0,29, Y: 174,210, one pixel: 11 174
Blob 10 of 25, id: 13, sources: 1, size: 28x26, npix 504, brick X: 73,101, Y: 134,160, one pixel: 83 134
Blob 11 of 25, id: 16, sources: 1, size: 27x27, npix 462, brick X: 188,215, Y: 196,223, one pixel: 201 196
Blob 12 of 25, id: 22, sources: 1, size: 28x23, npix 454, brick X: 121,149, Y: 280,303, one pixel: 132 280
Blob 13 of 25, id: 1, sources: 1, size: 30x21, npix 444, brick X: 247,277, Y: 0,21, one pixel: 251 0
Blob 14 of 25, id: 12, sources: 1, size: 26x26, npix 420, brick X: 35,61, Y: 131,157, one pixel: 46 131
Blob 15 of 25, id: 24, sources: 1, size: 31x18, npix 411, brick X: 250,281, Y: 285,303, one pixel: 262 285
Blob 16 of 25, id: 19, sources: 1, size: 28x27, npix 397, brick X: 233,261, Y: 223,250, one pixel: 242 223
Blob 17 of 25, id: 10, sources: 1, size: 22x23, npix 323, brick X: 212,234, Y: 111,134, one pixel: 222 111
Blob 18 of 25, id: 4, sources: 1, size: 17x25, npix 297, brick X: 286,303, Y: 53,78, one pixel: 296 53
Measuring 1 iterative sources
Blob 16 finished, total: Wall: 0.34 s, CPU: 0.32 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151288 MB
Blob 19 of 25, id: 5, sources: 1, size: 22x21, npix 271, brick X: 222,244, Y: 60,81, one pixel: 231 60
Blob 11 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151104 MB
Blob 20 of 25, id: 11, sources: 1, size: 19x21, npix 235, brick X: 284,303, Y: 129,150, one pixel: 294 129
Blob 14 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.09768 MB
Blob 21 of 25, id: 15, sources: 1, size: 20x20, npix 229, brick X: 224,244, Y: 194,214, one pixel: 233 194
Blob 10 finished, total: Wall: 0.69 s, CPU: 0.68 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099132 MB
Blob 22 of 25, id: 20, sources: 1, size: 20x20, npix 229, brick X: 141,161, Y: 245,265, one pixel: 150 245
Blob 19 finished, total: Wall: 0.20 s, CPU: 0.20 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.097968 MB
Blob 23 of 25, id: 18, sources: 1, size: 20x19, npix 209, brick X: 25,45, Y: 207,226, one pixel: 34 207
Blob 8 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096028 MB
Blob 24 of 25, id: 17, sources: 1, size: 19x19, npix 199, brick X: 77,96, Y: 204,223, one pixel: 86 204
Blob 4 finished, total: Wall: 0.89 s, CPU: 0.89 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151132 MB
Blob 25 of 25, id: 2, sources: 1, size: 18x17, npix 162, brick X: 56,74, Y: 9,26, one pixel: 64 9
Measuring 1 iterative sources
Blob 17 finished, total: Wall: 0.58 s, CPU: 0.58 s, VmPeak: 809 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151864 MB
Blob 12 finished, total: Wall: 1.11 s, CPU: 1.11 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.09728 MB
Blob 21 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.097968 MB
Blob 22 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.096296 MB
Blob 13 finished, total: Wall: 1.16 s, CPU: 1.16 s, VmPeak: 791 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151076 MB
Blob 25 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.097508 MB
Blob 23 finished, total: Wall: 0.32 s, CPU: 0.32 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151132 MB
Blob 5 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15148 MB
Blob 20 finished, total: Wall: 0.53 s, CPU: 0.53 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.099288 MB
Measuring 1 iterative sources
Blob 18 finished, total: Wall: 0.85 s, CPU: 0.85 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151476 MB
Blob 6 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 807 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151044 MB
Blob 24 finished, total: Wall: 0.49 s, CPU: 0.49 s, VmPeak: 809 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151864 MB
Blob 9 finished, total: Wall: 1.59 s, CPU: 1.59 s, VmPeak: 805 MB, VmSize: 731 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.15212 MB
Blob 15 finished, total: Wall: 1.56 s, CPU: 1.55 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.098484 MB
Blob 7 finished, total: Wall: 1.70 s, CPU: 1.67 s, VmPeak: 806 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151616 MB
Measuring 1 iterative sources
Blob 3 finished, total: Wall: 1.92 s, CPU: 1.91 s, VmPeak: 802 MB, VmSize: 731 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.151096 MB
Blob 2 finished, total: Wall: 2.27 s, CPU: 2.27 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099012 MB
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.45458, ee1=0.311259, ee2=0.344673
Blob 1 finished, total: Wall: 5.97 s, CPU: 5.96 s, VmPeak: 675 MB, VmSize: 672 MB, VmRSS: 99 MB, VmData: 143 MB, maxrss: 0.103652 MB
Old catalog: 39
New catalog: 38
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/blobs-custom-222650p41883.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/metrics/cus/all-models-custom-222650p41883.fits
Stage fitblobs : Wall: 6.33 s, CPU: 0.41 s, VmPeak: 988 MB, VmSize: 981 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.217936 MB
Stage fitblobs finished: 2020-08-05T21:18:09.977294
Resources for stage fitblobs : 27.781 s worker CPU, 27.950 s worker Wall, Wall: 6.330 s, Cores in use: 4.45, Total efficiency (on 16 cores): 27.8 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-05T21:18:09.992200
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel-z.fits.fz
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock'
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-resid.jpg
Stage coadds : Wall: 3.18 s, CPU: 1.06 s, VmPeak: 988 MB, VmSize: 981 MB, VmRSS: 213 MB, VmData: 239 MB, maxrss: 0.218388 MB
Stage coadds finished: 2020-08-05T21:18:13.171787
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage coadds : 9.300 s worker CPU, 16.105 s worker Wall, Wall: 3.181 s, Cores in use: 3.26, Total efficiency (on 16 cores): 20.4 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-coadds.p
Running stage wise_forced
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Running stage wise_forced at 2020-08-05T21:18:13.252700
Cut to 1 unWISE tiles
Reading WISE tile 2224p424 band 2
Reading WISE tile 2224p424 band 3
Reading WISE tile 2224p424 band 1
Reading WISE tile 2224p424 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 810 MB, VmSize: 810 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.192524 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 868 MB, VmSize: 868 MB, VmRSS: 208 MB, VmData: 235 MB, maxrss: 0.213396 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 805 MB, VmSize: 803 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204584 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 815 MB, VmSize: 813 MB, VmRSS: 153 MB, VmData: 181 MB, maxrss: 0.216964 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 5.79 s, CPU: 0.63 s, VmPeak: 988 MB, VmSize: 981 MB, VmRSS: 214 MB, VmData: 239 MB, maxrss: 0.2191 MB
Stage wise_forced finished: 2020-08-05T21:18:19.047095
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data]
Resources for stage wise_forced : 2.961 s worker CPU, 10.074 s worker Wall, Wall: 5.796 s, Cores in use: 0.62, Total efficiency (on 16 cores): 3.9 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-05T21:18:19.068876
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/tractor-i/cus/tractor-custom-222650p41883.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/tractor/cus/tractor-custom-222650p41883.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/tractor/cus/brick-custom-222650p41883.sha256sum
Stage writecat : Wall: 4.25 s, CPU: 1.77 s, VmPeak: 1113 MB, VmSize: 985 MB, VmRSS: 216 MB, VmData: 239 MB, maxrss: 0.352156 MB
Stage writecat finished: 2020-08-05T21:18:23.321480
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.254 s, Cores in use: 0.42, Total efficiency (on 16 cores): 2.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-writecat.p
All done: 45.849 s worker CPU, 99.806 s worker Wall, Wall: 48.419 s, Cores in use: 1.12, Total efficiency (on 16 cores): 7.0 %
Finished galaxy DR8-2227p420-92 in 0.877 minutes.
Started working on galaxy DR8-2227p420-92 at Thu Aug 13 13:32:12 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 222.650119186511 41.8835059079373 --width 303 --height 303 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-08-13T13:32:12.832272
legacypipe git version: DR9.5.11-watershed-9-g82106209
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '222.650119186511', '41.8835059079373', '--width', '303', '--height', '303', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 222.650119186511 41.8835059079373 --width 303 --height 303 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 222.650119186511 41.8835059079373
Starting process 37846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 37847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB
Starting process 37848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 37849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB
Starting process 37850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059536 MB
Starting process 37851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 37852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB
Starting process 37853 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 37854 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB
Starting process 37855 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB
Starting process 37856 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 37857 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB
Starting process 37858 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 37859 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 37860 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 37861 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB
Starting process 37862 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB
Starting process 37863 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB
Starting process 37864 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 37865 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 37866 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB
Starting process 37867 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 37868 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB
Starting process 37869 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB
Starting process 37870 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB
Starting process 37871 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 37872 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB
Starting process 37873 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB
Starting process 37874 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 37875 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 37876 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB
Starting process 37877 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-08-13T13:32:13.514043
Keeping 9 CCDs:
  k4m_160327_100831_ooi_zd_ls9-CCD3 z expnum 79033 exptime 80.105 propid 2016A-0453 seeing 0.73 MJD 57474.423 object MzLS_613675_z 
    mosaic/CP/V4.3/CP20160326/k4m_160327_100831_ooi_zd_ls9.fits.fz
  k4m_170329_101238_ooi_zd_ls9-CCD4 z expnum 117835 exptime 117.104 propid 2016A-0453 seeing 1.96 MJD 57841.425 object MzLS_612740_z 
    mosaic/CP/V4.3/CP20170328/k4m_170329_101238_ooi_zd_ls9.fits.fz
  k4m_160401_092017_ooi_zd_ls9-CCD3 z expnum 80123 exptime 80.104 propid 2016A-0453 seeing 1.30 MJD 57479.389 object MzLS_614608_z 
    mosaic/CP/V4.3/CP20160331/k4m_160401_092017_ooi_zd_ls9.fits.fz
  ksb_170223_120852_ooi_g_ls9-CCD3 g expnum 78070115 exptime 125.193 propid BASS seeing 2.43 MJD 57807.506 object 17103 
    90prime/CP/V2.3/CP20170222/ksb_170223_120852_ooi_g_ls9.fits.fz
  ksb_170324_104419_ooi_r_ls9-CCD3 r expnum 78360219 exptime 100.475 propid BASS seeing 1.69 MJD 57836.447 object 17103 
    90prime/CP/V2.3/CP20170323/ksb_170324_104419_ooi_r_ls9.fits.fz
  ksb_160403_073920_ooi_r_ls9-CCD2 r expnum 74810163 exptime 80.7 propid BASS seeing 1.24 MJD 57481.319 object 17091 
    90prime/CP/V2.3/CP20160402/ksb_160403_073920_ooi_r_ls9.fits.fz
  ksb_160213_124637_ooi_g_ls9-CCD2 g expnum 74310263 exptime 75.1 propid 2015A-0801 seeing 1.41 MJD 57431.532 object 17091 
    90prime/CP/V2.3/CP20160212/ksb_160213_124637_ooi_g_ls9.fits.fz
  ksb_160513_071009_ooi_r_ls9-CCD2 r expnum 75210114 exptime 73.7 propid BASS seeing 1.17 MJD 57521.299 object 17092 
    90prime/CP/V2.3/CP20160512/ksb_160513_071009_ooi_r_ls9.fits.fz
  ksb_170518_065258_ooi_g_ls9-CCD2 g expnum 78910061 exptime 89.73 propid 2015A-0801 seeing 1.54 MJD 57891.287 object 17092 
    90prime/CP/V2.3/CP20170517/ksb_170518_065258_ooi_g_ls9.fits.fz
mosaic get_fwhm: self.fwhm = 5.01
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 399 709 and amp range 0 2005 and image y 585 893 and amp range 0 2039
Range in image: x 0 311 , y 0 309 (with image size 311 x 309)
dzp -0.005856539 -> scaling image by 0.9946204500110131
mosaic get_fwhm: self.fwhm = 2.81
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 3108 3412 and amp range 2006 4053 and image y 274 578 and amp range 0 2039
Range in image: x 0 305 , y 0 305 (with image size 305 x 305)
dzp -0.00064781494 -> scaling image by 0.9994035183523652
Faked up EXPNUM 74810163
Faked up EXPNUM 74810163
Faked up EXPNUM 74810163
90prime get_fwhm: self.fwhm = 2.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 716 893 and amp range 0 2015 and image y 910 1089 and amp range 0 2047
Range in image: x 0 178 , y 0 180 (with image size 178 x 180)
dzp -0.006045583 -> scaling image by 0.9944472857505693
Faked up EXPNUM 78360219
Faked up EXPNUM 78360219
Faked up EXPNUM 78360219
90prime get_fwhm: self.fwhm = 3.73
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2987 3162 and amp range 2016 4031 and image y 2489 2665 and amp range 2048 4095
Range in image: x 0 176 , y 0 177 (with image size 176 x 177)
dzp -0.035697103 -> scaling image by 0.9676563679910417
Faked up EXPNUM 74310263
Faked up EXPNUM 74310263
Faked up EXPNUM 74310263
90prime get_fwhm: self.fwhm = 3.11
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 728 906 and amp range 0 2015 and image y 900 1078 and amp range 0 2047
Range in image: x 0 179 , y 0 179 (with image size 179 x 179)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 78070115
Faked up EXPNUM 78070115
Faked up EXPNUM 78070115
90prime get_fwhm: self.fwhm = 5.37
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2977 3153 and amp range 2016 4031 and image y 2494 2671 and amp range 2048 4095
Range in image: x 0 177 , y 0 178 (with image size 177 x 178)
dzp -0.02530836 -> scaling image by 0.9769597156943128
Faked up EXPNUM 75210114
Faked up EXPNUM 75210114
Faked up EXPNUM 75210114
90prime get_fwhm: self.fwhm = 2.59
Found 4 relevant rows in amp-corrections file.
Faked up EXPNUM 78910061
Faked up EXPNUM 78910061
Faked up EXPNUM 78910061
90prime get_fwhm: self.fwhm = 3.39
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 2731 2908 and amp range 2016 4031 and image y 2905 3083 and amp range 2048 4095
Range in image: x 0 178 , y 0 179 (with image size 178 x 179)
Found overlap: image x 2726 2904 and amp range 2016 4031 and image y 2897 3075 and amp range 2048 4095
dzp 0.010008041 -> scaling image by 1.0092603604948323
Range in image: x 0 179 , y 0 179 (with image size 179 x 179)
dzp 0.0002007609 -> scaling image by 1.0001849247187462
mosaic get_fwhm: self.fwhm = 7.53
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1524 1831 and amp range 0 2047 and image y 1054 1359 and amp range 0 2021
Range in image: x 0 308 , y 0 306 (with image size 308 x 306)
dzp -0.018417627 -> scaling image by 0.9831798050134541
Stage tims : Wall: 2.49 s, CPU: 0.96 s, VmPeak: 951 MB, VmSize: 951 MB, VmRSS: 174 MB, VmData: 208 MB, maxrss: 0.178492 MB
Stage tims finished: 2020-08-13T13:32:16.000890
Resources for stage tims : 4.732 s worker CPU, 9.869 s worker Wall, Wall: 2.489 s, Cores in use: 2.29, Total efficiency (on 32 cores): 7.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-08-13T13:32:16.023960
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02191.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-01936.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02062.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02063.fits
Matched 2 large galaxies to Gaia stars.
Matched 0 large galaxies to Tycho-2 stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/reference-custom-222650p41883.fits
Stage refs : Wall: 1.91 s, CPU: 1.58 s, VmPeak: 981 MB, VmSize: 965 MB, VmRSS: 189 MB, VmData: 222 MB, maxrss: 0.193972 MB
Stage refs finished: 2020-08-13T13:32:17.931430
Resources for stage refs : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 1.910 s, Cores in use: 0.83, Total efficiency (on 32 cores): 2.6 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-08-13T13:32:17.953199
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/outlier-mask-custom-222650p41883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/outliers-pre-custom-222650p41883.jpg
Image k4m_170329_101238_ooi_zd_ls9-CCD4 z : masking 0 positive outlier pixels and 130 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/outlier-mask-custom-222650p41883.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/outliers-post-custom-222650p41883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/outliers-masked-pos-custom-222650p41883.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/outliers-masked-neg-custom-222650p41883.jpg
Stage outliers : Wall: 1.01 s, CPU: 0.64 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 208 MB, VmData: 238 MB, maxrss: 0.21324 MB
Stage outliers finished: 2020-08-13T13:32:18.967418
Resources for stage outliers : 0.917 s worker CPU, 1.182 s worker Wall, Wall: 1.017 s, Cores in use: 1.53, Total efficiency (on 32 cores): 4.8 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-08-13T13:32:19.056992
Stage halos : Wall: 0.28 s, CPU: 0.28 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 208 MB, VmData: 238 MB, maxrss: 0.213304 MB
Stage halos finished: 2020-08-13T13:32:19.339120
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.284 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-halos.p
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-08-13T13:32:19.362982
PSF sigmas in coadd pixels: ['3.95', '2.29', '2.50']
Using average PSF sigma 2.9126628391385636
Gaussian PSF norm 0.09685116587586542 vs pixelized 0.081291385
average tim pixel scale / coadd scale: 1.7299480338133018
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.75', '2.01', '1.91']
Using average PSF sigma 2.2207094857479954
Gaussian PSF norm 0.127029129016784 vs pixelized 0.10138666
average tim pixel scale / coadd scale: 1.7299229734157788
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.18', '3.18', '2.11']
Using average PSF sigma 2.1576214709928356
Gaussian PSF norm 0.13074341146784726 vs pixelized 0.12453872
average tim pixel scale / coadd scale: 0.9909492694303563
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.19 s, CPU: 0.18 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 210 MB, VmData: 238 MB, maxrss: 0.215224 MB
Stage fit_on_coadds finished: 2020-08-13T13:32:19.555013
Resources for stage fit_on_coadds : 0.185 s worker CPU, 0.185 s worker Wall, Wall: 0.194 s, Cores in use: 1.90, Total efficiency (on 32 cores): 6.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-08-13T13:32:19.567603
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 25 potential peaks
Of 25 potential peaks: 1 in veto map, 0 cut by saddle test, 0 cut by aper test, 24 kept
SED z : 24 new peaks
Found 22 potential peaks
Of 22 potential peaks: 20 in veto map, 0 cut by saddle test, 0 cut by aper test, 2 kept
SED r : 2 new peaks
Found 17 potential peaks
Of 17 potential peaks: 13 in veto map, 1 cut by saddle test, 0 cut by aper test, 3 kept
SED g : 3 new peaks
Found 39 potential peaks
Of 39 potential peaks: 29 in veto map, 4 cut by saddle test, 0 cut by aper test, 6 kept
SED Flat : 6 new peaks
Found 41 potential peaks
Of 41 potential peaks: 35 in veto map, 4 cut by saddle test, 0 cut by aper test, 2 kept
SED Red : 2 new peaks
Adding 37 new sources
Median coadd sky for g : 5.447449e-05
Median coadd sky for r : 9.930912e-05
Median coadd sky for z : 0.00019563812
Stage srcs : Wall: 0.54 s, CPU: 0.50 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.215616 MB
Stage srcs finished: 2020-08-13T13:32:20.105965
Resources for stage srcs : 0.099 s worker CPU, 0.099 s worker Wall, Wall: 0.541 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-08-13T13:32:20.130000
Blob 1 of 25, id: 8, sources: 4, size: 85x116, npix 6231, brick X: 114,199, Y: 90,206, one pixel: 160 90
Blob 2 of 25, id: 3, sources: 3, size: 78x53, npix 2204, brick X: 81,159, Y: 22,75, one pixel: 91 22
Blob 3 of 25, id: 0, sources: 4, size: 49x47, npix 1364, brick X: 151,200, Y: 0,47, one pixel: 171 0
Blob 4 of 25, id: 6, sources: 2, size: 48x33, npix 933, brick X: 87,135, Y: 79,112, one pixel: 120 79
Blob 5 of 25, id: 23, sources: 2, size: 61x21, npix 925, brick X: 185,246, Y: 282,303, one pixel: 224 282
Blob 6 of 25, id: 7, sources: 2, size: 41x40, npix 881, brick X: 248,289, Y: 89,129, one pixel: 276 89
Blob 7 of 25, id: 21, sources: 2, size: 30x46, npix 811, brick X: 52,82, Y: 248,294, one pixel: 70 248
Blob 8 of 25, id: 9, sources: 2, size: 45x34, npix 781, brick X: 8,53, Y: 91,125, one pixel: 18 91
Blob 9 of 25, id: 14, sources: 1, size: 29x36, npix 646, brick X: 0,29, Y: 174,210, one pixel: 11 174
Blob 10 of 25, id: 13, sources: 1, size: 28x26, npix 504, brick X: 73,101, Y: 134,160, one pixel: 83 134
Blob 11 of 25, id: 16, sources: 1, size: 27x27, npix 462, brick X: 188,215, Y: 196,223, one pixel: 201 196
Blob 12 of 25, id: 22, sources: 1, size: 28x23, npix 454, brick X: 121,149, Y: 280,303, one pixel: 132 280
Blob 13 of 25, id: 1, sources: 1, size: 30x21, npix 444, brick X: 247,277, Y: 0,21, one pixel: 251 0
Blob 14 of 25, id: 12, sources: 1, size: 26x26, npix 420, brick X: 35,61, Y: 131,157, one pixel: 46 131
Blob 15 of 25, id: 24, sources: 1, size: 31x18, npix 411, brick X: 250,281, Y: 285,303, one pixel: 262 285
Blob 16 of 25, id: 19, sources: 1, size: 28x27, npix 397, brick X: 233,261, Y: 223,250, one pixel: 242 223
Blob 17 of 25, id: 10, sources: 1, size: 22x23, npix 323, brick X: 212,234, Y: 111,134, one pixel: 222 111
Blob 18 of 25, id: 4, sources: 1, size: 17x25, npix 297, brick X: 286,303, Y: 53,78, one pixel: 296 53
Blob 19 of 25, id: 5, sources: 1, size: 22x21, npix 271, brick X: 222,244, Y: 60,81, one pixel: 231 60
Blob 20 of 25, id: 11, sources: 1, size: 19x21, npix 235, brick X: 284,303, Y: 129,150, one pixel: 294 129
Blob 21 of 25, id: 15, sources: 1, size: 20x20, npix 229, brick X: 224,244, Y: 194,214, one pixel: 233 194
Blob 22 of 25, id: 20, sources: 1, size: 20x20, npix 229, brick X: 141,161, Y: 245,265, one pixel: 150 245
Blob 23 of 25, id: 18, sources: 1, size: 20x19, npix 209, brick X: 25,45, Y: 207,226, one pixel: 34 207
Blob 24 of 25, id: 17, sources: 1, size: 19x19, npix 199, brick X: 77,96, Y: 204,223, one pixel: 86 204
Blob 25 of 25, id: 2, sources: 1, size: 18x17, npix 162, brick X: 56,74, Y: 9,26, one pixel: 64 9
Blob 25 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 91 MB, VmData: 142 MB, maxrss: 0.092736 MB
Blob 19 finished, total: Wall: 0.16 s, CPU: 0.15 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.09434 MB
Blob 21 finished, total: Wall: 0.28 s, CPU: 0.27 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094508 MB
Measuring 1 iterative sources
Blob 23 finished, total: Wall: 0.30 s, CPU: 0.30 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 94 MB, VmData: 142 MB, maxrss: 0.09656 MB
Blob 22 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147448 MB
Blob 11 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 791 MB, VmSize: 724 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146488 MB
Blob 20 finished, total: Wall: 0.39 s, CPU: 0.38 s, VmPeak: 809 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 183 MB, maxrss: 0.14558 MB
Blob 16 finished, total: Wall: 0.40 s, CPU: 0.39 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.09334 MB
Blob 24 finished, total: Wall: 0.52 s, CPU: 0.51 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 93 MB, VmData: 141 MB, maxrss: 0.09562 MB
Blob 14 finished, total: Wall: 0.56 s, CPU: 0.55 s, VmPeak: 802 MB, VmSize: 725 MB, VmRSS: 143 MB, VmData: 183 MB, maxrss: 0.1469 MB
Blob 17 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 672 MB, VmSize: 672 MB, VmRSS: 97 MB, VmData: 143 MB, maxrss: 0.098952 MB
Blob 8 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.092716 MB
Blob 10 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 95 MB, VmData: 142 MB, maxrss: 0.097496 MB
Blob 13 finished, total: Wall: 0.70 s, CPU: 0.70 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 139 MB, maxrss: 0.094368 MB
Blob 4 finished, total: Wall: 0.76 s, CPU: 0.76 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 92 MB, VmData: 140 MB, maxrss: 0.094152 MB
Blob 5 finished, total: Wall: 0.77 s, CPU: 0.77 s, VmPeak: 668 MB, VmSize: 668 MB, VmRSS: 91 MB, VmData: 139 MB, maxrss: 0.093436 MB
Measuring 1 iterative sources
Blob 18 finished, total: Wall: 0.85 s, CPU: 0.84 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 92 MB, VmData: 138 MB, maxrss: 0.094336 MB
Blob 12 finished, total: Wall: 0.90 s, CPU: 0.90 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 91 MB, VmData: 138 MB, maxrss: 0.093172 MB
Measuring 1 iterative sources
Blob 15 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 667 MB, VmSize: 667 MB, VmRSS: 93 MB, VmData: 139 MB, maxrss: 0.094944 MB
Blob 6 finished, total: Wall: 1.05 s, CPU: 1.05 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 94 MB, VmData: 141 MB, maxrss: 0.096132 MB
Blob 7 finished, total: Wall: 1.13 s, CPU: 1.13 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 94 MB, VmData: 140 MB, maxrss: 0.09648 MB
Blob 9 finished, total: Wall: 1.37 s, CPU: 1.37 s, VmPeak: 805 MB, VmSize: 725 MB, VmRSS: 145 MB, VmData: 183 MB, maxrss: 0.14818 MB
Blob 3 finished, total: Wall: 1.61 s, CPU: 1.60 s, VmPeak: 807 MB, VmSize: 725 MB, VmRSS: 144 MB, VmData: 183 MB, maxrss: 0.147632 MB
Measuring 1 iterative sources
Blob 2 finished, total: Wall: 2.08 s, CPU: 2.08 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.099316 MB
Reference source: ExpGalaxy at RaDecPos: RA, Dec = (222.65037, 41.88408) with NanoMaggies: g=18.2, r=17.4, z=17 and EllipseWithPriors(0.25): log r_e=1.50735, ee1=0.297283, ee2=0.342769
  cat entry: tabledata object with 1 rows and 62 columns
  cat entry: tabledata object with 2 rows and 62 columns
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.50735, ee1=0.297283, ee2=0.342769
Blob 1 finished, total: Wall: 5.66 s, CPU: 5.65 s, VmPeak: 807 MB, VmSize: 728 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.1503 MB
Old catalog: 39
New catalog: 38
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/blobs-custom-222650p41883.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/metrics/cus/all-models-custom-222650p41883.fits
Stage fitblobs : Wall: 6.03 s, CPU: 0.44 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.215988 MB
Stage fitblobs finished: 2020-08-13T13:32:26.161719
Resources for stage fitblobs : 23.405 s worker CPU, 23.594 s worker Wall, Wall: 6.034 s, Cores in use: 3.95, Total efficiency (on 32 cores): 12.4 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-08-13T13:32:26.177376
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-resid.jpg
Stage coadds : Wall: 2.03 s, CPU: 0.62 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 211 MB, VmData: 238 MB, maxrss: 0.216468 MB
Stage coadds finished: 2020-08-13T13:32:28.205412
Resources for stage coadds : 27.033 s worker CPU, 28.281 s worker Wall, Wall: 2.030 s, Cores in use: 13.62, Total efficiency (on 32 cores): 42.6 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-08-13T13:32:28.224427
Cut to 1 unWISE tiles
Reading WISE tile 2224p424 band 1
Reading WISE tile 2224p424 band 2
Reading WISE tile 2224p424 band 3
Reading WISE tile 2224p424 band 4
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 806 MB, VmSize: 797 MB, VmRSS: 142 MB, VmData: 175 MB, maxrss: 0.183292 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 792 MB, VmRSS: 136 MB, VmData: 170 MB, maxrss: 0.198264 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 809 MB, VmSize: 797 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.204152 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/222/2224p424/unwise-2224p424-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 808 MB, VmSize: 806 MB, VmRSS: 150 MB, VmData: 180 MB, maxrss: 0.212752 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/tmp-legacysurvey-custom-222650p41883-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 4.91 s, CPU: 1.02 s, VmPeak: 981 MB, VmSize: 975 MB, VmRSS: 212 MB, VmData: 238 MB, maxrss: 0.217176 MB
Stage wise_forced finished: 2020-08-13T13:32:33.132770
Resources for stage wise_forced : 3.248 s worker CPU, 4.310 s worker Wall, Wall: 4.911 s, Cores in use: 0.87, Total efficiency (on 32 cores): 2.7 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-08-13T13:32:33.149893
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/coadd/cus/custom-222650p41883/legacysurvey-custom-222650p41883-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/tractor-i/cus/tractor-custom-222650p41883.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/tractor/cus/tractor-custom-222650p41883.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/tractor/cus/brick-custom-222650p41883.sha256sum
Stage writecat : Wall: 3.16 s, CPU: 0.58 s, VmPeak: 1107 MB, VmSize: 979 MB, VmRSS: 214 MB, VmData: 238 MB, maxrss: 0.350188 MB
Stage writecat finished: 2020-08-13T13:32:36.310182
Resources for stage writecat : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 3.162 s, Cores in use: 0.18, Total efficiency (on 32 cores): 0.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/222/DR8-2227p420-92/DR8-2227p420-92-largegalaxy-writecat.p
All done: 59.625 s worker CPU, 67.527 s worker Wall, Wall: 23.071 s, Cores in use: 2.89, Total efficiency (on 32 cores): 9.0 %
Finished galaxy DR8-2227p420-92 in 0.410 minutes.