Started working on galaxy PGC2612610 at Sun Jun  7 18:57:10 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 297.3672915 61.138722200000004 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-06-07T18:57:11.841489
legacypipe git version: DR9.5.2
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '297.3672915', '61.138722200000004', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '4', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--write-stage', 'tims', '--write-stage', 'srcs', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 297.3672915 61.138722200000004 --width 287 --height 287 --pixscale 0.262 --threads 4 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --write-stage tims --write-stage srcs --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 297.3672915 61.138722200000004
Starting process 44162 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 44164 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 44166 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057304 MB
Starting process 44171 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 632 MB, VmSize: 632 MB, VmRSS: 56 MB, VmData: 127 MB, maxrss: 0.057308 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-06-07T18:57:12.457763
Keeping 4 CCDs:
   k4m_171110_045053_ooi_zd_ls9.fits.fz k4m_171110_045053_ooi_zd_ls9-CCD3 z exptime 127.106 propid 2016A-0453 seeing 0.90 MJD 58067.202 object MzLS_690686_z
   k4m_160607_112507_ooi_zd_ls9.fits.fz k4m_160607_112507_ooi_zd_ls9-CCD3 z exptime 89.105 propid 2016A-0453 seeing 0.99 MJD 57546.476 object MzLS_690686_z
   ksb_160703_103137_ooi_g_ls9.fits.fz ksb_160703_103137_ooi_g_ls9-CCD2 g exptime 128.9 propid BASS seeing 1.58 MJD 57572.439 object 65072
   ksb_180523_103259_ooi_r_ls9.fits.fz ksb_180523_103259_ooi_r_ls9-CCD2 r exptime 99.509 propid NOTBASS seeing 1.42 MJD 58261.440 object 65072
Faked up EXPNUM 82610133
Faked up EXPNUM 82610133
Faked up EXPNUM 82610133
90prime get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 664 832 and amp range 0 2015 and image y 15 48 and amp range 0 2047
Range in image: x 0 169 , y 0 34 (with image size 169 x 34)
dzp -0.003875085 -> scaling image by 0.9964372765054066
Faked up EXPNUM 75720117
Faked up EXPNUM 75720117
Faked up EXPNUM 75720117
90prime get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 660 827 and amp range 0 2015 and image y 15 57 and amp range 0 2047
Range in image: x 0 168 , y 0 43 (with image size 168 x 43)
dzp -0.008523628 -> scaling image by 0.992180183483648
mosaic get_fwhm: self.fwhm = 3.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1776 2068 and amp range 0 2005 and image y 2377 2673 and amp range 2040 4078
Range in image: x 0 230 , y 0 297 (with image size 293 x 297)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
Found overlap: image x 1776 2068 and amp range 2006 4053 and image y 2377 2673 and amp range 2040 4078
Range in image: x 230 293 , y 0 297 (with image size 293 x 297)
dzp -0.0026360443 -> scaling image by 0.99757505842151
mosaic get_fwhm: self.fwhm = 3.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1784 2077 and amp range 0 2005 and image y 2400 2697 and amp range 2040 4078
Range in image: x 0 222 , y 0 298 (with image size 294 x 298)
dzp 0.01523814 -> scaling image by 1.014133796220052
Found overlap: image x 1784 2077 and amp range 2006 4053 and image y 2400 2697 and amp range 2040 4078
Range in image: x 222 294 , y 0 298 (with image size 294 x 298)
dzp 0.0056365696 -> scaling image by 1.005204971477435
Stage tims : Wall: 3.83 s, CPU: 1.02 s, VmPeak: 940 MB, VmSize: 940 MB, VmRSS: 168 MB, VmData: 202 MB, maxrss: 0.56658 MB
Stage tims finished: 2020-06-07T18:57:16.290250
Resources for stage tims : 2.684 s worker CPU, 6.960 s worker Wall, Wall: 3.834 s, Cores in use: 0.97, Total efficiency (on 4 cores): 24.2 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-06-07T18:57:16.305200
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00825.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00826.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00746.fits
Matched 1 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/reference-custom-297367p61138.fits
Stage refs : Wall: 10.27 s, CPU: 8.74 s, VmPeak: 1038 MB, VmSize: 1031 MB, VmRSS: 262 MB, VmData: 293 MB, maxrss: 0.56658 MB
Stage refs finished: 2020-06-07T18:57:26.579734
Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.276 s, Cores in use: 0.85, Total efficiency (on 4 cores): 21.3 %
Stage refs finished
Running stage outliers
Running stage outliers at 2020-06-07T18:57:26.581403
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outlier-mask-custom-297367p61138.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-pre-custom-297367p61138.jpg
Image k4m_160607_112507_ooi_zd_ls9-CCD3 z : masking 252 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outlier-mask-custom-297367p61138.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-post-custom-297367p61138.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-masked-pos-custom-297367p61138.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-masked-neg-custom-297367p61138.jpg
Stage outliers : Wall: 0.89 s, CPU: 0.67 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 272 MB, VmData: 301 MB, maxrss: 0.56658 MB
Stage outliers finished: 2020-06-07T18:57:27.468985
Resources for stage outliers : 0.300 s worker CPU, 0.300 s worker Wall, Wall: 0.889 s, Cores in use: 1.09, Total efficiency (on 4 cores): 27.2 %
Stage outliers finished
Running stage halos
Running stage halos at 2020-06-07T18:57:27.470682
Stage halos : Wall: 0.31 s, CPU: 0.29 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 272 MB, VmData: 301 MB, maxrss: 0.56658 MB
Stage halos finished: 2020-06-07T18:57:27.778530
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.309 s, Cores in use: 0.95, Total efficiency (on 4 cores): 23.7 %
Stage halos finished
Running stage fit_on_coadds
Running stage fit_on_coadds at 2020-06-07T18:57:27.780308
PSF sigmas in coadd pixels: ['2.57']
Using average PSF sigma 2.568556150491773
Gaussian PSF norm 0.1098262117882331 vs pixelized 0.106445566
average tim pixel scale / coadd scale: 1.7295435350032822
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.31']
Using average PSF sigma 2.3052837360294136
Gaussian PSF norm 0.12236879450672482 vs pixelized 0.106325306
average tim pixel scale / coadd scale: 1.730804019678697
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.45', '1.61']
Using average PSF sigma 1.534907996287446
Gaussian PSF norm 0.1837861242864029 vs pixelized 0.15722632
average tim pixel scale / coadd scale: 0.99094670340561
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.10 s, CPU: 0.09 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 274 MB, VmData: 301 MB, maxrss: 0.56658 MB
Stage fit_on_coadds finished: 2020-06-07T18:57:27.881126
Resources for stage fit_on_coadds : 0.061 s worker CPU, 0.062 s worker Wall, Wall: 0.102 s, Cores in use: 1.49, Total efficiency (on 4 cores): 37.1 %
Stage fit_on_coadds finished
Running stage srcs
Running stage srcs at 2020-06-07T18:57:27.883352
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 35 potential peaks
Of 35 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 24 kept
SED z : 24 new peaks
Found 57093 potential peaks
Of 57093 potential peaks: 57092 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 52312 potential peaks
Of 52312 potential peaks: 52311 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 831 potential peaks
Of 831 potential peaks: 830 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 840 potential peaks
Of 840 potential peaks: 839 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 24 new sources
Median coadd sky for g : -4.2328047e-05
Median coadd sky for r : -0.000101119265
Median coadd sky for z : -0.0002897439
Stage srcs : Wall: 2.62 s, CPU: 0.57 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 274 MB, VmData: 301 MB, maxrss: 0.56658 MB
Stage srcs finished: 2020-06-07T18:57:30.506374
Resources for stage srcs : 3.906 s worker CPU, 3.906 s worker Wall, Wall: 2.624 s, Cores in use: 1.70, Total efficiency (on 4 cores): 42.6 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-06-07T18:57:30.523443
Blob 1 of 3, id: 0, sources: 41, size: 283x287, npix 72780, brick X: 0,283, Y: 0,287, one pixel: 0 0
Blob 2 of 3, id: 1, sources: 4, size: 36x54, npix 1411, brick X: 251,287, Y: 189,243, one pixel: 272 189
Blob 3 of 3, id: 2, sources: 1, size: 14x22, npix 205, brick X: 273,287, Y: 259,281, one pixel: 282 259
Blob 3 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 796 MB, VmSize: 712 MB, VmRSS: 138 MB, VmData: 178 MB, maxrss: 0.14124 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.33678, 61.14302), pm (-3.2, 34.4), parallax 5.034 with NanoMaggies: g=20.6, r=19.1, z=16.8
Reset brightness to NanoMaggies: g=20.6, r=19.1, z=16.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.34435, 61.14442), pm (-2.6, -2.9), parallax 0.945 with NanoMaggies: g=20.4, r=(flux -44.1), z=(flux -72.1)
Reset brightness to NanoMaggies: g=20.8, r=20.2, z=20
Blob 2 finished, total: Wall: 2.33 s, CPU: 2.33 s, VmPeak: 801 MB, VmSize: 712 MB, VmRSS: 140 MB, VmData: 178 MB, maxrss: 0.14294 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.59093, 61.20924), pm (-25.2, 39.2), parallax 17.479 with NanoMaggies: g=6.81, r=6.52, z=6.47
Reset brightness to NanoMaggies: g=6.81, r=6.52, z=6.47
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.40169, 61.13840), pm (-7.1, -8.9), parallax 0.885 with NanoMaggies: g=12.5, r=11.7, z=11.4
Reset brightness to NanoMaggies: g=12.5, r=11.7, z=11.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.36429, 61.17700), pm (-5.2, -4.3), parallax 0.277 with NanoMaggies: g=13.3, r=12.1, z=11.5
Reset brightness to NanoMaggies: g=13.3, r=12.1, z=11.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.42540, 61.12454), pm (-3.4, -3.6), parallax 0.873 with NanoMaggies: g=13.8, r=13.4, z=13.3
Reset brightness to NanoMaggies: g=13.8, r=13.4, z=13.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.40591, 61.13934), pm (-0.9, -4.5), parallax 0.571 with NanoMaggies: g=15.4, r=15, z=14.8
Reset brightness to NanoMaggies: g=15.4, r=15, z=14.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.35383, 61.15376), pm (-8.6, -14.8), parallax 1.336 with NanoMaggies: g=16.6, r=15.7, z=15.3
Reset brightness to NanoMaggies: g=16.6, r=15.7, z=15.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.35579, 61.12821), pm (-6.1, -0.4), parallax 3.115 with NanoMaggies: g=18.3, r=(flux -1.09e+03), z=15.6
Reset brightness to NanoMaggies: g=17.9, r=16.5, z=15.2
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.81369, ee1=0.538832, ee2=0.319119
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.36024, 61.15108), pm (-4.2, -2.0), parallax 0.331 with NanoMaggies: g=(flux -2.36e+10), r=17.2, z=17.2
Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39651, 61.14458), pm (-4.9, 6.1), parallax 0.442 with NanoMaggies: g=18, r=17.4, z=17.1
Reset brightness to NanoMaggies: g=18, r=17.4, z=17.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39068, 61.14957), pm (2.8, -3.9), parallax 0.485 with NanoMaggies: g=21.4, r=19.9, z=16.6
Reset brightness to NanoMaggies: g=21.4, r=19.9, z=18.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39050, 61.13561), pm (-1.8, -1.7), parallax -0.090 with NanoMaggies: g=20.2, r=19.5, z=17.9
Reset brightness to NanoMaggies: g=20.2, r=19.5, z=19.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39077, 61.13613), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.2, r=20.2, z=(flux -7.43)
Reset brightness to NanoMaggies: g=21.2, r=20.2, z=19.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.36362, 61.12756), pm (-4.2, -3.7), parallax -1.076 with NanoMaggies: g=20.8, r=20.2, z=22.2
Reset brightness to NanoMaggies: g=20.8, r=20.2, z=20
Blob 1 finished, total: Wall: 17.10 s, CPU: 17.10 s, VmPeak: 800 MB, VmSize: 722 MB, VmRSS: 155 MB, VmData: 187 MB, maxrss: 0.181764 MB
Old catalog: 48
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/blobs-custom-297367p61138.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/all-models-custom-297367p61138.fits
Stage fitblobs : Wall: 17.61 s, CPU: 0.40 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 277 MB, VmData: 303 MB, maxrss: 0.56658 MB
Stage fitblobs finished: 2020-06-07T18:57:48.130097
Resources for stage fitblobs : 19.917 s worker CPU, 19.993 s worker Wall, Wall: 17.608 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.9 %
Stage fitblobs finished
Running stage coadds
Running stage coadds at 2020-06-07T18:57:48.132520
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-resid.jpg
Stage coadds : Wall: 5.08 s, CPU: 0.78 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.56658 MB
Stage coadds finished: 2020-06-07T18:57:53.211050
Resources for stage coadds : 6.058 s worker CPU, 6.159 s worker Wall, Wall: 5.080 s, Cores in use: 1.35, Total efficiency (on 4 cores): 33.7 %
Stage coadds finished
Running stage wise_forced
Running stage wise_forced at 2020-06-07T18:57:53.212698
Cut to 1 unWISE tiles
Reading WISE tile 2970p605 band 3
Reading WISE tile 2970p605 band 4
Reading WISE tile 2970p605 band 2
Reading WISE tile 2970p605 band 1
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 800 MB, VmSize: 798 MB, VmRSS: 155 MB, VmData: 180 MB, maxrss: 0.201908 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 801 MB, VmSize: 788 MB, VmRSS: 141 MB, VmData: 169 MB, maxrss: 0.205096 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 796 MB, VmSize: 792 MB, VmRSS: 144 MB, VmData: 174 MB, maxrss: 0.207392 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 796 MB, VmSize: 787 MB, VmRSS: 140 MB, VmData: 173 MB, maxrss: 0.202952 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 2.64 s, CPU: 0.52 s, VmPeak: 1041 MB, VmSize: 1041 MB, VmRSS: 281 MB, VmData: 307 MB, maxrss: 0.56658 MB
Stage wise_forced finished: 2020-06-07T18:57:55.851735
Resources for stage wise_forced : 4.177 s worker CPU, 6.151 s worker Wall, Wall: 2.640 s, Cores in use: 1.78, Total efficiency (on 4 cores): 44.5 %
Stage wise_forced finished
Running stage writecat
Running stage writecat at 2020-06-07T18:57:55.853588
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/tractor-i/cus/tractor-custom-297367p61138.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/tractor/cus/tractor-custom-297367p61138.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/tractor/cus/brick-custom-297367p61138.sha256sum
Stage writecat : Wall: 0.75 s, CPU: 0.49 s, VmPeak: 1173 MB, VmSize: 1045 MB, VmRSS: 283 MB, VmData: 307 MB, maxrss: 0.56658 MB
Stage writecat finished: 2020-06-07T18:57:56.605044
Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.752 s, Cores in use: 0.65, Total efficiency (on 4 cores): 16.3 %
Stage writecat finished
All done: 37.105 s worker CPU, 43.534 s worker Wall, Wall: 44.152 s, Cores in use: 1.15, Total efficiency (on 4 cores): 28.7 %
Finished galaxy PGC2612610 in 0.773 minutes.
Started working on galaxy PGC2612610 at Sat Jul 18 20:19:30 2020
Bands touching this brick, g r z
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 297.3672915 61.138722200000004 --width 287 --height 287 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 

runbrick.py starting at 2020-07-18T20:19:30.655293
legacypipe git version: DR9.5.5-6-g531bd718
Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '297.3672915', '61.138722200000004', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'north', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0']
python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 297.3672915 61.138722200000004 --width 287 --height 287 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run north --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0

Parsed RA,Dec 297.3672915 61.138722200000004
Starting process 57662 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058848 MB
Starting process 57663 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 57664 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 57665 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB
Starting process 57666 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059148 MB
Starting process 57667 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.059152 MB
Starting process 57668 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 57669 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 57670 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 57671 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 57672 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.05886 MB
Starting process 57673 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058864 MB
Starting process 57674 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 57675 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 57676 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 57 MB, VmData: 128 MB, maxrss: 0.058872 MB
Starting process 57677 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 57678 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 57679 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.05888 MB
Starting process 57680 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 57681 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 57682 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058884 MB
Starting process 57683 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 57684 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058888 MB
Starting process 57685 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058896 MB
Starting process 57686 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 57687 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 57688 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 57689 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.0589 MB
Starting process 57690 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 57691 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058904 MB
Starting process 57692 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058908 MB
Starting process 57693 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 635 MB, VmSize: 635 MB, VmRSS: 58 MB, VmData: 128 MB, maxrss: 0.058912 MB
Runstage writecat
Runstage wise_forced
Runstage coadds
Runstage fitblobs
Runstage srcs
Runstage fit_on_coadds
Runstage halos
Runstage outliers
Runstage refs
Runstage tims
Running stage tims
Running stage tims at 2020-07-18T20:19:31.289456
Keeping 4 CCDs:
   k4m_171110_045053_ooi_zd_ls9.fits.fz k4m_171110_045053_ooi_zd_ls9-CCD3 z exptime 127.106 propid 2016A-0453 seeing 0.90 MJD 58067.202 object MzLS_690686_z
   k4m_160607_112507_ooi_zd_ls9.fits.fz k4m_160607_112507_ooi_zd_ls9-CCD3 z exptime 89.105 propid 2016A-0453 seeing 0.99 MJD 57546.476 object MzLS_690686_z
   ksb_160703_103137_ooi_g_ls9.fits.fz ksb_160703_103137_ooi_g_ls9-CCD2 g exptime 128.9 propid BASS seeing 1.58 MJD 57572.439 object 65072
   ksb_180523_103259_ooi_r_ls9.fits.fz ksb_180523_103259_ooi_r_ls9-CCD2 r exptime 99.509 propid NOTBASS seeing 1.42 MJD 58261.440 object 65072
mosaic get_fwhm: self.fwhm = 3.45
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1784 2077 and amp range 0 2005 and image y 2400 2697 and amp range 2040 4078
Range in image: x 0 222 , y 0 298 (with image size 294 x 298)
dzp 0.01523814 -> scaling image by 1.014133796220052
Found overlap: image x 1784 2077 and amp range 2006 4053 and image y 2400 2697 and amp range 2040 4078
Range in image: x 222 294 , y 0 298 (with image size 294 x 298)
dzp 0.0056365696 -> scaling image by 1.005204971477435
Faked up EXPNUM 75720117
Faked up EXPNUM 75720117
Faked up EXPNUM 75720117
90prime get_fwhm: self.fwhm = 3.49
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 660 827 and amp range 0 2015 and image y 15 57 and amp range 0 2047
Range in image: x 0 168 , y 0 43 (with image size 168 x 43)
dzp -0.008523628 -> scaling image by 0.992180183483648
Faked up EXPNUM 82610133
Faked up EXPNUM 82610133
Faked up EXPNUM 82610133
90prime get_fwhm: self.fwhm = 3.13
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 664 832 and amp range 0 2015 and image y 15 48 and amp range 0 2047
Range in image: x 0 169 , y 0 34 (with image size 169 x 34)
dzp -0.003875085 -> scaling image by 0.9964372765054066
mosaic get_fwhm: self.fwhm = 3.83
Found 4 relevant rows in amp-corrections file.
Found overlap: image x 1776 2068 and amp range 0 2005 and image y 2377 2673 and amp range 2040 4078
Range in image: x 0 230 , y 0 297 (with image size 293 x 297)
dzp 0.0022078273 -> scaling image by 1.0020355530120029
Found overlap: image x 1776 2068 and amp range 2006 4053 and image y 2377 2673 and amp range 2040 4078
Range in image: x 230 293 , y 0 297 (with image size 293 x 297)
dzp -0.0026360443 -> scaling image by 0.99757505842151
Stage tims : Wall: 2.44 s, CPU: 0.93 s, VmPeak: 943 MB, VmSize: 943 MB, VmRSS: 170 MB, VmData: 204 MB, maxrss: 0.220064 MB
Stage tims finished: 2020-07-18T20:19:33.725203
Resources for stage tims : 1.816 s worker CPU, 4.533 s worker Wall, Wall: 2.439 s, Cores in use: 1.13, Total efficiency (on 32 cores): 3.5 %
Stage tims finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-tims.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-tims.p
Running stage refs
Running stage refs at 2020-07-18T20:19:33.740019
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00825.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00826.fits
Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-00746.fits
Matched 1 large galaxies to Gaia stars.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/reference-custom-297367p61138.fits
Stage refs : Wall: 8.33 s, CPU: 7.74 s, VmPeak: 1041 MB, VmSize: 1035 MB, VmRSS: 265 MB, VmData: 296 MB, maxrss: 0.270088 MB
Stage refs finished: 2020-07-18T20:19:42.072276
Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 8.335 s, Cores in use: 0.93, Total efficiency (on 32 cores): 2.9 %
Stage refs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-refs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-refs.p
Running stage outliers
Running stage outliers at 2020-07-18T20:19:42.087004
Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outlier-mask-custom-297367p61138.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-pre-custom-297367p61138.jpg
Image k4m_160607_112507_ooi_zd_ls9-CCD3 z : masking 252 positive outlier pixels and 0 negative outlier pixels
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outlier-mask-custom-297367p61138.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-post-custom-297367p61138.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-masked-pos-custom-297367p61138.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/outliers-masked-neg-custom-297367p61138.jpg
Stage outliers : Wall: 9.22 s, CPU: 0.60 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 274 MB, VmData: 303 MB, maxrss: 0.280552 MB
Stage outliers finished: 2020-07-18T20:19:51.307171
Resources for stage outliers : 0.339 s worker CPU, 0.395 s worker Wall, Wall: 9.223 s, Cores in use: 0.10, Total efficiency (on 32 cores): 0.3 %
Stage outliers finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-outliers.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-outliers.p
Running stage halos
Running stage halos at 2020-07-18T20:19:52.969252
Stage halos : Wall: 0.45 s, CPU: 0.43 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 274 MB, VmData: 303 MB, maxrss: 0.280656 MB
Stage halos finished: 2020-07-18T20:19:53.419647
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage halos : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.453 s, Cores in use: 0.95, Total efficiency (on 32 cores): 3.0 %
Stage halos finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-halos.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-halos.p
Running stage fit_on_coadds
Warning: Stellar halo subtraction is only implemented for DECam
Warning: Stellar halo subtraction is only implemented for DECam
Running stage fit_on_coadds at 2020-07-18T20:19:55.425066
PSF sigmas in coadd pixels: ['2.57']
Using average PSF sigma 2.568556150491773
Gaussian PSF norm 0.1098262117882331 vs pixelized 0.106445566
average tim pixel scale / coadd scale: 1.7295435350032822
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-copsf-g.fits.fz
PSF sigmas in coadd pixels: ['2.31']
Using average PSF sigma 2.3052837360294136
Gaussian PSF norm 0.12236879450672482 vs pixelized 0.106325306
average tim pixel scale / coadd scale: 1.730804019678697
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-copsf-r.fits.fz
PSF sigmas in coadd pixels: ['1.45', '1.61']
Using average PSF sigma 1.534907996287446
Gaussian PSF norm 0.1837861242864029 vs pixelized 0.15722632
average tim pixel scale / coadd scale: 0.99094670340561
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-copsf-z.fits.fz
Stage fit_on_coadds : Wall: 0.43 s, CPU: 0.07 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 276 MB, VmData: 303 MB, maxrss: 0.282136 MB
Stage fit_on_coadds finished: 2020-07-18T20:19:55.854321
Warning: Stellar halo subtraction is only implemented for DECam
Resources for stage fit_on_coadds : 0.058 s worker CPU, 0.069 s worker Wall, Wall: 0.432 s, Cores in use: 0.31, Total efficiency (on 32 cores): 1.0 %
Stage fit_on_coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-fit_on_coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-fit_on_coadds.p
Running stage srcs
Running stage srcs at 2020-07-18T20:19:55.945863
SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])]
Found 35 potential peaks
Of 35 potential peaks: 8 in veto map, 3 cut by saddle test, 0 cut by aper test, 24 kept
SED z : 24 new peaks
Found 57093 potential peaks
Of 57093 potential peaks: 57092 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED r : 0 new peaks
Found 52312 potential peaks
Of 52312 potential peaks: 52311 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED g : 0 new peaks
Found 831 potential peaks
Of 831 potential peaks: 830 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Flat : 0 new peaks
Found 840 potential peaks
Of 840 potential peaks: 839 in veto map, 1 cut by saddle test, 0 cut by aper test, 0 kept
SED Red : 0 new peaks
Adding 24 new sources
Median coadd sky for g : -4.2328047e-05
Median coadd sky for r : -0.000101119265
Median coadd sky for z : -0.0002897439
Stage srcs : Wall: 2.65 s, CPU: 0.72 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 276 MB, VmData: 303 MB, maxrss: 0.282648 MB
Stage srcs finished: 2020-07-18T20:19:58.595623
Resources for stage srcs : 3.641 s worker CPU, 3.671 s worker Wall, Wall: 2.652 s, Cores in use: 1.64, Total efficiency (on 32 cores): 5.1 %
Stage srcs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-srcs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-srcs.p
Running stage fitblobs
Running stage fitblobs at 2020-07-18T20:19:58.616054
Blob 1 of 3, id: 0, sources: 41, size: 283x287, npix 72780, brick X: 0,283, Y: 0,287, one pixel: 0 0
Blob 2 of 3, id: 1, sources: 4, size: 36x54, npix 1411, brick X: 251,287, Y: 189,243, one pixel: 272 189
Blob 3 of 3, id: 2, sources: 1, size: 14x22, npix 205, brick X: 273,287, Y: 259,281, one pixel: 282 259
Blob 3 finished, total: Wall: 0.40 s, CPU: 0.38 s, VmPeak: 659 MB, VmSize: 659 MB, VmRSS: 89 MB, VmData: 137 MB, maxrss: 0.090884 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.33678, 61.14302), pm (-3.2, 34.4), parallax 5.034 with NanoMaggies: g=20.6, r=19.1, z=16.8
Reset brightness to NanoMaggies: g=20.6, r=19.1, z=16.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.34435, 61.14442), pm (-2.6, -2.9), parallax 0.945 with NanoMaggies: g=20.4, r=(flux -44.1), z=(flux -72.1)
Reset brightness to NanoMaggies: g=20.8, r=20.2, z=20
Blob 2 finished, total: Wall: 1.27 s, CPU: 1.26 s, VmPeak: 660 MB, VmSize: 660 MB, VmRSS: 90 MB, VmData: 138 MB, maxrss: 0.09244 MB
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.59093, 61.20924), pm (-25.2, 39.2), parallax 17.479 with NanoMaggies: g=6.81, r=6.52, z=6.47
Reset brightness to NanoMaggies: g=6.81, r=6.52, z=6.47
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.40169, 61.13840), pm (-7.1, -8.9), parallax 0.885 with NanoMaggies: g=12.5, r=11.7, z=11.4
Reset brightness to NanoMaggies: g=12.5, r=11.7, z=11.4
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.36429, 61.17700), pm (-5.2, -4.3), parallax 0.277 with NanoMaggies: g=13.3, r=12.1, z=11.5
Reset brightness to NanoMaggies: g=13.3, r=12.1, z=11.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.42540, 61.12454), pm (-3.4, -3.6), parallax 0.873 with NanoMaggies: g=13.8, r=13.4, z=13.3
Reset brightness to NanoMaggies: g=13.8, r=13.4, z=13.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.40591, 61.13934), pm (-0.9, -4.5), parallax 0.571 with NanoMaggies: g=15.4, r=15, z=14.8
Reset brightness to NanoMaggies: g=15.4, r=15, z=14.8
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.35383, 61.15376), pm (-8.6, -14.8), parallax 1.336 with NanoMaggies: g=16.6, r=15.7, z=15.3
Reset brightness to NanoMaggies: g=16.6, r=15.7, z=15.3
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.35579, 61.12821), pm (-6.1, -0.4), parallax 3.115 with NanoMaggies: g=18.3, r=(flux -1.09e+03), z=15.6
Reset brightness to NanoMaggies: g=17.9, r=16.5, z=15.2
Known galaxy.  Initial shape: EllipseWithPriors(0.25): log r_e=1.81369, ee1=0.538832, ee2=0.319119
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.36024, 61.15108), pm (-4.2, -2.0), parallax 0.331 with NanoMaggies: g=(flux -2.36e+10), r=17.2, z=17.2
Reset brightness to NanoMaggies: g=17.7, r=17.2, z=17
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39651, 61.14458), pm (-4.9, 6.1), parallax 0.442 with NanoMaggies: g=18, r=17.4, z=17.1
Reset brightness to NanoMaggies: g=18, r=17.4, z=17.1
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39068, 61.14957), pm (2.8, -3.9), parallax 0.485 with NanoMaggies: g=21.4, r=19.9, z=16.6
Reset brightness to NanoMaggies: g=21.4, r=19.9, z=18.5
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39050, 61.13561), pm (-1.8, -1.7), parallax -0.090 with NanoMaggies: g=20.2, r=19.5, z=17.9
Reset brightness to NanoMaggies: g=20.2, r=19.5, z=19.2
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.39077, 61.13613), pm (0.0, 0.0), parallax 0.000 with NanoMaggies: g=21.2, r=20.2, z=(flux -7.43)
Reset brightness to NanoMaggies: g=21.2, r=20.2, z=19.7
Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (297.36362, 61.12756), pm (-4.2, -3.7), parallax -1.076 with NanoMaggies: g=20.8, r=20.2, z=22.2
Reset brightness to NanoMaggies: g=20.8, r=20.2, z=20
Blob 1 finished, total: Wall: 13.93 s, CPU: 13.90 s, VmPeak: 713 MB, VmSize: 696 MB, VmRSS: 135 MB, VmData: 173 MB, maxrss: 0.156976 MB
Old catalog: 48
New catalog: 45
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/blobs-custom-297367p61138.fits.gz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/metrics/cus/all-models-custom-297367p61138.fits
Stage fitblobs : Wall: 14.61 s, CPU: 0.56 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 279 MB, VmData: 305 MB, maxrss: 0.285424 MB
Stage fitblobs finished: 2020-07-18T20:20:13.229395
Resources for stage fitblobs : 15.607 s worker CPU, 15.675 s worker Wall, Wall: 14.616 s, Cores in use: 1.11, Total efficiency (on 32 cores): 3.5 %
Stage fitblobs finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-fitblobs.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-fitblobs.p
Running stage coadds
Running stage coadds at 2020-07-18T20:20:13.246174
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-ccds.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-nexp-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-galdepth-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-psfsize-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-chi2-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel-g.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-nexp-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-galdepth-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-psfsize-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-chi2-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel-r.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-nexp-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-galdepth-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-psfsize-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-chi2-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel-z.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-depth.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-blobmodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-resid.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-resid.jpg
Stage coadds : Wall: 5.04 s, CPU: 0.78 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 283 MB, VmData: 309 MB, maxrss: 0.289344 MB
Stage coadds finished: 2020-07-18T20:20:18.282575
Resources for stage coadds : 36.171 s worker CPU, 43.835 s worker Wall, Wall: 5.039 s, Cores in use: 7.33, Total efficiency (on 32 cores): 22.9 %
Stage coadds finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-coadds.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-coadds.p
Running stage wise_forced
Running stage wise_forced at 2020-07-18T20:20:20.884028
Cut to 1 unWISE tiles
Reading WISE tile 2970p605 band 2
Reading WISE tile 2970p605 band 1
Reading WISE tile 2970p605 band 4
Reading WISE tile 2970p605 band 3
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w4-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 791 MB, VmSize: 791 MB, VmRSS: 141 MB, VmData: 175 MB, maxrss: 0.17748 MB
Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w3-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 786 MB, VmSize: 786 MB, VmRSS: 136 MB, VmData: 170 MB, maxrss: 0.193988 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w2-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 806 MB, VmSize: 789 MB, VmRSS: 141 MB, VmData: 173 MB, maxrss: 0.201368 MB
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-img-m.fits
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-invvar-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-n-m.fits.gz
Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/297/2970p605/unwise-2970p605-w1-n-u.fits.gz
Reading /usr/local/lib/python/wise/wise-psf-avg.fits
unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 801 MB, VmSize: 789 MB, VmRSS: 140 MB, VmData: 173 MB, maxrss: 0.201916 MB
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W1.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W2.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W3.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-image-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-model-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-invvar-W4.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-wise.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/tmp-legacysurvey-custom-297367p61138-wisemodel.jpg
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-wisemodel.jpg
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Setting WISE apphot
Stage wise_forced : Wall: 15.09 s, CPU: 1.36 s, VmPeak: 1045 MB, VmSize: 1045 MB, VmRSS: 283 MB, VmData: 309 MB, maxrss: 0.289856 MB
Stage wise_forced finished: 2020-07-18T20:20:35.970740
Resources for stage wise_forced : 3.331 s worker CPU, 5.415 s worker Wall, Wall: 15.089 s, Cores in use: 0.31, Total efficiency (on 32 cores): 1.0 %
Stage wise_forced finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-wise_forced.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-wise_forced.p
Running stage writecat
Running stage writecat at 2020-07-18T20:20:35.987948
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/coadd/cus/custom-297367p61138/legacysurvey-custom-297367p61138-maskbits.fits.fz
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/tractor-i/cus/tractor-custom-297367p61138.fits
Reading SFD maps...
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
END                                                                             
  Rejected (1), keyrecords following the END keyrecord were ignored.
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/tractor/cus/tractor-custom-297367p61138.fits
Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/tractor/cus/brick-custom-297367p61138.sha256sum
Stage writecat : Wall: 0.82 s, CPU: 0.70 s, VmPeak: 1177 MB, VmSize: 1049 MB, VmRSS: 285 MB, VmData: 309 MB, maxrss: 0.422604 MB
Stage writecat finished: 2020-07-18T20:20:36.811811
Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.826 s, Cores in use: 0.85, Total efficiency (on 32 cores): 2.6 %
Stage writecat finished
Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-writecat.p
Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/297/PGC2612610/PGC2612610-largegalaxy-writecat.p
All done: 60.969 s worker CPU, 73.601 s worker Wall, Wall: 65.545 s, Cores in use: 1.14, Total efficiency (on 32 cores): 3.6 %
Finished galaxy PGC2612610 in 1.129 minutes.