Started working on galaxy PGC578368 at Wed Aug 5 20:24:52 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 13.221289500000001 -41.1709322 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:24:55.610743 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '13.221289500000001', '-41.1709322', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 13.221289500000001 -41.1709322 --width 269 --height 269 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 13.221289500000001 -41.1709322 Starting process 20038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 20039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 20041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 20043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 20045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 20047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 20049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 20051 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 20054 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 20055 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 20058 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 20060 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20062 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20063 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20066 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 20069 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:24:57.584167 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 28 CCDs: c4d_171124_012135_ooi_z_v1-N4 z expnum 699123 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58081.057 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171123/c4d_171124_012135_ooi_z_v1.fits.fz c4d_171015_065427_ooi_g_v1-S18 g expnum 687264 exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58041.288 object DES survey hex 112-420 tiling 7 decam/CP/V4.1/CP20171014/c4d_171015_065427_ooi_g_v1.fits.fz c4d_171015_065228_ooi_r_v1-S18 r expnum 687263 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58041.286 object DES survey hex 112-420 tiling 7 decam/CP/V4.1/CP20171014/c4d_171015_065228_ooi_r_v1.fits.fz c4d_161111_052210_ooi_z_ls9-S18 z expnum 592248 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57703.222 object DES survey hex 112-420 tiling 7 decam/CP/V4.8.2/CP20161110/c4d_161111_052210_ooi_z_ls9.fits.fz c4d_131212_032050_ooi_z_ls9-S23 z expnum 263021 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 56638.138 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131211/c4d_131212_032050_ooi_z_ls9.fits.fz c4d_131230_020859_ooi_r_ls9-S23 r expnum 269551 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56656.088 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131229/c4d_131230_020859_ooi_r_ls9.fits.fz c4d_131212_032050_ooi_z_ls9-S24 z expnum 263021 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 56638.138 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131211/c4d_131212_032050_ooi_z_ls9.fits.fz c4d_131027_045040_ooi_g_ls9-S24 g expnum 247232 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56592.202 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131026/c4d_131027_045040_ooi_g_ls9.fits.fz c4d_131230_020859_ooi_r_ls9-S24 r expnum 269551 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56656.088 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131229/c4d_131230_020859_ooi_r_ls9.fits.fz c4d_171022_065036_ooi_g_v1-N5 g expnum 689785 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58048.285 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171021/c4d_171022_065036_ooi_g_v1.fits.fz c4d_171022_064637_ooi_r_v1-N5 r expnum 689783 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58048.282 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171021/c4d_171022_064637_ooi_r_v1.fits.fz c4d_171124_012135_ooi_z_v1-N5 z expnum 699123 exptime 90.0 propid 2012B-0001 seeing 0.85 MJD 58081.057 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171123/c4d_171124_012135_ooi_z_v1.fits.fz c4d_131003_075947_ooi_g_ls9-S14 g expnum 240800 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 56568.333 object DES survey hex 155-420 tiling 2 decam/CP/V4.8.2a/CP20131002/c4d_131003_075947_ooi_g_ls9.fits.fz c4d_131222_025049_ooi_z_ls9-S14 z expnum 267244 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 56648.117 object DES survey hex 155-420 tiling 2 decam/CP/V4.8.2a/CP20131221/c4d_131222_025049_ooi_z_ls9.fits.fz c4d_160903_082020_ooi_g_ls9-N16 g expnum 570487 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 57634.346 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160902/c4d_160903_082020_ooi_g_ls9.fits.fz c4d_161123_045326_ooi_g_v1-N28 g expnum 595434 exptime 90.0 propid 2012B-0001 seeing 2.11 MJD 57715.202 object DES survey hex 133-410 tiling 6 decam/CP/V4.1/CP20161123/c4d_161123_045326_ooi_g_v1.fits.fz c4d_161205_032139_ooi_g_ls9-N28 g expnum 599755 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57727.138 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2/CP20161204/c4d_161205_032139_ooi_g_ls9.fits.fz c4d_161205_031945_ooi_r_ls9-N28 r expnum 599754 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57727.137 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2/CP20161204/c4d_161205_031945_ooi_r_ls9.fits.fz c4d_161010_005939_ooi_z_ls9-N28 z expnum 582383 exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 57671.040 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2a/CP20161009/c4d_161010_005939_ooi_z_ls9.fits.fz c4d_131015_063640_ooi_z_ls9-N10 z expnum 244324 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 56580.275 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20131014/c4d_131015_063640_ooi_z_ls9.fits.fz c4d_140102_022057_ooi_r_ls9-N10 r expnum 270598 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 56659.096 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20140101/c4d_140102_022057_ooi_r_ls9.fits.fz c4d_131011_060823_ooi_g_ls9-N10 g expnum 242795 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56576.256 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20131010/c4d_131011_060823_ooi_g_ls9.fits.fz c4d_171126_034943_ooi_z_v1-S19 z expnum 699949 exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 58083.160 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171125/c4d_171126_034943_ooi_z_v1.fits.fz c4d_171209_032506_ooi_g_v1-S19 g expnum 703144 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 58096.142 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171208/c4d_171209_032506_ooi_g_v1.fits.fz c4d_171124_012334_ooi_r_v1-S19 r expnum 699124 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58081.058 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171123/c4d_171124_012334_ooi_r_v1.fits.fz c4d_160902_085210_ooi_r_ls9-N16 r expnum 570223 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 57633.368 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160901/c4d_160902_085210_ooi_r_ls9.fits.fz c4d_160903_081823_ooi_r_ls9-N16 r expnum 570486 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 57634.344 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160902/c4d_160903_081823_ooi_r_ls9.fits.fz c4d_160816_062539_ooi_z_ls9-N16 z expnum 565118 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57616.266 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160815/c4d_160816_062539_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131027T045040_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9610283-r-20131230T020636_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95009e7-z-20161111T051948_oi[S18,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES16B_20161121_8e237e6-g-20161123T045102_oi[N28,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-g-20171015T065427_oi[S18,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S23,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505282-g-20161205T031919_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612187-z-20131222T024826_oi[S14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131003T075947_oi[S14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171022T064637_oi[N5,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-r-20171015T065228_oi[S18,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N4,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N5,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160903T081759_oi[N16,noinherit][2046,4094][real]: DES sur Zeroing out 0 weight-map pixels below quantization error (= median 0.00026) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 0.000251) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 6.61e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3766 weight-map pixels below quantization error (= median 4.2e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3766 weight-map pixels below quantization error (= median 2.44e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3752 weight-map pixels below quantization error (= median 2.46e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962dcbe-z-20161010T005716_oi[N28,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T021835_oi[N10,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T063640_oi[N10,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131011T060823_oi[N10,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T032506_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 0.000264) Masking 0 additional saturated pixels in DECam expnum 703144 S19 CCD, decam/CP/V4.1/CP20171208/c4d_171209_032506_ooi_g_v1.fits.fz slice (slice(1644, 1917, None), slice(1077, 1349, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171126T034943_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 3.24e-06) Masking 0 additional saturated pixels in DECam expnum 699949 S19 CCD, decam/CP/V4.1/CP20171125/c4d_171126_034943_ooi_z_v1.fits.fz slice (slice(1612, 1885, None), slice(1082, 1354, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-r-20171124T012334_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 4.37e-05) Masking 0 additional saturated pixels in DECam expnum 699124 S19 CCD, decam/CP/V4.1/CP20171123/c4d_171124_012334_ooi_r_v1.fits.fz slice (slice(1630, 1903, None), slice(1093, 1365, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160902T084949_oi[N16,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505547-r-20161205T031721_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T062317_oi[N16,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160903T081602_oi[N16,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171022T065036_oi[N5,noinherit][2046,4094][real]: DES Zeroing out 3766 weight-map pixels below quantization error (= median 0.000151) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 91.21 s, CPU: 1.61 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 191 MB, VmData: 223 MB, maxrss: 0.1957 MB Stage tims finished: 2020-08-05T20:26:28.790871 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612187-z-20131222T024826_oi[S14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160903T081759_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131003T075947_oi[S14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95009e7-z-20161111T051948_oi[S18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962dcbe-z-20161010T005716_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-r-20171015T065228_oi[S18,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171126T034943_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-r-20171124T012334_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9610283-r-20131230T020636_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T063640_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-g-20171015T065427_oi[S18,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T021835_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES16B_20161121_8e237e6-g-20161123T045102_oi[N28,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505547-r-20161205T031721_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N4,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160902T084949_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160903T081602_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T062317_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131027T045040_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171022T065036_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 14.306 s worker CPU, 1211.421 s worker Wall, Wall: 91.208 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171022T064637_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T032506_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505282-g-20161205T031919_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131011T060823_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Running stage refs at 2020-08-05T20:26:29.335042 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10180.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10053.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/reference-custom-013221m41170.fits Stage refs : Wall: 3.99 s, CPU: 1.86 s, VmPeak: 1046 MB, VmSize: 1029 MB, VmRSS: 206 MB, VmData: 237 MB, maxrss: 0.211076 MB Stage refs finished: 2020-08-05T20:26:33.320821 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.987 s, Cores in use: 0.47, Total efficiency (on 16 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:26:33.594838 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outlier-mask-custom-013221m41170.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-pre-custom-013221m41170.jpg Image c4d_131003_075947_ooi_g_ls9-S14 g : masking 290 positive outlier pixels and 61 negative outlier pixels Image c4d_160903_082020_ooi_g_ls9-N16 g : masking 0 positive outlier pixels and 215 negative outlier pixels Image c4d_161123_045326_ooi_g_v1-N28 g : masking 919 positive outlier pixels and 176 negative outlier pixels Image c4d_171209_032506_ooi_g_v1-S19 g : masking 311 positive outlier pixels and 0 negative outlier pixels Image c4d_161205_032139_ooi_g_ls9-N28 g : masking 745 positive outlier pixels and 0 negative outlier pixels Image c4d_131230_020859_ooi_r_ls9-S24 r : masking 33 positive outlier pixels and 0 negative outlier pixels Image c4d_131212_032050_ooi_z_ls9-S24 z : masking 344 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outlier-mask-custom-013221m41170.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-post-custom-013221m41170.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-masked-pos-custom-013221m41170.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-masked-neg-custom-013221m41170.jpg Stage outliers : Wall: 1.33 s, CPU: 1.02 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 232 MB, VmData: 260 MB, maxrss: 0.237196 MB Stage outliers finished: 2020-08-05T20:26:34.920941 Resources for stage outliers : 1.768 s worker CPU, 1.768 s worker Wall, Wall: 1.328 s, Cores in use: 2.10, Total efficiency (on 16 cores): 13.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:26:34.980890 Stage halos : Wall: 1.25 s, CPU: 1.25 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 232 MB, VmData: 260 MB, maxrss: 0.2374 MB Stage halos finished: 2020-08-05T20:26:36.234109 Resources for stage halos : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.255 s, Cores in use: 1.00, Total efficiency (on 16 cores): 6.2 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:26:36.305936 PSF sigmas in coadd pixels: ['2.36', '2.53', '1.69', '2.47', '2.23', '3.42', '1.60', '1.77', '2.03'] Using average PSF sigma 2.234807727435901 Gaussian PSF norm 0.12622776819263046 vs pixelized 0.10548056 average tim pixel scale / coadd scale: 1.0010554412564703 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.07', '1.83', '1.59', '1.70', '1.72', '1.80', '2.30', '2.01'] Using average PSF sigma 1.8773178989345183 Gaussian PSF norm 0.15026479635334142 vs pixelized 0.13620993 average tim pixel scale / coadd scale: 1.0010673091209223 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.48', '1.42', '1.50', '1.39', '1.73', '1.35', '1.46', '1.35', '1.48'] Using average PSF sigma 1.473802381024797 Gaussian PSF norm 0.19140611754048445 vs pixelized 0.17831312 average tim pixel scale / coadd scale: 1.000999848496965 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.57 s, CPU: 0.54 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 234 MB, VmData: 260 MB, maxrss: 0.239172 MB Stage fit_on_coadds finished: 2020-08-05T20:26:36.875294 Resources for stage fit_on_coadds : 0.527 s worker CPU, 0.528 s worker Wall, Wall: 0.572 s, Cores in use: 1.87, Total efficiency (on 16 cores): 11.7 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:26:36.899109 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 45 potential peaks Of 45 potential peaks: 10 in veto map, 6 cut by saddle test, 0 cut by aper test, 29 kept SED z : 29 new peaks Found 65 potential peaks Of 65 potential peaks: 40 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 44 potential peaks Of 44 potential peaks: 36 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 61 potential peaks Of 61 potential peaks: 43 in veto map, 13 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 71 potential peaks Of 71 potential peaks: 53 in veto map, 13 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 50 new sources Median coadd sky for g : -0.00010174744 Median coadd sky for r : -1.87195e-05 Median coadd sky for z : 0.00022649058 Stage srcs : Wall: 1.30 s, CPU: 1.23 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 234 MB, VmData: 260 MB, maxrss: 0.23958 MB Stage srcs finished: 2020-08-05T20:26:38.196928 Resources for stage srcs : 0.092 s worker CPU, 0.092 s worker Wall, Wall: 1.300 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:26:38.215004 Blob 1 of 19, id: 0, sources: 22, size: 156x241, npix 16619, brick X: 34,190, Y: 0,241, one pixel: 78 0 Blob 2 of 19, id: 18, sources: 4, size: 94x42, npix 2387, brick X: 83,177, Y: 227,269, one pixel: 152 227 Blob 3 of 19, id: 9, sources: 4, size: 58x57, npix 2163, brick X: 211,269, Y: 80,137, one pixel: 249 80 Blob 4 of 19, id: 8, sources: 1, size: 55x38, npix 1510, brick X: 3,58, Y: 80,118, one pixel: 24 80 Blob 5 of 19, id: 6, sources: 2, size: 52x45, npix 1404, brick X: 143,195, Y: 50,95, one pixel: 158 50 Blob 6 of 19, id: 4, sources: 2, size: 42x52, npix 1396, brick X: 0,42, Y: 26,78, one pixel: 26 26 Blob 7 of 19, id: 17, sources: 3, size: 48x47, npix 1245, brick X: 191,239, Y: 222,269, one pixel: 206 222 Blob 8 of 19, id: 10, sources: 2, size: 35x43, npix 879, brick X: 19,54, Y: 134,177, one pixel: 28 134 Blob 9 of 19, id: 1, sources: 1, size: 50x29, npix 876, brick X: 202,252, Y: 0,29, one pixel: 214 0 Blob 10 of 19, id: 12, sources: 1, size: 34x30, npix 740, brick X: 204,238, Y: 138,168, one pixel: 214 138 Blob 11 of 19, id: 2, sources: 1, size: 30x31, npix 618, brick X: 172,202, Y: 6,37, one pixel: 185 6 Blob 12 of 19, id: 5, sources: 1, size: 29x31, npix 608, brick X: 229,258, Y: 31,62, one pixel: 240 31 Blob 13 of 19, id: 3, sources: 1, size: 23x22, npix 294, brick X: 127,150, Y: 8,30, one pixel: 138 8 Blob 14 of 19, id: 15, sources: 1, size: 20x27, npix 292, brick X: 220,240, Y: 179,206, one pixel: 228 179 Blob 15 of 19, id: 13, sources: 1, size: 20x19, npix 209, brick X: 2,22, Y: 159,178, one pixel: 11 159 Blob 16 of 19, id: 14, sources: 1, size: 15x18, npix 168, brick X: 254,269, Y: 173,191, one pixel: 262 173 Blob 17 of 19, id: 7, sources: 1, size: 17x17, npix 145, brick X: 214,231, Y: 58,75, one pixel: 222 58 Measuring 1 iterative sources Blob 15 finished, total: Wall: 0.42 s, CPU: 0.42 s, VmPeak: 1006 MB, VmSize: 705 MB, VmRSS: 117 MB, VmData: 154 MB, maxrss: 0.152284 MB Blob 18 of 19, id: 11, sources: 1, size: 17x17, npix 145, brick X: 243,260, Y: 135,152, one pixel: 251 135 Blob 16 finished, total: Wall: 0.46 s, CPU: 0.44 s, VmPeak: 1000 MB, VmSize: 734 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14978 MB Blob 19 of 19, id: 16, sources: 1, size: 17x17, npix 145, brick X: 62,79, Y: 200,217, one pixel: 70 200 Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1000 MB, VmSize: 734 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14978 MB Blob 19 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1000 MB, VmSize: 734 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.14978 MB Blob 17 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 1006 MB, VmSize: 705 MB, VmRSS: 117 MB, VmData: 154 MB, maxrss: 0.152284 MB Blob 13 finished, total: Wall: 0.82 s, CPU: 0.78 s, VmPeak: 980 MB, VmSize: 734 MB, VmRSS: 146 MB, VmData: 183 MB, maxrss: 0.149792 MB Blob 11 finished, total: Wall: 1.20 s, CPU: 1.19 s, VmPeak: 995 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148144 MB Measuring 1 iterative sources Measuring 3 iterative sources Blob 14 finished, total: Wall: 1.59 s, CPU: 1.57 s, VmPeak: 975 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.156076 MB Blob 8 finished, total: Wall: 1.60 s, CPU: 1.57 s, VmPeak: 1034 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148032 MB Blob 10 finished, total: Wall: 1.77 s, CPU: 1.74 s, VmPeak: 939 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.1524 MB Blob 12 finished, total: Wall: 1.90 s, CPU: 1.90 s, VmPeak: 938 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150456 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.25 s, CPU: 2.21 s, VmPeak: 1010 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150824 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 2.57 s, CPU: 2.54 s, VmPeak: 1028 MB, VmSize: 707 MB, VmRSS: 121 MB, VmData: 156 MB, maxrss: 0.145436 MB Blob 5 finished, total: Wall: 2.87 s, CPU: 2.84 s, VmPeak: 973 MB, VmSize: 705 MB, VmRSS: 120 MB, VmData: 154 MB, maxrss: 0.154368 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 3.05 s, CPU: 3.05 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.151032 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 3.96 s, CPU: 3.93 s, VmPeak: 938 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152448 MB Blob 2 finished, total: Wall: 4.05 s, CPU: 4.03 s, VmPeak: 971 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 183 MB, maxrss: 0.15062 MB Blob 3 finished, total: Wall: 4.42 s, CPU: 4.39 s, VmPeak: 976 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.152728 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.51925, ee1=-0.0370071, ee2=0.0223401 Measuring 6 iterative sources Blob 1 finished, total: Wall: 23.12 s, CPU: 23.11 s, VmPeak: 1032 MB, VmSize: 735 MB, VmRSS: 156 MB, VmData: 184 MB, maxrss: 0.159784 MB Old catalog: 51 New catalog: 60 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/blobs-custom-013221m41170.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/all-models-custom-013221m41170.fits Stage fitblobs : Wall: 24.58 s, CPU: 1.42 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 234 MB, VmData: 260 MB, maxrss: 0.239996 MB Stage fitblobs finished: 2020-08-05T20:27:02.793315 Resources for stage fitblobs : 56.458 s worker CPU, 57.323 s worker Wall, Wall: 24.580 s, Cores in use: 2.35, Total efficiency (on 16 cores): 14.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:27:02.817152 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-resid.jpg Stage coadds : Wall: 3.81 s, CPU: 1.84 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 235 MB, VmData: 260 MB, maxrss: 0.240456 MB Stage coadds finished: 2020-08-05T20:27:06.631483 Resources for stage coadds : 6.965 s worker CPU, 20.478 s worker Wall, Wall: 3.816 s, Cores in use: 2.31, Total efficiency (on 16 cores): 14.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T20:27:06.650403 Cut to 1 unWISE tiles Reading WISE tile 0138m409 band 1 Reading WISE tile 0138m409 band 2 Reading WISE tile 0138m409 band 3 Reading WISE tile 0138m409 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 995 MB, VmSize: 812 MB, VmRSS: 152 MB, VmData: 177 MB, maxrss: 0.19476 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1028 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.209444 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1032 MB, VmSize: 815 MB, VmRSS: 159 MB, VmData: 180 MB, maxrss: 0.223512 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1000 MB, VmSize: 811 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.215056 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.97 s, CPU: 1.52 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 236 MB, VmData: 260 MB, maxrss: 0.241164 MB Stage wise_forced finished: 2020-08-05T20:27:11.616659 Resources for stage wise_forced : 3.233 s worker CPU, 7.466 s worker Wall, Wall: 4.968 s, Cores in use: 0.96, Total efficiency (on 16 cores): 6.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:27:11.632652 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/tractor-i/cus/tractor-custom-013221m41170.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/tractor/cus/tractor-custom-013221m41170.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/tractor/cus/brick-custom-013221m41170.sha256sum Stage writecat : Wall: 2.73 s, CPU: 1.29 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 237 MB, VmData: 260 MB, maxrss: 0.374168 MB Stage writecat finished: 2020-08-05T20:27:14.362815 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 2.732 s, Cores in use: 0.47, Total efficiency (on 16 cores): 3.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-writecat.p All done: 83.354 s worker CPU, 1299.080 s worker Wall, Wall: 136.811 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.4 % Finished galaxy PGC578368 in 2.365 minutes. Started working on galaxy PGC578368 at Wed Aug 5 22:11:01 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 13.221289500000001 -41.1709322 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T22:11:03.034138 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '13.221289500000001', '-41.1709322', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 13.221289500000001 -41.1709322 --width 269 --height 269 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 13.221289500000001 -41.1709322 Starting process 38801 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 38803 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 38805 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38807 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 38809 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 38811 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 38813 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 38815 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 38816 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 38818 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 38820 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 38822 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38824 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38826 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38828 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38835 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 38831 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 38836 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 38837 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 38839 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 38838 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 38841 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 38842 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 38844 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 38845 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 38846 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 38847 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 38848 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 38849 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 38850 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 38851 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 38852 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059304 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T22:11:04.929878 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 28 CCDs: c4d_171124_012135_ooi_z_v1-N4 z expnum 699123 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58081.057 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171123/c4d_171124_012135_ooi_z_v1.fits.fz c4d_171015_065427_ooi_g_v1-S18 g expnum 687264 exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58041.288 object DES survey hex 112-420 tiling 7 decam/CP/V4.1/CP20171014/c4d_171015_065427_ooi_g_v1.fits.fz c4d_171015_065228_ooi_r_v1-S18 r expnum 687263 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58041.286 object DES survey hex 112-420 tiling 7 decam/CP/V4.1/CP20171014/c4d_171015_065228_ooi_r_v1.fits.fz c4d_161111_052210_ooi_z_ls9-S18 z expnum 592248 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57703.222 object DES survey hex 112-420 tiling 7 decam/CP/V4.8.2/CP20161110/c4d_161111_052210_ooi_z_ls9.fits.fz c4d_131212_032050_ooi_z_ls9-S23 z expnum 263021 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 56638.138 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131211/c4d_131212_032050_ooi_z_ls9.fits.fz c4d_131230_020859_ooi_r_ls9-S23 r expnum 269551 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56656.088 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131229/c4d_131230_020859_ooi_r_ls9.fits.fz c4d_131212_032050_ooi_z_ls9-S24 z expnum 263021 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 56638.138 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131211/c4d_131212_032050_ooi_z_ls9.fits.fz c4d_131027_045040_ooi_g_ls9-S24 g expnum 247232 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56592.202 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131026/c4d_131027_045040_ooi_g_ls9.fits.fz c4d_131230_020859_ooi_r_ls9-S24 r expnum 269551 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56656.088 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131229/c4d_131230_020859_ooi_r_ls9.fits.fz c4d_171022_065036_ooi_g_v1-N5 g expnum 689785 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58048.285 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171021/c4d_171022_065036_ooi_g_v1.fits.fz c4d_171022_064637_ooi_r_v1-N5 r expnum 689783 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58048.282 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171021/c4d_171022_064637_ooi_r_v1.fits.fz c4d_171124_012135_ooi_z_v1-N5 z expnum 699123 exptime 90.0 propid 2012B-0001 seeing 0.85 MJD 58081.057 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171123/c4d_171124_012135_ooi_z_v1.fits.fz c4d_131003_075947_ooi_g_ls9-S14 g expnum 240800 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 56568.333 object DES survey hex 155-420 tiling 2 decam/CP/V4.8.2a/CP20131002/c4d_131003_075947_ooi_g_ls9.fits.fz c4d_131222_025049_ooi_z_ls9-S14 z expnum 267244 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 56648.117 object DES survey hex 155-420 tiling 2 decam/CP/V4.8.2a/CP20131221/c4d_131222_025049_ooi_z_ls9.fits.fz c4d_160903_082020_ooi_g_ls9-N16 g expnum 570487 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 57634.346 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160902/c4d_160903_082020_ooi_g_ls9.fits.fz c4d_161123_045326_ooi_g_v1-N28 g expnum 595434 exptime 90.0 propid 2012B-0001 seeing 2.11 MJD 57715.202 object DES survey hex 133-410 tiling 6 decam/CP/V4.1/CP20161123/c4d_161123_045326_ooi_g_v1.fits.fz c4d_161205_032139_ooi_g_ls9-N28 g expnum 599755 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57727.138 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2/CP20161204/c4d_161205_032139_ooi_g_ls9.fits.fz c4d_161205_031945_ooi_r_ls9-N28 r expnum 599754 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57727.137 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2/CP20161204/c4d_161205_031945_ooi_r_ls9.fits.fz c4d_161010_005939_ooi_z_ls9-N28 z expnum 582383 exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 57671.040 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2a/CP20161009/c4d_161010_005939_ooi_z_ls9.fits.fz c4d_131015_063640_ooi_z_ls9-N10 z expnum 244324 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 56580.275 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20131014/c4d_131015_063640_ooi_z_ls9.fits.fz c4d_140102_022057_ooi_r_ls9-N10 r expnum 270598 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 56659.096 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20140101/c4d_140102_022057_ooi_r_ls9.fits.fz c4d_131011_060823_ooi_g_ls9-N10 g expnum 242795 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56576.256 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20131010/c4d_131011_060823_ooi_g_ls9.fits.fz c4d_171126_034943_ooi_z_v1-S19 z expnum 699949 exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 58083.160 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171125/c4d_171126_034943_ooi_z_v1.fits.fz c4d_171209_032506_ooi_g_v1-S19 g expnum 703144 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 58096.142 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171208/c4d_171209_032506_ooi_g_v1.fits.fz c4d_171124_012334_ooi_r_v1-S19 r expnum 699124 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58081.058 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171123/c4d_171124_012334_ooi_r_v1.fits.fz c4d_160902_085210_ooi_r_ls9-N16 r expnum 570223 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 57633.368 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160901/c4d_160902_085210_ooi_r_ls9.fits.fz c4d_160903_081823_ooi_r_ls9-N16 r expnum 570486 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 57634.344 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160902/c4d_160903_081823_ooi_r_ls9.fits.fz c4d_160816_062539_ooi_z_ls9-N16 z expnum 565118 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57616.266 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160815/c4d_160816_062539_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-r-20171124T012334_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 4.37e-05) Masking 0 additional saturated pixels in DECam expnum 699124 S19 CCD, decam/CP/V4.1/CP20171123/c4d_171124_012334_ooi_r_v1.fits.fz slice (slice(1630, 1903, None), slice(1093, 1365, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9610283-r-20131230T020636_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612187-z-20131222T024826_oi[S14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171126T034943_oi[S19,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T063640_oi[N10,noinherit][2046,4094][real]: DES sur Zeroing out 0 weight-map pixels below quantization error (= median 3.24e-06) Masking 0 additional saturated pixels in DECam expnum 699949 S19 CCD, decam/CP/V4.1/CP20171125/c4d_171126_034943_ooi_z_v1.fits.fz slice (slice(1612, 1885, None), slice(1082, 1354, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131003T075947_oi[S14,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171022T064637_oi[N5,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505282-g-20161205T031919_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-r-20171015T065228_oi[S18,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131027T045040_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-g-20171015T065427_oi[S18,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T021835_oi[N10,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131011T060823_oi[N10,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T032506_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 0.000264) Masking 0 additional saturated pixels in DECam expnum 703144 S19 CCD, decam/CP/V4.1/CP20171208/c4d_171209_032506_ooi_g_v1.fits.fz slice (slice(1644, 1917, None), slice(1077, 1349, None)) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T062317_oi[N16,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95009e7-z-20161111T051948_oi[S18,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S23,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160902T084949_oi[N16,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962dcbe-z-20161010T005716_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505547-r-20161205T031721_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160903T081602_oi[N16,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES16B_20161121_8e237e6-g-20161123T045102_oi[N28,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N4,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N5,noinherit][2046,4094][real]: DES The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160903T081759_oi[N16,noinherit][2046,4094][real]: DES sur CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 0.00026) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 6.61e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3766 weight-map pixels below quantization error (= median 4.2e-05) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 0 weight-map pixels below quantization error (= median 0.000251) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3766 weight-map pixels below quantization error (= median 2.44e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Zeroing out 3752 weight-map pixels below quantization error (= median 2.46e-06) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171022T065036_oi[N5,noinherit][2046,4094][real]: DES Zeroing out 3766 weight-map pixels below quantization error (= median 0.000151) CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 134.44 s, CPU: 1.25 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 192 MB, VmData: 224 MB, maxrss: 0.196116 MB Stage tims finished: 2020-08-05T22:13:19.367674 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171022T064637_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95009e7-z-20161111T051948_oi[S18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131011T060823_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-r-20171015T065228_oi[S18,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9610283-r-20131230T020636_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-g-20171015T065427_oi[S18,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T063640_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131003T075947_oi[S14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES16B_20161121_8e237e6-g-20161123T045102_oi[N28,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160903T081759_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171022T065036_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131027T045040_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 19.302 s worker CPU, 2266.067 s worker Wall, Wall: 134.440 s, Cores in use: 0.15, Total efficiency (on 32 cores): 0.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-r-20171124T012334_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171126T034943_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160902T084949_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612187-z-20131222T024826_oi[S14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160903T081602_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962dcbe-z-20161010T005716_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T062317_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T032506_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T22:13:19.755123 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10180.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10053.fits Matched 5 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/reference-custom-013221m41170.fits Stage refs : Wall: 9.34 s, CPU: 2.01 s, VmPeak: 1046 MB, VmSize: 1029 MB, VmRSS: 207 MB, VmData: 238 MB, maxrss: 0.211488 MB Stage refs finished: 2020-08-05T22:13:29.096000 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T021835_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505282-g-20161205T031919_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N4,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 9.343 s, Cores in use: 0.22, Total efficiency (on 32 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-refs.p Running stage outliers WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505547-r-20161205T031721_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage outliers at 2020-08-05T22:13:29.146844 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outlier-mask-custom-013221m41170.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-pre-custom-013221m41170.jpg Image c4d_131003_075947_ooi_g_ls9-S14 g : masking 290 positive outlier pixels and 61 negative outlier pixels Image c4d_160903_082020_ooi_g_ls9-N16 g : masking 0 positive outlier pixels and 215 negative outlier pixels Image c4d_161123_045326_ooi_g_v1-N28 g : masking 919 positive outlier pixels and 176 negative outlier pixels Image c4d_161205_032139_ooi_g_ls9-N28 g : masking 745 positive outlier pixels and 0 negative outlier pixels Image c4d_171209_032506_ooi_g_v1-S19 g : masking 311 positive outlier pixels and 0 negative outlier pixels Image c4d_131230_020859_ooi_r_ls9-S24 r : masking 33 positive outlier pixels and 0 negative outlier pixels Image c4d_131212_032050_ooi_z_ls9-S24 z : masking 344 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outlier-mask-custom-013221m41170.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-post-custom-013221m41170.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-masked-pos-custom-013221m41170.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/outliers-masked-neg-custom-013221m41170.jpg Stage outliers : Wall: 1.18 s, CPU: 0.95 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 231 MB, VmData: 259 MB, maxrss: 0.236596 MB Stage outliers finished: 2020-08-05T22:13:30.330521 Resources for stage outliers : 1.659 s worker CPU, 1.788 s worker Wall, Wall: 1.186 s, Cores in use: 2.21, Total efficiency (on 32 cores): 6.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T22:13:30.379306 Stage halos : Wall: 0.42 s, CPU: 0.41 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 231 MB, VmData: 259 MB, maxrss: 0.236696 MB Stage halos finished: 2020-08-05T22:13:30.795931 Resources for stage halos : 0.000 s worker CPU, 0.001 s worker Wall, Wall: 0.419 s, Cores in use: 1.00, Total efficiency (on 32 cores): 3.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T22:13:30.872744 PSF sigmas in coadd pixels: ['2.36', '2.53', '1.69', '2.47', '2.23', '3.42', '1.60', '1.77', '2.03'] Using average PSF sigma 2.234807727435901 Gaussian PSF norm 0.12622776819263046 vs pixelized 0.10548056 average tim pixel scale / coadd scale: 1.0010554412564703 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.07', '1.83', '1.59', '1.70', '1.72', '1.80', '2.30', '2.01'] Using average PSF sigma 1.8773178989345183 Gaussian PSF norm 0.15026479635334142 vs pixelized 0.13620993 average tim pixel scale / coadd scale: 1.0010673091209223 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.48', '1.42', '1.50', '1.39', '1.73', '1.35', '1.46', '1.35', '1.48'] Using average PSF sigma 1.473802381024797 Gaussian PSF norm 0.19140611754048445 vs pixelized 0.17831312 average tim pixel scale / coadd scale: 1.000999848496965 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.39 s, CPU: 0.32 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 234 MB, VmData: 260 MB, maxrss: 0.239168 MB Stage fit_on_coadds finished: 2020-08-05T22:13:31.262439 Resources for stage fit_on_coadds : 0.357 s worker CPU, 0.357 s worker Wall, Wall: 0.392 s, Cores in use: 1.72, Total efficiency (on 32 cores): 5.4 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T22:13:31.284256 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 45 potential peaks Of 45 potential peaks: 10 in veto map, 6 cut by saddle test, 0 cut by aper test, 29 kept SED z : 29 new peaks Found 65 potential peaks Of 65 potential peaks: 40 in veto map, 14 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 44 potential peaks Of 44 potential peaks: 36 in veto map, 8 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 61 potential peaks Of 61 potential peaks: 43 in veto map, 13 cut by saddle test, 0 cut by aper test, 5 kept SED Flat : 5 new peaks Found 71 potential peaks Of 71 potential peaks: 53 in veto map, 13 cut by saddle test, 0 cut by aper test, 5 kept SED Red : 5 new peaks Adding 50 new sources Median coadd sky for g : -0.00010174744 Median coadd sky for r : -1.8719453e-05 Median coadd sky for z : 0.00022649049 Stage srcs : Wall: 0.88 s, CPU: 0.84 s, VmPeak: 1046 MB, VmSize: 1039 MB, VmRSS: 234 MB, VmData: 260 MB, maxrss: 0.239576 MB Stage srcs finished: 2020-08-05T22:13:32.162365 Resources for stage srcs : 0.082 s worker CPU, 0.082 s worker Wall, Wall: 0.880 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T22:13:32.183790 Blob 1 of 19, id: 0, sources: 22, size: 156x241, npix 16619, brick X: 34,190, Y: 0,241, one pixel: 78 0 Blob 2 of 19, id: 18, sources: 4, size: 94x42, npix 2387, brick X: 83,177, Y: 227,269, one pixel: 152 227 Blob 3 of 19, id: 9, sources: 4, size: 58x57, npix 2163, brick X: 211,269, Y: 80,137, one pixel: 249 80 Blob 4 of 19, id: 8, sources: 1, size: 55x38, npix 1510, brick X: 3,58, Y: 80,118, one pixel: 24 80 Blob 5 of 19, id: 6, sources: 2, size: 52x45, npix 1404, brick X: 143,195, Y: 50,95, one pixel: 158 50 Blob 6 of 19, id: 4, sources: 2, size: 42x52, npix 1396, brick X: 0,42, Y: 26,78, one pixel: 26 26 Blob 7 of 19, id: 17, sources: 3, size: 48x47, npix 1245, brick X: 191,239, Y: 222,269, one pixel: 206 222 Blob 8 of 19, id: 10, sources: 2, size: 35x43, npix 879, brick X: 19,54, Y: 134,177, one pixel: 28 134 Blob 9 of 19, id: 1, sources: 1, size: 50x29, npix 876, brick X: 202,252, Y: 0,29, one pixel: 214 0 Blob 10 of 19, id: 12, sources: 1, size: 34x30, npix 740, brick X: 204,238, Y: 138,168, one pixel: 214 138 Blob 11 of 19, id: 2, sources: 1, size: 30x31, npix 618, brick X: 172,202, Y: 6,37, one pixel: 185 6 Blob 12 of 19, id: 5, sources: 1, size: 29x31, npix 608, brick X: 229,258, Y: 31,62, one pixel: 240 31 Blob 13 of 19, id: 3, sources: 1, size: 23x22, npix 294, brick X: 127,150, Y: 8,30, one pixel: 138 8 Blob 14 of 19, id: 15, sources: 1, size: 20x27, npix 292, brick X: 220,240, Y: 179,206, one pixel: 228 179 Blob 15 of 19, id: 13, sources: 1, size: 20x19, npix 209, brick X: 2,22, Y: 159,178, one pixel: 11 159 Blob 16 of 19, id: 14, sources: 1, size: 15x18, npix 168, brick X: 254,269, Y: 173,191, one pixel: 262 173 Blob 17 of 19, id: 7, sources: 1, size: 17x17, npix 145, brick X: 214,231, Y: 58,75, one pixel: 222 58 Blob 18 of 19, id: 11, sources: 1, size: 17x17, npix 145, brick X: 243,260, Y: 135,152, one pixel: 251 135 Blob 19 of 19, id: 16, sources: 1, size: 17x17, npix 145, brick X: 62,79, Y: 200,217, one pixel: 70 200 Blob 18 finished, total: Wall: 0.11 s, CPU: 0.05 s, VmPeak: 935 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151092 MB Blob 19 finished, total: Wall: 0.13 s, CPU: 0.05 s, VmPeak: 939 MB, VmSize: 734 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150064 MB Blob 17 finished, total: Wall: 0.22 s, CPU: 0.20 s, VmPeak: 1016 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149292 MB Blob 16 finished, total: Wall: 0.32 s, CPU: 0.28 s, VmPeak: 1011 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149396 MB Blob 15 finished, total: Wall: 0.32 s, CPU: 0.29 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147876 MB Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.58 s, CPU: 0.53 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14828 MB Measuring 1 iterative sources Blob 11 finished, total: Wall: 1.03 s, CPU: 0.95 s, VmPeak: 996 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148548 MB Blob 14 finished, total: Wall: 1.16 s, CPU: 1.08 s, VmPeak: 1010 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150084 MB Blob 8 finished, total: Wall: 1.17 s, CPU: 1.11 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 147 MB, VmData: 182 MB, maxrss: 0.150648 MB Blob 10 finished, total: Wall: 1.29 s, CPU: 1.28 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 95 MB, VmData: 140 MB, maxrss: 0.097332 MB Blob 12 finished, total: Wall: 1.29 s, CPU: 1.24 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14972 MB Measuring 3 iterative sources Measuring 1 iterative sources Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.72 s, CPU: 1.65 s, VmPeak: 938 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150208 MB Blob 7 finished, total: Wall: 2.05 s, CPU: 1.96 s, VmPeak: 938 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152328 MB Blob 5 finished, total: Wall: 2.19 s, CPU: 2.15 s, VmPeak: 952 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149964 MB Measuring 1 iterative sources Blob 9 finished, total: Wall: 2.73 s, CPU: 2.65 s, VmPeak: 1006 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149288 MB Blob 6 finished, total: Wall: 3.27 s, CPU: 3.19 s, VmPeak: 670 MB, VmSize: 670 MB, VmRSS: 96 MB, VmData: 142 MB, maxrss: 0.0986 MB Measuring 1 iterative sources Blob 2 finished, total: Wall: 3.44 s, CPU: 3.36 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150252 MB Blob 3 finished, total: Wall: 4.07 s, CPU: 3.98 s, VmPeak: 955 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14958 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.51925, ee1=-0.037007, ee2=0.0223399 Measuring 6 iterative sources Blob 1 finished, total: Wall: 22.57 s, CPU: 22.56 s, VmPeak: 952 MB, VmSize: 737 MB, VmRSS: 157 MB, VmData: 186 MB, maxrss: 0.161196 MB Old catalog: 51 New catalog: 60 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/blobs-custom-013221m41170.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/metrics/cus/all-models-custom-013221m41170.fits Stage fitblobs : Wall: 24.09 s, CPU: 1.42 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 234 MB, VmData: 259 MB, maxrss: 0.239932 MB Stage fitblobs finished: 2020-08-05T22:13:56.278151 Resources for stage fitblobs : 48.866 s worker CPU, 52.180 s worker Wall, Wall: 24.097 s, Cores in use: 2.09, Total efficiency (on 32 cores): 6.5 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T22:13:56.294109 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-resid.jpg Stage coadds : Wall: 3.46 s, CPU: 0.65 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 234 MB, VmData: 259 MB, maxrss: 0.239932 MB Stage coadds finished: 2020-08-05T22:13:59.753528 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 41.448 s worker CPU, 65.696 s worker Wall, Wall: 3.462 s, Cores in use: 12.16, Total efficiency (on 32 cores): 38.0 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T22:13:59.770779 Cut to 1 unWISE tiles Reading WISE tile 0138m409 band 1 Reading WISE tile 0138m409 band 2 Reading WISE tile 0138m409 band 3 Reading WISE tile 0138m409 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.09 s, CPU: 0.09 s, VmPeak: 1012 MB, VmSize: 802 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.204096 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 939 MB, VmSize: 802 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.2041 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.11 s, VmPeak: 1016 MB, VmSize: 812 MB, VmRSS: 151 MB, VmData: 177 MB, maxrss: 0.192244 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1010 MB, VmSize: 804 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.206368 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.08 s, CPU: 0.61 s, VmPeak: 1046 MB, VmSize: 1038 MB, VmRSS: 235 MB, VmData: 259 MB, maxrss: 0.24064 MB Stage wise_forced finished: 2020-08-05T22:14:03.851233 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.291 s worker CPU, 8.077 s worker Wall, Wall: 4.083 s, Cores in use: 0.96, Total efficiency (on 32 cores): 3.0 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T22:14:03.868582 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/tractor-i/cus/tractor-custom-013221m41170.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/tractor/cus/tractor-custom-013221m41170.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/tractor/cus/brick-custom-013221m41170.sha256sum Stage writecat : Wall: 0.75 s, CPU: 0.62 s, VmPeak: 1171 MB, VmSize: 1043 MB, VmRSS: 237 MB, VmData: 259 MB, maxrss: 0.373644 MB Stage writecat finished: 2020-08-05T22:14:04.623032 Resources for stage writecat : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 0.757 s, Cores in use: 0.83, Total efficiency (on 32 cores): 2.6 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/013/PGC578368/PGC578368-largegalaxy-writecat.p All done: 115.010 s worker CPU, 2394.255 s worker Wall, Wall: 179.716 s, Cores in use: 0.69, Total efficiency (on 32 cores): 2.2 % Finished galaxy PGC578368 in 3.134 minutes. Started working on galaxy PGC578368 at Mon Aug 10 09:19:08 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 13.221225716068028 -41.17055185528771 --width 269 --height 269 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T09:19:08.948951 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '13.221225716068028', '-41.17055185528771', '--width', '269', '--height', '269', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 13.221225716068028 -41.17055185528771 --width 269 --height 269 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 13.221225716068028 -41.17055185528771 Starting process 25218 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059224 MB Starting process 25219 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 25220 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 25221 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 25222 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059392 MB Starting process 25223 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0594 MB Starting process 25224 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05934 MB Starting process 25225 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T09:19:09.515290 Keeping 28 CCDs: c4d_171124_012135_ooi_z_v1-N4 z expnum 699123 exptime 90.0 propid 2012B-0001 seeing 0.97 MJD 58081.057 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171123/c4d_171124_012135_ooi_z_v1.fits.fz c4d_171015_065427_ooi_g_v1-S18 g expnum 687264 exptime 90.0 propid 2012B-0001 seeing 1.46 MJD 58041.288 object DES survey hex 112-420 tiling 7 decam/CP/V4.1/CP20171014/c4d_171015_065427_ooi_g_v1.fits.fz c4d_171015_065228_ooi_r_v1-S18 r expnum 687263 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 58041.286 object DES survey hex 112-420 tiling 7 decam/CP/V4.1/CP20171014/c4d_171015_065228_ooi_r_v1.fits.fz c4d_161111_052210_ooi_z_ls9-S18 z expnum 592248 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57703.222 object DES survey hex 112-420 tiling 7 decam/CP/V4.8.2/CP20161110/c4d_161111_052210_ooi_z_ls9.fits.fz c4d_131212_032050_ooi_z_ls9-S23 z expnum 263021 exptime 90.0 propid 2012B-0001 seeing 0.87 MJD 56638.138 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131211/c4d_131212_032050_ooi_z_ls9.fits.fz c4d_131230_020859_ooi_r_ls9-S23 r expnum 269551 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56656.088 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131229/c4d_131230_020859_ooi_r_ls9.fits.fz c4d_131212_032050_ooi_z_ls9-S24 z expnum 263021 exptime 90.0 propid 2012B-0001 seeing 0.93 MJD 56638.138 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131211/c4d_131212_032050_ooi_z_ls9.fits.fz c4d_131027_045040_ooi_g_ls9-S24 g expnum 247232 exptime 90.0 propid 2012B-0001 seeing 1.56 MJD 56592.202 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131026/c4d_131027_045040_ooi_g_ls9.fits.fz c4d_131230_020859_ooi_r_ls9-S24 r expnum 269551 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 56656.088 object DES survey hex 133-410 tiling 3 decam/CP/V4.8.2a/CP20131229/c4d_131230_020859_ooi_r_ls9.fits.fz c4d_171022_065036_ooi_g_v1-N5 g expnum 689785 exptime 90.0 propid 2012B-0001 seeing 1.04 MJD 58048.285 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171021/c4d_171022_065036_ooi_g_v1.fits.fz c4d_171022_064637_ooi_r_v1-N5 r expnum 689783 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 58048.282 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171021/c4d_171022_064637_ooi_r_v1.fits.fz c4d_171124_012135_ooi_z_v1-N5 z expnum 699123 exptime 90.0 propid 2012B-0001 seeing 0.85 MJD 58081.057 object DES survey hex 133-410 tiling 8 decam/CP/V4.1/CP20171123/c4d_171124_012135_ooi_z_v1.fits.fz c4d_131003_075947_ooi_g_ls9-S14 g expnum 240800 exptime 90.0 propid 2012B-0001 seeing 1.52 MJD 56568.333 object DES survey hex 155-420 tiling 2 decam/CP/V4.8.2a/CP20131002/c4d_131003_075947_ooi_g_ls9.fits.fz c4d_131222_025049_ooi_z_ls9-S14 z expnum 267244 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 56648.117 object DES survey hex 155-420 tiling 2 decam/CP/V4.8.2a/CP20131221/c4d_131222_025049_ooi_z_ls9.fits.fz c4d_160903_082020_ooi_g_ls9-N16 g expnum 570487 exptime 90.0 propid 2012B-0001 seeing 1.37 MJD 57634.346 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160902/c4d_160903_082020_ooi_g_ls9.fits.fz c4d_161123_045326_ooi_g_v1-N28 g expnum 595434 exptime 90.0 propid 2012B-0001 seeing 2.11 MJD 57715.202 object DES survey hex 133-410 tiling 6 decam/CP/V4.1/CP20161123/c4d_161123_045326_ooi_g_v1.fits.fz c4d_161205_032139_ooi_g_ls9-N28 g expnum 599755 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57727.138 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2/CP20161204/c4d_161205_032139_ooi_g_ls9.fits.fz c4d_161205_031945_ooi_r_ls9-N28 r expnum 599754 exptime 90.0 propid 2012B-0001 seeing 1.05 MJD 57727.137 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2/CP20161204/c4d_161205_031945_ooi_r_ls9.fits.fz c4d_161010_005939_ooi_z_ls9-N28 z expnum 582383 exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 57671.040 object DES survey hex 133-410 tiling 6 decam/CP/V4.8.2a/CP20161009/c4d_161010_005939_ooi_z_ls9.fits.fz c4d_131015_063640_ooi_z_ls9-N10 z expnum 244324 exptime 90.0 propid 2012B-0001 seeing 0.90 MJD 56580.275 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20131014/c4d_131015_063640_ooi_z_ls9.fits.fz c4d_140102_022057_ooi_r_ls9-N10 r expnum 270598 exptime 90.0 propid 2012B-0001 seeing 1.06 MJD 56659.096 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20140101/c4d_140102_022057_ooi_r_ls9.fits.fz c4d_131011_060823_ooi_g_ls9-N10 g expnum 242795 exptime 90.0 propid 2012B-0001 seeing 1.09 MJD 56576.256 object DES survey hex 133-410 tiling 1 decam/CP/V4.8.2a/CP20131010/c4d_131011_060823_ooi_g_ls9.fits.fz c4d_171126_034943_ooi_z_v1-S19 z expnum 699949 exptime 90.0 propid 2012B-0001 seeing 0.83 MJD 58083.160 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171125/c4d_171126_034943_ooi_z_v1.fits.fz c4d_171209_032506_ooi_g_v1-S19 g expnum 703144 exptime 90.0 propid 2012B-0001 seeing 1.25 MJD 58096.142 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171208/c4d_171209_032506_ooi_g_v1.fits.fz c4d_171124_012334_ooi_r_v1-S19 r expnum 699124 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 58081.058 object DES survey hex 112-420 tiling 9 decam/CP/V4.1/CP20171123/c4d_171124_012334_ooi_r_v1.fits.fz c4d_160902_085210_ooi_r_ls9-N16 r expnum 570223 exptime 90.0 propid 2012B-0001 seeing 1.42 MJD 57633.368 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160901/c4d_160902_085210_ooi_r_ls9.fits.fz c4d_160903_081823_ooi_r_ls9-N16 r expnum 570486 exptime 90.0 propid 2012B-0001 seeing 1.23 MJD 57634.344 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160902/c4d_160903_081823_ooi_r_ls9.fits.fz c4d_160816_062539_ooi_z_ls9-N16 z expnum 565118 exptime 90.0 propid 2012B-0001 seeing 0.91 MJD 57616.266 object DES survey hex 133-410 tiling 5 decam/CP/V4.8.2a/CP20160815/c4d_160816_062539_ooi_z_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95009e7-z-20161111T051948_oi[S18,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-r-20171015T065228_oi[S18,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-g-20171015T065427_oi[S18,noinherit][2046,4094][real]: DE The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131027T045040_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S23,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9610283-r-20131230T020636_oi[S24,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N4,noinherit][2046,4094][real]: DES Zeroing out 0 weight-map pixels below quantization error (= median 6.61e-05) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171022T064637_oi[N5,noinherit][2046,4094][real]: DES Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131003T075947_oi[S14,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612187-z-20131222T024826_oi[S14,noinherit][2046,4094][real]: DES sur Zeroing out 3766 weight-map pixels below quantization error (= median 2.44e-06) The following header keyword is invalid or follows an unrecognized non-standard convention: DES16B_20161121_8e237e6-g-20161123T045102_oi[N28,noinherit][2046,4094][real]: DE Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N5,noinherit][2046,4094][real]: DES Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160903T081759_oi[N16,noinherit][2046,4094][real]: DES sur Zeroing out 3766 weight-map pixels below quantization error (= median 4.2e-05) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505282-g-20161205T031919_oi[N28,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505547-r-20161205T031721_oi[N28,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962dcbe-z-20161010T005716_oi[N28,noinherit][2046,4094][real]: DES sur Zeroing out 3752 weight-map pixels below quantization error (= median 2.45e-06) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T021835_oi[N10,noinherit][2046,4094][real]: DES sur Zeroing out 0 weight-map pixels below quantization error (= median 0.000251) The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T063640_oi[N10,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131011T060823_oi[N10,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171126T034943_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 3.24e-06) Masking 0 additional saturated pixels in DECam expnum 699949 S19 CCD, decam/CP/V4.1/CP20171125/c4d_171126_034943_ooi_z_v1.fits.fz slice (slice(1612, 1885, None), slice(1077, 1349, None)) Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T032506_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 0.000264) Masking 0 additional saturated pixels in DECam expnum 703144 S19 CCD, decam/CP/V4.1/CP20171208/c4d_171209_032506_ooi_g_v1.fits.fz slice (slice(1644, 1917, None), slice(1072, 1344, None)) Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-r-20171124T012334_oi[S19,noinherit][2046,4094][real]: DE Zeroing out 0 weight-map pixels below quantization error (= median 4.37e-05) Masking 0 additional saturated pixels in DECam expnum 699124 S19 CCD, decam/CP/V4.1/CP20171123/c4d_171124_012334_ooi_r_v1.fits.fz slice (slice(1630, 1903, None), slice(1088, 1360, None)) Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160902T084949_oi[N16,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160903T081602_oi[N16,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T062317_oi[N16,noinherit][2046,4094][real]: DES sur Zeroing out 0 weight-map pixels below quantization error (= median 0.00026) The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171022T065036_oi[N5,noinherit][2046,4094][real]: DES Stage tims : Wall: 123.34 s, CPU: 1.08 s, VmPeak: 1009 MB, VmSize: 1009 MB, VmRSS: 190 MB, VmData: 223 MB, maxrss: 0.194088 MB Stage tims finished: 2020-08-10T09:21:12.856954 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-r-20171015T065228_oi[S18,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-r-20171022T064637_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505282-g-20161205T031919_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171125_9031971-z-20171126T034943_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9634c69-g-20131003T075947_oi[S14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9505547-r-20161205T031721_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-r-20171124T012334_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_960fe80-z-20131212T031828_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9612187-z-20131222T024826_oi[S14,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962dcbe-z-20161010T005716_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171208_904ccf3-g-20171209T032506_oi[S19,noinherit][2046,4094][real]: DE [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9636044-g-20131027T045040_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95009e7-z-20161111T051948_oi[S18,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96114d9-r-20140102T021835_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160902T084949_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9610283-r-20131230T020636_oi[S24,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9628d5c-g-20160903T081759_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9635375-g-20131011T060823_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_96294bb-z-20160816T062317_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Resources for stage tims : 10.199 s worker CPU, 866.913 s worker Wall, Wall: 123.343 s, Cores in use: 0.09, Total efficiency (on 8 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171121_902d32a-z-20171124T012135_oi[N4,noinherit][2046,4094][real]: DES [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES16B_20161121_8e237e6-g-20161123T045102_oi[N28,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9633023-z-20131015T063640_oi[N10,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_962a5ea-r-20160903T081602_oi[N16,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Zeroing out 3766 weight-map pixels below quantization error (= median 0.000151) WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171013_8fd9711-g-20171015T065427_oi[S18,noinherit][2046,4094][real]: DE [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DES17B_20171017_8fe5678-g-20171022T065036_oi[N5,noinherit][2046,4094][real]: DES [astropy.io.fits.card] Running stage refs at 2020-08-10T09:21:13.161533 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10180.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-10053.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/reference-custom-013221m41170.fits Stage refs : Wall: 10.52 s, CPU: 1.80 s, VmPeak: 1040 MB, VmSize: 1023 MB, VmRSS: 204 MB, VmData: 237 MB, maxrss: 0.209296 MB Stage refs finished: 2020-08-10T09:21:23.686473 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 10.526 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T09:21:23.756619 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/outlier-mask-custom-013221m41170.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/outliers-pre-custom-013221m41170.jpg Image c4d_131003_075947_ooi_g_ls9-S14 g : masking 301 positive outlier pixels and 65 negative outlier pixels Image c4d_160903_082020_ooi_g_ls9-N16 g : masking 0 positive outlier pixels and 213 negative outlier pixels Image c4d_161123_045326_ooi_g_v1-N28 g : masking 1029 positive outlier pixels and 167 negative outlier pixels Image c4d_161205_032139_ooi_g_ls9-N28 g : masking 749 positive outlier pixels and 0 negative outlier pixels Image c4d_171209_032506_ooi_g_v1-S19 g : masking 260 positive outlier pixels and 0 negative outlier pixels Image c4d_131230_020859_ooi_r_ls9-S24 r : masking 78 positive outlier pixels and 0 negative outlier pixels Image c4d_160903_081823_ooi_r_ls9-N16 r : masking 90 positive outlier pixels and 0 negative outlier pixels Image c4d_160902_085210_ooi_r_ls9-N16 r : masking 62 positive outlier pixels and 63 negative outlier pixels Image c4d_131212_032050_ooi_z_ls9-S24 z : masking 343 positive outlier pixels and 0 negative outlier pixels Image c4d_171124_012135_ooi_z_v1-N5 z : masking 0 positive outlier pixels and 66 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/outlier-mask-custom-013221m41170.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/outliers-post-custom-013221m41170.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/outliers-masked-pos-custom-013221m41170.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/outliers-masked-neg-custom-013221m41170.jpg Stage outliers : Wall: 1.45 s, CPU: 1.19 s, VmPeak: 1040 MB, VmSize: 1033 MB, VmRSS: 227 MB, VmData: 257 MB, maxrss: 0.232916 MB Stage outliers finished: 2020-08-10T09:21:25.208586 Resources for stage outliers : 1.994 s worker CPU, 1.994 s worker Wall, Wall: 1.453 s, Cores in use: 2.19, Total efficiency (on 8 cores): 27.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T09:21:25.259503 Stage halos : Wall: 1.01 s, CPU: 0.56 s, VmPeak: 1040 MB, VmSize: 1033 MB, VmRSS: 228 MB, VmData: 257 MB, maxrss: 0.233236 MB Stage halos finished: 2020-08-10T09:21:26.271671 Resources for stage halos : 0.315 s worker CPU, 2.206 s worker Wall, Wall: 1.013 s, Cores in use: 0.86, Total efficiency (on 8 cores): 10.8 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T09:21:26.362373 PSF sigmas in coadd pixels: ['2.36', '2.53', '1.69', '2.47', '2.23', '3.42', '1.60', '1.77', '2.03'] Using average PSF sigma 2.234807727435901 Gaussian PSF norm 0.12622776819263046 vs pixelized 0.10548043 average tim pixel scale / coadd scale: 1.0010554412564703 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.07', '1.83', '1.59', '1.70', '1.72', '1.80', '2.30', '2.01'] Using average PSF sigma 1.8773178989345183 Gaussian PSF norm 0.15026479635334142 vs pixelized 0.13621014 average tim pixel scale / coadd scale: 1.0010673091209223 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.57', '1.48', '1.42', '1.50', '1.39', '1.73', '1.35', '1.46', '1.35', '1.48'] Using average PSF sigma 1.473802381024797 Gaussian PSF norm 0.19140611754048445 vs pixelized 0.1783109 average tim pixel scale / coadd scale: 1.000999848496965 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.35 s, CPU: 0.34 s, VmPeak: 1040 MB, VmSize: 1033 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.235896 MB Stage fit_on_coadds finished: 2020-08-10T09:21:26.710791 Resources for stage fit_on_coadds : 0.452 s worker CPU, 0.455 s worker Wall, Wall: 0.350 s, Cores in use: 2.28, Total efficiency (on 8 cores): 28.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T09:21:26.724181 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 46 potential peaks Of 46 potential peaks: 12 in veto map, 6 cut by saddle test, 0 cut by aper test, 28 kept SED z : 28 new peaks Found 62 potential peaks Of 62 potential peaks: 39 in veto map, 12 cut by saddle test, 0 cut by aper test, 11 kept SED r : 11 new peaks Found 43 potential peaks Of 43 potential peaks: 36 in veto map, 7 cut by saddle test, 0 cut by aper test, 0 kept SED g : 0 new peaks Found 60 potential peaks Of 60 potential peaks: 43 in veto map, 11 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 72 potential peaks Of 72 potential peaks: 55 in veto map, 13 cut by saddle test, 0 cut by aper test, 4 kept SED Red : 4 new peaks Adding 49 new sources Median coadd sky for g : -9.316832e-05 Median coadd sky for r : -1.8546054e-05 Median coadd sky for z : 0.00027828006 Stage srcs : Wall: 0.73 s, CPU: 0.68 s, VmPeak: 1040 MB, VmSize: 1033 MB, VmRSS: 231 MB, VmData: 258 MB, maxrss: 0.23652 MB Stage srcs finished: 2020-08-10T09:21:27.454269 Resources for stage srcs : 0.098 s worker CPU, 0.098 s worker Wall, Wall: 0.731 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T09:21:27.467225 Blob 1 of 19, id: 0, sources: 20, size: 156x236, npix 16286, brick X: 33,189, Y: 0,236, one pixel: 46 0 Blob 2 of 19, id: 18, sources: 5, size: 95x47, npix 2783, brick X: 83,178, Y: 222,269, one pixel: 151 222 Blob 3 of 19, id: 8, sources: 4, size: 58x58, npix 2188, brick X: 211,269, Y: 74,132, one pixel: 250 74 Blob 4 of 19, id: 9, sources: 1, size: 55x37, npix 1497, brick X: 2,57, Y: 75,112, one pixel: 22 75 Blob 5 of 19, id: 6, sources: 2, size: 53x45, npix 1402, brick X: 142,195, Y: 45,90, one pixel: 157 45 Blob 6 of 19, id: 4, sources: 2, size: 42x52, npix 1393, brick X: 0,42, Y: 21,73, one pixel: 25 21 Blob 7 of 19, id: 17, sources: 3, size: 48x50, npix 1272, brick X: 191,239, Y: 217,267, one pixel: 205 217 Blob 8 of 19, id: 10, sources: 2, size: 36x43, npix 899, brick X: 18,54, Y: 129,172, one pixel: 27 129 Blob 9 of 19, id: 12, sources: 1, size: 35x29, npix 741, brick X: 203,238, Y: 133,162, one pixel: 213 133 Blob 8 finished, total: Wall: 1.29 s, CPU: 1.29 s, VmPeak: 1014 MB, VmSize: 724 MB, VmRSS: 140 MB, VmData: 179 MB, maxrss: 0.143456 MB Blob 10 of 19, id: 1, sources: 1, size: 30x31, npix 616, brick X: 171,201, Y: 0,31, one pixel: 186 0 Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.21 s, CPU: 2.21 s, VmPeak: 969 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149104 MB Blob 11 of 19, id: 5, sources: 1, size: 28x31, npix 594, brick X: 229,257, Y: 26,57, one pixel: 239 26 Measuring 1 iterative sources Measuring 1 iterative sources Blob 7 finished, total: Wall: 3.03 s, CPU: 3.03 s, VmPeak: 1024 MB, VmSize: 729 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149956 MB Blob 12 of 19, id: 2, sources: 1, size: 29x24, npix 459, brick X: 222,251, Y: 0,24, one pixel: 226 0 Blob 9 finished, total: Wall: 1.87 s, CPU: 1.87 s, VmPeak: 1014 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145384 MB Measuring 1 iterative sources Blob 13 of 19, id: 3, sources: 1, size: 22x22, npix 299, brick X: 127,149, Y: 3,25, one pixel: 137 3 Blob 5 finished, total: Wall: 3.26 s, CPU: 3.26 s, VmPeak: 1028 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145184 MB Blob 14 of 19, id: 13, sources: 1, size: 19x19, npix 217, brick X: 2,21, Y: 154,173, one pixel: 10 154 Blob 10 finished, total: Wall: 1.26 s, CPU: 1.26 s, VmPeak: 969 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149104 MB Blob 15 of 19, id: 14, sources: 1, size: 16x20, npix 193, brick X: 253,269, Y: 167,187, one pixel: 262 167 Blob 14 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 969 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149104 MB Blob 16 of 19, id: 15, sources: 1, size: 18x18, npix 180, brick X: 222,240, Y: 183,201, one pixel: 230 183 Blob 13 finished, total: Wall: 0.80 s, CPU: 0.80 s, VmPeak: 1028 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14544 MB Blob 17 of 19, id: 7, sources: 1, size: 18x17, npix 162, brick X: 213,231, Y: 53,70, one pixel: 221 53 Measuring 1 iterative sources Blob 15 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 969 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149104 MB Blob 18 of 19, id: 11, sources: 1, size: 17x17, npix 145, brick X: 242,259, Y: 130,147, one pixel: 250 130 Blob 16 finished, total: Wall: 0.43 s, CPU: 0.43 s, VmPeak: 1028 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14544 MB Blob 19 of 19, id: 16, sources: 1, size: 17x17, npix 145, brick X: 62,79, Y: 195,212, one pixel: 70 195 Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1028 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.14544 MB Blob 19 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1028 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145632 MB Blob 17 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 969 MB, VmSize: 727 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149104 MB Blob 11 finished, total: Wall: 1.66 s, CPU: 1.66 s, VmPeak: 1024 MB, VmSize: 729 MB, VmRSS: 146 MB, VmData: 184 MB, maxrss: 0.149956 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 4.96 s, CPU: 4.96 s, VmPeak: 1023 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.148644 MB Blob 12 finished, total: Wall: 1.81 s, CPU: 1.81 s, VmPeak: 1014 MB, VmSize: 724 MB, VmRSS: 142 MB, VmData: 179 MB, maxrss: 0.145384 MB Measuring 2 iterative sources Blob 3 finished, total: Wall: 5.60 s, CPU: 5.60 s, VmPeak: 1025 MB, VmSize: 727 MB, VmRSS: 145 MB, VmData: 182 MB, maxrss: 0.1486 MB Blob 2 finished, total: Wall: 7.90 s, CPU: 7.89 s, VmPeak: 1023 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147956 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.32151, ee1=-0.0238382, ee2=0.0183364 Measuring 5 iterative sources Blob 1 finished, total: Wall: 19.71 s, CPU: 19.71 s, VmPeak: 938 MB, VmSize: 727 MB, VmRSS: 151 MB, VmData: 182 MB, maxrss: 0.15508 MB Old catalog: 51 New catalog: 55 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/blobs-custom-013221m41170.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/metrics/cus/all-models-custom-013221m41170.fits Stage fitblobs : Wall: 20.27 s, CPU: 0.57 s, VmPeak: 1040 MB, VmSize: 1033 MB, VmRSS: 231 MB, VmData: 258 MB, maxrss: 0.23694 MB Stage fitblobs finished: 2020-08-10T09:21:47.737157 Resources for stage fitblobs : 57.334 s worker CPU, 57.397 s worker Wall, Wall: 20.271 s, Cores in use: 2.86, Total efficiency (on 8 cores): 35.7 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T09:21:47.751084 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-resid.jpg Stage coadds : Wall: 1.65 s, CPU: 0.73 s, VmPeak: 1040 MB, VmSize: 1033 MB, VmRSS: 232 MB, VmData: 258 MB, maxrss: 0.237388 MB Stage coadds finished: 2020-08-10T09:21:49.402411 Resources for stage coadds : 4.713 s worker CPU, 5.145 s worker Wall, Wall: 1.652 s, Cores in use: 3.29, Total efficiency (on 8 cores): 41.2 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T09:21:49.414302 Cut to 1 unWISE tiles Reading WISE tile 0138m409 band 1 Reading WISE tile 0138m409 band 3 Reading WISE tile 0138m409 band 2 Reading WISE tile 0138m409 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1025 MB, VmSize: 805 MB, VmRSS: 151 MB, VmData: 176 MB, maxrss: 0.214988 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 1023 MB, VmSize: 801 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.207296 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.10 s, VmPeak: 938 MB, VmSize: 811 MB, VmRSS: 158 MB, VmData: 182 MB, maxrss: 0.200904 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/013/0138m409/unwise-0138m409-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 1028 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.20776 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/tmp-legacysurvey-custom-013221m41170-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 4.97 s, CPU: 0.59 s, VmPeak: 1040 MB, VmSize: 1033 MB, VmRSS: 233 MB, VmData: 258 MB, maxrss: 0.238096 MB Stage wise_forced finished: 2020-08-10T09:21:54.386613 Resources for stage wise_forced : 3.185 s worker CPU, 8.917 s worker Wall, Wall: 4.974 s, Cores in use: 0.76, Total efficiency (on 8 cores): 9.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T09:21:54.400539 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/coadd/cus/custom-013221m41170/legacysurvey-custom-013221m41170-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/tractor-i/cus/tractor-custom-013221m41170.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/tractor/cus/tractor-custom-013221m41170.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/tractor/cus/brick-custom-013221m41170.sha256sum Stage writecat : Wall: 1.11 s, CPU: 0.87 s, VmPeak: 1165 MB, VmSize: 1037 MB, VmRSS: 234 MB, VmData: 258 MB, maxrss: 0.371084 MB Stage writecat finished: 2020-08-10T09:21:55.506249 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.107 s, Cores in use: 0.78, Total efficiency (on 8 cores): 9.8 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/013/PGC578368/PGC578368-largegalaxy-writecat.p All done: 78.292 s worker CPU, 943.127 s worker Wall, Wall: 166.040 s, Cores in use: 0.52, Total efficiency (on 8 cores): 6.5 % Finished galaxy PGC578368 in 2.798 minutes.