Started working on galaxy PGC1788736 at Wed Aug 5 21:54:12 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.64446300000003 26.8001614 --width 353 --height 353 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:54:13.586800 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '267.64446300000003', '26.8001614', '--width', '353', '--height', '353', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 267.64446300000003 26.8001614 --width 353 --height 353 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 267.64446300000003 26.8001614 Starting process 40913 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 40915 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 40917 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 40919 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 40921 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 40923 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 40925 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 40927 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 40929 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 40931 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 40933 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40935 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40937 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40938 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40940 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 40942 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:54:14.164351 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 17 CCDs: c4d_170820_004559_ooi_g_ls9-N1 g expnum 669393 exptime 200.0 propid 2014B-0404 seeing 1.87 MJD 57985.032 object DECaLS_18786_g decam/CP/V4.8.2a/CP20170819/c4d_170820_004559_ooi_g_ls9.fits.fz c4d_170317_092826_ooi_z_ls9-N1 z expnum 631088 exptime 217.0 propid 2014B-0404 seeing 0.96 MJD 57829.392 object DECaLS_18786_z decam/CP/V4.8.2/CP20170316/c4d_170317_092826_ooi_z_ls9.fits.fz c4d_170725_020351_ooi_r_ls9-N1 r expnum 661866 exptime 111.0 propid 2014B-0404 seeing 1.40 MJD 57959.084 object DECaLS_18786_r decam/CP/V4.8.2a/CP20170724/c4d_170725_020351_ooi_r_ls9.fits.fz c4d_150408_093651_ooi_z_ls9-N2 z expnum 430529 exptime 109.0 propid 2014B-0404 seeing 0.87 MJD 57120.399 object DECaLS_2914_z decam/CP/V4.8.2a/CP20150407/c4d_150408_093651_ooi_z_ls9.fits.fz c4d_170722_022549_ooi_r_ls9-N2 r expnum 660823 exptime 65.0 propid 2014B-0404 seeing 1.31 MJD 57956.100 object DECaLS_2914_r decam/CP/V4.8.2a/CP20170721/c4d_170722_022549_ooi_r_ls9.fits.fz c4d_180811_020946_ooi_g_ls9-N2 g expnum 764060 exptime 76.0 propid 2014B-0404 seeing 1.15 MJD 58341.090 object DECaLS_47938_g decam/CP/V4.8.2a/CP20180810/c4d_180811_020946_ooi_g_ls9.fits.fz c4d_180901_234433_ooi_z_ls9-N2 z expnum 767823 exptime 166.0 propid 2014B-0404 seeing 1.57 MJD 58362.989 object DECaLS_47938_z decam/CP/V4.8.2a/CP20180901/c4d_180901_234433_ooi_z_ls9.fits.fz c4d_180810_020409_ooi_r_ls9-N2 r expnum 763624 exptime 62.0 propid 2014B-0404 seeing 1.20 MJD 58340.086 object DECaLS_47938_r decam/CP/V4.8.2a/CP20180809/c4d_180810_020409_ooi_r_ls9.fits.fz c4d_180905_233412_ooi_z_ls9-S28 z expnum 769442 exptime 120.0 propid 2014B-0404 seeing 0.98 MJD 58366.982 object DECaLS_34657_z decam/CP/V4.8.2a/CP20180905/c4d_180905_233412_ooi_z_ls9.fits.fz c4d_180908_002522_ooi_r_ls9-S28 r expnum 770505 exptime 125.0 propid 2014B-0404 seeing 1.07 MJD 58369.018 object DECaLS_34657_r decam/CP/V4.8.2a/CP20180907/c4d_180908_002522_ooi_r_ls9.fits.fz c4d_180904_000623_ooi_g_ls9-S28 g expnum 768646 exptime 148.0 propid 2014B-0404 seeing 1.79 MJD 58365.004 object DECaLS_34657_g decam/CP/V4.8.2a/CP20180903/c4d_180904_000623_ooi_g_ls9.fits.fz c4d_180905_234336_ooi_z_ls9-N1 z expnum 769445 exptime 145.0 propid 2014B-0404 seeing 0.93 MJD 58366.989 object DECaLS_34658_z decam/CP/V4.8.2a/CP20180905/c4d_180905_234336_ooi_z_ls9.fits.fz c4d_180812_014012_ooi_r_ls9-N1 r expnum 764518 exptime 48.0 propid 2014B-0404 seeing 1.03 MJD 58342.070 object DECaLS_34658_r decam/CP/V4.8.2a/CP20180811/c4d_180812_014012_ooi_r_ls9.fits.fz c4d_180908_005425_ooi_g_ls9-N1 g expnum 770517 exptime 187.0 propid 2014B-0404 seeing 1.61 MJD 58369.038 object DECaLS_34658_g decam/CP/V4.8.2a/CP20180907/c4d_180908_005425_ooi_g_ls9.fits.fz c4d_170820_004559_ooi_g_ls9-N2 g expnum 669393 exptime 200.0 propid 2014B-0404 seeing 1.82 MJD 57985.032 object DECaLS_18786_g decam/CP/V4.8.2a/CP20170819/c4d_170820_004559_ooi_g_ls9.fits.fz c4d_170317_092826_ooi_z_ls9-N2 z expnum 631088 exptime 217.0 propid 2014B-0404 seeing 0.91 MJD 57829.392 object DECaLS_18786_z decam/CP/V4.8.2/CP20170316/c4d_170317_092826_ooi_z_ls9.fits.fz c4d_170725_020351_ooi_r_ls9-N2 r expnum 661866 exptime 111.0 propid 2014B-0404 seeing 1.37 MJD 57959.084 object DECaLS_18786_r decam/CP/V4.8.2a/CP20170724/c4d_170725_020351_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521c06-g-20170820T004559_oi[N2,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521c06-g-20170820T004559_oi[N1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534b3a-r-20180908T002522_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T020106_oi[N1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T020946_oi[N2,noinherit][2046,4094][real]: DECaLS_4 Clipping 9 pixels with anomalously large oow values: max 0.0696804 vs median 0.0518578 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T233412_oi[S28,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T093411_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T092401_oi[N1,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T022352_oi[N2,noinherit][2046,4094][real]: DECaLS_2 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T092401_oi[N2,noinherit][2046,4094][real]: DECaLS_1 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T234433_oi[N2,noinherit][2046,4094][real]: DECaLS_47938 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014012_oi[N1,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T234336_oi[N1,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T005425_oi[N1,noinherit][2046,4094][real]: DECaLS_3 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T000623_oi[S28,noinherit][2046,4094][real]: DECaLS_3465 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953157b-r-20180810T020409_oi[N2,noinherit][2046,4094][real]: DECaLS_4 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T020106_oi[N2,noinherit][2046,4094][real]: DECaLS_1 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 82.23 s, CPU: 1.12 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 190 MB, VmData: 222 MB, maxrss: 0.194864 MB Stage tims finished: 2020-08-05T21:55:36.391534 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95328e1-g-20180811T020946_oi[N2,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9577b3f-z-20150408T093411_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T020106_oi[N1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9535c38-g-20180908T005425_oi[N1,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534b3a-r-20180908T002522_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T092401_oi[N1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T234336_oi[N1,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952d014-z-20180905T233412_oi[S28,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180904T000623_oi[S28,noinherit][2046,4094][real]: DECaLS_3465 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521c06-g-20170820T004559_oi[N2,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9521c06-g-20170820T004559_oi[N1,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T234433_oi[N2,noinherit][2046,4094][real]: DECaLS_47938 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951ffb4-r-20170725T020106_oi[N2,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180812T014012_oi[N1,noinherit][2046,4094][real]: DECaLS_3 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 11.282 s worker CPU, 827.724 s worker Wall, Wall: 82.229 s, Cores in use: 0.15, Total efficiency (on 16 cores): 0.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T022352_oi[N2,noinherit][2046,4094][real]: DECaLS_2 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9510adb-z-20170317T092401_oi[N2,noinherit][2046,4094][real]: DECaLS_1 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953157b-r-20180810T020409_oi[N2,noinherit][2046,4094][real]: DECaLS_4 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T21:55:36.687153 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03359.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03358.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03487.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/reference-custom-267644p26800.fits Stage refs : Wall: 14.48 s, CPU: 7.16 s, VmPeak: 1101 MB, VmSize: 1096 MB, VmRSS: 275 MB, VmData: 305 MB, maxrss: 0.281788 MB Stage refs finished: 2020-08-05T21:55:51.168624 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 14.483 s, Cores in use: 0.49, Total efficiency (on 16 cores): 3.1 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:55:51.622778 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/outlier-mask-custom-267644p26800.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/outliers-pre-custom-267644p26800.jpg Image c4d_170820_004559_ooi_g_ls9-N2 g : masking 64 positive outlier pixels and 0 negative outlier pixels Image c4d_180904_000623_ooi_g_ls9-S28 g : masking 4196 positive outlier pixels and 0 negative outlier pixels Image c4d_180908_005425_ooi_g_ls9-N1 g : masking 787 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_022549_ooi_r_ls9-N2 r : masking 341 positive outlier pixels and 68 negative outlier pixels Image c4d_170317_092826_ooi_z_ls9-N1 z : masking 137 positive outlier pixels and 0 negative outlier pixels Image c4d_170317_092826_ooi_z_ls9-N2 z : masking 195 positive outlier pixels and 0 negative outlier pixels Image c4d_180901_234433_ooi_z_ls9-N2 z : masking 199 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_234336_ooi_z_ls9-N1 z : masking 510 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_233412_ooi_z_ls9-S28 z : masking 599 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/outlier-mask-custom-267644p26800.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/outliers-post-custom-267644p26800.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/outliers-masked-pos-custom-267644p26800.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/outliers-masked-neg-custom-267644p26800.jpg Stage outliers : Wall: 1.40 s, CPU: 1.04 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 303 MB, VmData: 329 MB, maxrss: 0.309792 MB Stage outliers finished: 2020-08-05T21:55:53.018793 Resources for stage outliers : 2.084 s worker CPU, 2.084 s worker Wall, Wall: 1.397 s, Cores in use: 2.24, Total efficiency (on 16 cores): 14.0 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:55:53.058836 Stage halos : Wall: 1.24 s, CPU: 0.79 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 303 MB, VmData: 329 MB, maxrss: 0.310048 MB Stage halos finished: 2020-08-05T21:55:54.302555 Resources for stage halos : 1.090 s worker CPU, 2.946 s worker Wall, Wall: 1.245 s, Cores in use: 1.51, Total efficiency (on 16 cores): 9.4 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:55:54.695202 PSF sigmas in coadd pixels: ['3.04', '1.87', '2.90', '2.61', '2.96'] Using average PSF sigma 2.678365764684389 Gaussian PSF norm 0.10532347579014079 vs pixelized 0.08989375 average tim pixel scale / coadd scale: 1.0012582038664295 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-copsf-g.fits.fz PSF sigmas in coadd pixels: ['2.28', '2.13', '1.95', '1.73', '1.67', '2.22'] Using average PSF sigma 1.99573208034204 Gaussian PSF norm 0.14134902903676888 vs pixelized 0.12112212 average tim pixel scale / coadd scale: 1.0012746030973085 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.55', '1.41', '2.56', '1.60', '1.51', '1.49'] Using average PSF sigma 1.6860289021640895 Gaussian PSF norm 0.1673131411992983 vs pixelized 0.1422293 average tim pixel scale / coadd scale: 1.0012739365973744 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.33 s, CPU: 0.33 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 304 MB, VmData: 330 MB, maxrss: 0.311696 MB Stage fit_on_coadds finished: 2020-08-05T21:55:55.027167 Resources for stage fit_on_coadds : 0.523 s worker CPU, 0.523 s worker Wall, Wall: 0.334 s, Cores in use: 2.56, Total efficiency (on 16 cores): 16.0 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:55:55.049943 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 121 potential peaks Of 121 potential peaks: 49 in veto map, 13 cut by saddle test, 0 cut by aper test, 59 kept SED z : 59 new peaks Found 123 potential peaks Of 123 potential peaks: 95 in veto map, 10 cut by saddle test, 0 cut by aper test, 18 kept SED r : 18 new peaks Found 84 potential peaks Of 84 potential peaks: 74 in veto map, 7 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 131 potential peaks Of 131 potential peaks: 117 in veto map, 12 cut by saddle test, 0 cut by aper test, 2 kept SED Flat : 2 new peaks Found 161 potential peaks Of 161 potential peaks: 145 in veto map, 14 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 84 new sources Median coadd sky for g : 8.501618e-05 Median coadd sky for r : 0.0002613953 Median coadd sky for z : 0.0007107475 Stage srcs : Wall: 1.38 s, CPU: 1.33 s, VmPeak: 1105 MB, VmSize: 1105 MB, VmRSS: 305 MB, VmData: 330 MB, maxrss: 0.312228 MB Stage srcs finished: 2020-08-05T21:55:56.434324 Resources for stage srcs : 0.127 s worker CPU, 0.127 s worker Wall, Wall: 1.386 s, Cores in use: 1.06, Total efficiency (on 16 cores): 6.6 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:55:56.553424 Blob 1 of 25, id: 7, sources: 33, size: 250x243, npix 32042, brick X: 25,275, Y: 57,300, one pixel: 215 57 Blob 2 of 25, id: 21, sources: 8, size: 126x105, npix 7012, brick X: 227,353, Y: 242,347, one pixel: 279 242 Blob 3 of 25, id: 1, sources: 5, size: 118x60, npix 3907, brick X: 186,304, Y: 0,60, one pixel: 192 0 Blob 4 of 25, id: 0, sources: 7, size: 79x89, npix 3106, brick X: 63,142, Y: 0,89, one pixel: 69 0 Blob 5 of 25, id: 13, sources: 6, size: 57x104, npix 3009, brick X: 288,345, Y: 108,212, one pixel: 306 108 Blob 6 of 25, id: 3, sources: 4, size: 48x87, npix 2311, brick X: 136,184, Y: 3,90, one pixel: 159 3 Blob 7 of 25, id: 22, sources: 6, size: 57x70, npix 2239, brick X: 125,182, Y: 283,353, one pixel: 160 283 Blob 8 of 25, id: 4, sources: 3, size: 45x78, npix 2005, brick X: 0,45, Y: 11,89, one pixel: 4 11 Blob 9 of 25, id: 24, sources: 6, size: 66x51, npix 1757, brick X: 43,109, Y: 300,351, one pixel: 95 300 Blob 10 of 25, id: 23, sources: 1, size: 42x47, npix 1301, brick X: 192,234, Y: 295,342, one pixel: 204 295 Blob 11 of 25, id: 18, sources: 1, size: 48x34, npix 1055, brick X: 26,74, Y: 169,203, one pixel: 54 169 Blob 12 of 25, id: 15, sources: 2, size: 33x43, npix 847, brick X: 5,38, Y: 142,185, one pixel: 22 142 Blob 13 of 25, id: 5, sources: 2, size: 41x30, npix 809, brick X: 312,353, Y: 16,46, one pixel: 334 16 Blob 14 of 25, id: 12, sources: 1, size: 29x35, npix 742, brick X: 0,29, Y: 93,128, one pixel: 8 93 Blob 15 of 25, id: 10, sources: 1, size: 33x32, npix 719, brick X: 277,310, Y: 77,109, one pixel: 290 77 Blob 16 of 25, id: 6, sources: 1, size: 30x31, npix 628, brick X: 169,199, Y: 17,48, one pixel: 181 17 Blob 17 of 25, id: 8, sources: 2, size: 24x42, npix 586, brick X: 43,67, Y: 60,102, one pixel: 52 60 Measuring 1 iterative sources Blob 15 finished, total: Wall: 1.21 s, CPU: 1.21 s, VmPeak: 964 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.15628 MB Blob 16 finished, total: Wall: 1.22 s, CPU: 1.22 s, VmPeak: 941 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.152056 MB Blob 18 of 25, id: 14, sources: 1, size: 26x24, npix 377, brick X: 98,124, Y: 119,143, one pixel: 110 119 Blob 19 of 25, id: 11, sources: 1, size: 19x28, npix 376, brick X: 334,353, Y: 90,118, one pixel: 345 90 Measuring 1 iterative sources Blob 10 finished, total: Wall: 1.39 s, CPU: 1.35 s, VmPeak: 955 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.15676 MB Blob 20 of 25, id: 16, sources: 1, size: 23x24, npix 328, brick X: 55,78, Y: 143,167, one pixel: 65 143 Blob 14 finished, total: Wall: 1.58 s, CPU: 1.58 s, VmPeak: 942 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151892 MB Blob 21 of 25, id: 9, sources: 1, size: 23x22, npix 323, brick X: 314,337, Y: 65,87, one pixel: 323 65 Blob 20 finished, total: Wall: 0.44 s, CPU: 0.44 s, VmPeak: 942 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.15264 MB Blob 22 of 25, id: 17, sources: 1, size: 23x22, npix 316, brick X: 272,295, Y: 164,186, one pixel: 281 164 Measuring 1 iterative sources Blob 18 finished, total: Wall: 0.94 s, CPU: 0.94 s, VmPeak: 941 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152324 MB Blob 23 of 25, id: 19, sources: 1, size: 16x24, npix 267, brick X: 337,353, Y: 187,211, one pixel: 346 187 Blob 12 finished, total: Wall: 2.24 s, CPU: 2.24 s, VmPeak: 965 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150476 MB Blob 24 of 25, id: 2, sources: 1, size: 23x15, npix 242, brick X: 315,338, Y: 0,15, one pixel: 318 0 Blob 21 finished, total: Wall: 0.33 s, CPU: 0.33 s, VmPeak: 942 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.15264 MB Blob 25 of 25, id: 20, sources: 1, size: 17x18, npix 162, brick X: 335,352, Y: 231,249, one pixel: 343 231 Blob 19 finished, total: Wall: 1.03 s, CPU: 1.03 s, VmPeak: 955 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.15676 MB Blob 11 finished, total: Wall: 2.45 s, CPU: 2.36 s, VmPeak: 954 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156728 MB Blob 17 finished, total: Wall: 1.19 s, CPU: 1.19 s, VmPeak: 964 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156564 MB Blob 22 finished, total: Wall: 0.25 s, CPU: 0.25 s, VmPeak: 941 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152324 MB Blob 25 finished, total: Wall: 0.38 s, CPU: 0.38 s, VmPeak: 955 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.15676 MB Blob 24 finished, total: Wall: 0.75 s, CPU: 0.75 s, VmPeak: 942 MB, VmSize: 734 MB, VmRSS: 149 MB, VmData: 183 MB, maxrss: 0.15264 MB Blob 13 finished, total: Wall: 3.27 s, CPU: 3.26 s, VmPeak: 977 MB, VmSize: 705 MB, VmRSS: 121 MB, VmData: 154 MB, maxrss: 0.157876 MB Blob 23 finished, total: Wall: 1.23 s, CPU: 1.23 s, VmPeak: 965 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150476 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 3.88 s, CPU: 3.82 s, VmPeak: 957 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 186 MB, maxrss: 0.156104 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 4.86 s, CPU: 4.86 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 154 MB, VmData: 187 MB, maxrss: 0.15732 MB Measuring 1 iterative sources Measuring 2 iterative sources Blob 3 finished, total: Wall: 5.05 s, CPU: 5.05 s, VmPeak: 962 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156908 MB Blob 7 finished, total: Wall: 5.23 s, CPU: 5.23 s, VmPeak: 957 MB, VmSize: 733 MB, VmRSS: 149 MB, VmData: 182 MB, maxrss: 0.152436 MB Blob 9 finished, total: Wall: 5.68 s, CPU: 5.67 s, VmPeak: 956 MB, VmSize: 738 MB, VmRSS: 154 MB, VmData: 187 MB, maxrss: 0.157636 MB Measuring 2 iterative sources Blob 4 finished, total: Wall: 5.78 s, CPU: 5.78 s, VmPeak: 957 MB, VmSize: 738 MB, VmRSS: 154 MB, VmData: 187 MB, maxrss: 0.15728 MB Blob 2 finished, total: Wall: 7.13 s, CPU: 7.12 s, VmPeak: 949 MB, VmSize: 734 MB, VmRSS: 150 MB, VmData: 183 MB, maxrss: 0.153532 MB Blob 5 finished, total: Wall: 7.58 s, CPU: 7.58 s, VmPeak: 957 MB, VmSize: 738 MB, VmRSS: 154 MB, VmData: 187 MB, maxrss: 0.157872 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.49584, ee1=-0.00697449, ee2=0.108481 Measuring 12 iterative sources Blob 1 finished, total: Wall: 44.87 s, CPU: 44.84 s, VmPeak: 959 MB, VmSize: 736 MB, VmRSS: 157 MB, VmData: 185 MB, maxrss: 0.177872 MB Old catalog: 108 New catalog: 114 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/blobs-custom-267644p26800.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/metrics/cus/all-models-custom-267644p26800.fits Stage fitblobs : Wall: 45.48 s, CPU: 0.90 s, VmPeak: 1105 MB, VmSize: 1050 MB, VmRSS: 250 MB, VmData: 275 MB, maxrss: 0.31252 MB Stage fitblobs finished: 2020-08-05T21:56:42.031615 Resources for stage fitblobs : 110.074 s worker CPU, 110.510 s worker Wall, Wall: 45.480 s, Cores in use: 2.44, Total efficiency (on 16 cores): 15.3 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:56:42.049650 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/tmp-legacysurvey-custom-267644p26800-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/tmp-legacysurvey-custom-267644p26800-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/tmp-legacysurvey-custom-267644p26800-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/tmp-legacysurvey-custom-267644p26800-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-resid.jpg Stage coadds : Wall: 2.64 s, CPU: 0.80 s, VmPeak: 1105 MB, VmSize: 1051 MB, VmRSS: 251 MB, VmData: 278 MB, maxrss: 0.31252 MB Stage coadds finished: 2020-08-05T21:56:44.688034 Resources for stage coadds : 17.314 s worker CPU, 22.745 s worker Wall, Wall: 2.640 s, Cores in use: 6.86, Total efficiency (on 16 cores): 42.9 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T21:56:44.953120 Cut to 1 unWISE tiles Reading WISE tile 2670p272 band 1 Reading WISE tile 2670p272 band 2 Reading WISE tile 2670p272 band 3 Reading WISE tile 2670p272 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.32 s, CPU: 0.98 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 154 MB, VmData: 190 MB, maxrss: 0.1939 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.24 s, CPU: 0.65 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 152 MB, VmData: 189 MB, maxrss: 0.214168 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.18 s, CPU: 0.42 s, VmPeak: 1014 MB, VmSize: 1014 MB, VmRSS: 149 MB, VmData: 187 MB, maxrss: 0.212356 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/267/2670p272/unwise-2670p272-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.17 s, CPU: 0.39 s, VmPeak: 1013 MB, VmSize: 1013 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.212624 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/tmp-legacysurvey-custom-267644p26800-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/tmp-legacysurvey-custom-267644p26800-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.61 s, CPU: 0.79 s, VmPeak: 1105 MB, VmSize: 1051 MB, VmRSS: 252 MB, VmData: 278 MB, maxrss: 0.31252 MB Stage wise_forced finished: 2020-08-05T21:56:47.559797 Resources for stage wise_forced : 5.497 s worker CPU, 5.563 s worker Wall, Wall: 2.608 s, Cores in use: 2.41, Total efficiency (on 16 cores): 15.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:56:47.583421 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/coadd/cus/custom-267644p26800/legacysurvey-custom-267644p26800-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/tractor-i/cus/tractor-custom-267644p26800.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/tractor/cus/tractor-custom-267644p26800.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/tractor/cus/brick-custom-267644p26800.sha256sum Stage writecat : Wall: 4.16 s, CPU: 1.46 s, VmPeak: 1183 MB, VmSize: 1055 MB, VmRSS: 254 MB, VmData: 278 MB, maxrss: 0.390672 MB Stage writecat finished: 2020-08-05T21:56:51.745733 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 4.164 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/267/PGC1788736/PGC1788736-largegalaxy-writecat.p All done: 147.996 s worker CPU, 972.226 s worker Wall, Wall: 157.740 s, Cores in use: 1.04, Total efficiency (on 16 cores): 6.5 % Finished galaxy PGC1788736 in 2.672 minutes.