Started working on galaxy PGC1040411 at Wed Aug 5 18:57:35 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.335122 -5.7870585 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T18:57:36.623541 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.335122', '-5.7870585', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '32', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.335122 -5.7870585 --width 233 --height 233 --pixscale 0.262 --threads 32 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.335122 -5.7870585 Starting process 33930 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 33932 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 33934 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33936 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 33939 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 33941 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33943 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33945 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33946 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 33948 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33950 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 33952 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 33954 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 33956 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 33958 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33960 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 33962 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059276 MB Starting process 33966 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05928 MB Starting process 33967 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059284 MB Starting process 33968 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 33969 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059288 MB Starting process 33970 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059292 MB Starting process 33971 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059296 MB Starting process 33973 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 33974 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 33976 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 33977 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.0593 MB Starting process 33978 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059308 MB Starting process 33979 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 33980 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 33981 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059312 MB Starting process 33982 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T18:57:37.088050 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 15 CCDs: c4d_160803_043243_ooi_r_ls9-S21 r expnum 558559 exptime 52.0 propid 2014B-0404 seeing 0.97 MJD 57603.188 object DECaLS_11758_r decam/CP/V4.8.2a/CP20160802/c4d_160803_043243_ooi_r_ls9.fits.fz c4d_160803_043408_ooi_g_ls9-S21 g expnum 558560 exptime 56.0 propid 2014B-0404 seeing 1.16 MJD 57603.189 object DECaLS_11758_g decam/CP/V4.8.2a/CP20160802/c4d_160803_043408_ooi_g_ls9.fits.fz c4d_160812_032939_ooi_z_ls9-S21 z expnum 563104 exptime 80.0 propid 2014B-0404 seeing 1.02 MJD 57612.144 object DECaLS_11758_z decam/CP/V4.8.2a/CP20160811/c4d_160812_032939_ooi_z_ls9.fits.fz c4d_180905_013038_ooi_g_ls9-N16 g expnum 768987 exptime 66.0 propid 2014B-0404 seeing 1.15 MJD 58366.063 object DECaLS_52078_g decam/CP/V4.8.2a/CP20180904/c4d_180905_013038_ooi_g_ls9.fits.fz c4d_180905_012705_ooi_g_ls9-S31 g expnum 768985 exptime 66.0 propid 2014B-0404 seeing 1.32 MJD 58366.060 object DECaLS_51883_g decam/CP/V4.8.2a/CP20180904/c4d_180905_012705_ooi_g_ls9.fits.fz c4d_180906_005235_ooi_g_ls9-N19 g expnum 769481 exptime 57.0 propid 2014B-0404 seeing 1.05 MJD 58367.037 object DECaLS_59215_g decam/CP/V4.8.2a/CP20180905/c4d_180906_005235_ooi_g_ls9.fits.fz c4d_170722_042032_ooi_r_ls9-N31 r expnum 660878 exptime 40.0 propid 2014B-0404 seeing 0.85 MJD 57956.180 object DECaLS_11759_r decam/CP/V4.8.2a/CP20170721/c4d_170722_042032_ooi_r_ls9.fits.fz c4d_160813_024709_ooi_z_ls9-N31 z expnum 563504 exptime 82.0 propid 2014B-0404 seeing 0.82 MJD 57613.114 object DECaLS_11759_z decam/CP/V4.8.2a/CP20160812/c4d_160813_024709_ooi_z_ls9.fits.fz c4d_160803_043122_ooi_g_ls9-N31 g expnum 558558 exptime 57.0 propid 2014B-0404 seeing 1.14 MJD 57603.187 object DECaLS_11759_g decam/CP/V4.8.2a/CP20160802/c4d_160803_043122_ooi_g_ls9.fits.fz c4d_170916_005446_ooi_r_ls9-S24 r expnum 677952 exptime 175.0 propid 2014B-0404 seeing 1.73 MJD 58012.038 object DECaLS_43485_r decam/CP/V4.8.2a/CP20170915/c4d_170916_005446_ooi_r_ls9.fits.fz c4d_180901_053715_ooi_z_ls9-S24 z expnum 767582 exptime 124.0 propid 2014B-0404 seeing 1.26 MJD 58362.234 object DECaLS_43485_z decam/CP/V4.8.2a/CP20180831/c4d_180901_053715_ooi_z_ls9.fits.fz c4d_180902_011433_ooi_g_ls9-S24 g expnum 767844 exptime 122.0 propid 2014B-0404 seeing 1.73 MJD 58363.052 object DECaLS_43485_g decam/CP/V4.8.2a/CP20180901/c4d_180902_011433_ooi_g_ls9.fits.fz c4d_180903_010735_ooi_r_ls9-S20 r expnum 768251 exptime 72.0 propid 2014B-0404 seeing 1.31 MJD 58364.047 object DECaLS_27630_r decam/CP/V4.8.2a/CP20180902/c4d_180903_010735_ooi_r_ls9.fits.fz c4d_180914_010052_ooi_z_ls9-S20 z expnum 773188 exptime 104.0 propid 2014B-0404 seeing 1.17 MJD 58375.042 object DECaLS_27630_z decam/CP/V4.8.2a/CP20180913/c4d_180914_010052_ooi_z_ls9.fits.fz c4d_180830_005856_ooi_g_ls9-S20 g expnum 766972 exptime 158.0 propid 2014B-0404 seeing 1.67 MJD 58360.041 object DECaLS_27630_g decam/CP/V4.8.2a/CP20180829/c4d_180830_005856_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T012705_oi[S31,noinherit][2046,4094][real]: DECaLS_ Clipping 12 pixels with anomalously large oow values: max 0.0608507 vs median 0.0446395 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T010735_oi[S20,noinherit][2046,4094][real]: DECaLS_2763 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566d23-r-20160803T043100_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180902T011433_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013038_oi[N16,noinherit][2046,4094][real]: DECaLS_ Clipping 2 pixels with anomalously large oow values: max 0.0558963 vs median 0.0428889 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024449_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T010052_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T005235_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95338e1-g-20180830T005856_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T042933_oi[N31,noinherit][2046,4094][real]: DECaLS_ Clipping 7 pixels with anomalously large oow values: max 0.0713 vs median 0.0504244 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T041859_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032724_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T053715_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values Swapping in SKY_JOHN values for 1 splinesky cells; 2455.2285 -> 2453.7942 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T043222_oi[S21,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522dd2-r-20170916T005446_oi[S24,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 97.68 s, CPU: 1.07 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 180 MB, VmData: 213 MB, maxrss: 0.18474 MB Stage tims finished: 2020-08-05T18:59:14.772199 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180902T011433_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T005235_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T010735_oi[S20,noinherit][2046,4094][real]: DECaLS_2763 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T010052_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024449_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T041859_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T012705_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T053715_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032724_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013038_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522dd2-r-20170916T005446_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T043222_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.623 s worker CPU, 751.134 s worker Wall, Wall: 97.687 s, Cores in use: 0.10, Total efficiency (on 32 cores): 0.3 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95338e1-g-20180830T005856_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566d23-r-20160803T043100_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T18:59:14.954928 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06835.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/reference-custom-323335m05787.fits Stage refs : Wall: 18.75 s, CPU: 3.13 s, VmPeak: 1050 MB, VmSize: 1044 MB, VmRSS: 213 MB, VmData: 245 MB, maxrss: 0.218528 MB Stage refs finished: 2020-08-05T18:59:33.703285 Resources for stage refs : 0.001 s worker CPU, 0.001 s worker Wall, Wall: 18.751 s, Cores in use: 0.17, Total efficiency (on 32 cores): 0.5 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T18:59:33.785411 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outlier-mask-custom-323335m05787.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-pre-custom-323335m05787.jpg Image c4d_180905_012705_ooi_g_ls9-S31 g : masking 522 positive outlier pixels and 0 negative outlier pixels Image c4d_180830_005856_ooi_g_ls9-S20 g : masking 615 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_042032_ooi_r_ls9-N31 r : masking 0 positive outlier pixels and 101 negative outlier pixels Image c4d_180914_010052_ooi_z_ls9-S20 z : masking 191 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outlier-mask-custom-323335m05787.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-post-custom-323335m05787.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-masked-pos-custom-323335m05787.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-masked-neg-custom-323335m05787.jpg Stage outliers : Wall: 7.35 s, CPU: 0.87 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234052 MB Stage outliers finished: 2020-08-05T18:59:41.132726 Resources for stage outliers : 1.007 s worker CPU, 1.269 s worker Wall, Wall: 7.350 s, Cores in use: 0.26, Total efficiency (on 32 cores): 0.8 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T18:59:41.318732 Stage halos : Wall: 3.78 s, CPU: 0.36 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 229 MB, VmData: 257 MB, maxrss: 0.23426 MB Stage halos finished: 2020-08-05T18:59:45.103510 Resources for stage halos : 0.284 s worker CPU, 5.043 s worker Wall, Wall: 3.788 s, Cores in use: 0.17, Total efficiency (on 32 cores): 0.5 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T18:59:45.155146 PSF sigmas in coadd pixels: ['1.88', '1.87', '2.15', '1.70', '1.86', '2.82', '2.71'] Using average PSF sigma 2.1407126260400555 Gaussian PSF norm 0.131776114338011 vs pixelized 0.10404325 average tim pixel scale / coadd scale: 1.0010981924665305 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.58', '1.38', '2.80', '2.13'] Using average PSF sigma 1.9745069851834676 Gaussian PSF norm 0.14286846989688742 vs pixelized 0.10988362 average tim pixel scale / coadd scale: 1.0011268567244116 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.33', '2.05', '1.90'] Using average PSF sigma 1.735157668292197 Gaussian PSF norm 0.1625758839838029 vs pixelized 0.12694782 average tim pixel scale / coadd scale: 1.0010461519136384 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.22 s, CPU: 0.18 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.235964 MB Stage fit_on_coadds finished: 2020-08-05T18:59:45.374702 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T042933_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage fit_on_coadds : 0.196 s worker CPU, 0.196 s worker Wall, Wall: 0.222 s, Cores in use: 1.69, Total efficiency (on 32 cores): 5.3 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T18:59:45.434528 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 6 in veto map, 5 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 18 potential peaks Of 18 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 24 potential peaks Of 24 potential peaks: 19 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 15 new sources Median coadd sky for g : -7.395488e-05 Median coadd sky for r : -6.277906e-05 Median coadd sky for z : 3.178441e-05 Stage srcs : Wall: 0.67 s, CPU: 0.64 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 231 MB, VmData: 257 MB, maxrss: 0.236496 MB Stage srcs finished: 2020-08-05T18:59:46.100251 Resources for stage srcs : 0.061 s worker CPU, 0.061 s worker Wall, Wall: 0.668 s, Cores in use: 1.05, Total efficiency (on 32 cores): 3.3 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T18:59:46.112887 Blob 1 of 12, id: 4, sources: 3, size: 103x108, npix 7000, brick X: 59,162, Y: 68,176, one pixel: 134 68 Blob 2 of 12, id: 1, sources: 2, size: 58x56, npix 1850, brick X: 13,71, Y: 19,75, one pixel: 50 19 Blob 3 of 12, id: 3, sources: 2, size: 34x61, npix 1254, brick X: 199,233, Y: 63,124, one pixel: 217 63 Blob 4 of 12, id: 2, sources: 2, size: 46x50, npix 1146, brick X: 56,102, Y: 38,88, one pixel: 88 38 Blob 5 of 12, id: 6, sources: 2, size: 31x53, npix 959, brick X: 22,53, Y: 105,158, one pixel: 40 105 Blob 6 of 12, id: 10, sources: 1, size: 36x34, npix 953, brick X: 188,224, Y: 199,233, one pixel: 201 199 Blob 7 of 12, id: 8, sources: 1, size: 32x32, npix 683, brick X: 168,200, Y: 178,210, one pixel: 183 178 Blob 8 of 12, id: 11, sources: 2, size: 29x31, npix 592, brick X: 63,92, Y: 202,233, one pixel: 73 202 Blob 9 of 12, id: 0, sources: 2, size: 28x33, npix 578, brick X: 0,28, Y: 0,33, one pixel: 3 0 Blob 10 of 12, id: 5, sources: 1, size: 26x26, npix 429, brick X: 160,186, Y: 104,130, one pixel: 170 104 Blob 11 of 12, id: 7, sources: 1, size: 23x23, npix 328, brick X: 208,231, Y: 171,194, one pixel: 217 171 Blob 12 of 12, id: 9, sources: 1, size: 17x17, npix 145, brick X: 15,32, Y: 184,201, one pixel: 23 184 Blob 12 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 942 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148076 MB Blob 11 finished, total: Wall: 0.60 s, CPU: 0.60 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 109 MB, VmData: 165 MB, maxrss: 0.112028 MB Blob 10 finished, total: Wall: 0.63 s, CPU: 0.62 s, VmPeak: 939 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148636 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 942 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.14834 MB Blob 9 finished, total: Wall: 1.01 s, CPU: 1.01 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 110 MB, VmData: 165 MB, maxrss: 0.112832 MB Measuring 1 iterative sources Blob 8 finished, total: Wall: 1.46 s, CPU: 1.46 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 109 MB, VmData: 165 MB, maxrss: 0.112124 MB Measuring 1 iterative sources Blob 6 finished, total: Wall: 1.69 s, CPU: 1.69 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.114056 MB Blob 3 finished, total: Wall: 1.70 s, CPU: 1.69 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095396 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 1.85 s, CPU: 1.85 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 111 MB, VmData: 166 MB, maxrss: 0.113928 MB Blob 5 finished, total: Wall: 2.05 s, CPU: 2.05 s, VmPeak: 669 MB, VmSize: 669 MB, VmRSS: 93 MB, VmData: 140 MB, maxrss: 0.095112 MB Blob 2 finished, total: Wall: 2.45 s, CPU: 2.45 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 110 MB, VmData: 166 MB, maxrss: 0.11284 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.42174, ee1=-0.110381, ee2=0.347322 Measuring 2 iterative sources Blob 1 finished, total: Wall: 5.51 s, CPU: 5.51 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 116 MB, VmData: 165 MB, maxrss: 0.118684 MB Old catalog: 22 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/blobs-custom-323335m05787.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/all-models-custom-323335m05787.fits Stage fitblobs : Wall: 5.91 s, CPU: 0.40 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 231 MB, VmData: 257 MB, maxrss: 0.23666 MB Stage fitblobs finished: 2020-08-05T18:59:52.027458 Resources for stage fitblobs : 20.166 s worker CPU, 20.253 s worker Wall, Wall: 5.917 s, Cores in use: 3.48, Total efficiency (on 32 cores): 10.9 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T18:59:52.041093 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-resid.jpg Stage coadds : Wall: 3.04 s, CPU: 0.80 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 232 MB, VmData: 257 MB, maxrss: 0.237172 MB Stage coadds finished: 2020-08-05T18:59:55.076373 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 23.792 s worker CPU, 37.747 s worker Wall, Wall: 3.038 s, Cores in use: 8.10, Total efficiency (on 32 cores): 25.3 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T18:59:55.092078 Cut to 1 unWISE tiles Reading WISE tile 3235m061 band 4 Reading WISE tile 3235m061 band 2 Reading WISE tile 3235m061 band 1 Reading WISE tile 3235m061 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 934 MB, VmSize: 808 MB, VmRSS: 149 MB, VmData: 178 MB, maxrss: 0.19256 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 906 MB, VmSize: 801 MB, VmRSS: 141 MB, VmData: 171 MB, maxrss: 0.203236 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 870 MB, VmSize: 870 MB, VmRSS: 209 MB, VmData: 237 MB, maxrss: 0.214364 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 934 MB, VmSize: 866 MB, VmRSS: 205 MB, VmData: 235 MB, maxrss: 0.2095 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 3.66 s, CPU: 1.40 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 232 MB, VmData: 257 MB, maxrss: 0.23788 MB Stage wise_forced finished: 2020-08-05T18:59:58.752013 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage wise_forced : 3.388 s worker CPU, 6.373 s worker Wall, Wall: 3.662 s, Cores in use: 1.31, Total efficiency (on 32 cores): 4.1 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T18:59:58.769590 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/tractor-i/cus/tractor-custom-323335m05787.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/tractor/cus/tractor-custom-323335m05787.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/tractor/cus/brick-custom-323335m05787.sha256sum Stage writecat : Wall: 1.37 s, CPU: 0.92 s, VmPeak: 1186 MB, VmSize: 1058 MB, VmRSS: 234 MB, VmData: 257 MB, maxrss: 0.370756 MB Stage writecat finished: 2020-08-05T19:00:00.138392 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.371 s, Cores in use: 0.67, Total efficiency (on 32 cores): 2.1 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-writecat.p All done: 57.523 s worker CPU, 822.083 s worker Wall, Wall: 143.075 s, Cores in use: 0.47, Total efficiency (on 32 cores): 1.5 % Finished galaxy PGC1040411 in 2.435 minutes. Started working on galaxy PGC1040411 at Wed Aug 5 19:01:20 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.335122 -5.7870585 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T19:01:23.524204 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.335122', '-5.7870585', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.335122 -5.7870585 --width 233 --height 233 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.335122 -5.7870585 Starting process 34530 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 34531 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 34532 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 34533 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 34534 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059548 MB Starting process 34535 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 34536 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059556 MB Starting process 34537 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 34538 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 34539 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059264 MB Starting process 34540 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 34541 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 34542 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 34544 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 34545 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Starting process 34543 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059272 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T19:01:25.810285 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 15 CCDs: c4d_160803_043243_ooi_r_ls9-S21 r expnum 558559 exptime 52.0 propid 2014B-0404 seeing 0.97 MJD 57603.188 object DECaLS_11758_r decam/CP/V4.8.2a/CP20160802/c4d_160803_043243_ooi_r_ls9.fits.fz c4d_160803_043408_ooi_g_ls9-S21 g expnum 558560 exptime 56.0 propid 2014B-0404 seeing 1.16 MJD 57603.189 object DECaLS_11758_g decam/CP/V4.8.2a/CP20160802/c4d_160803_043408_ooi_g_ls9.fits.fz c4d_160812_032939_ooi_z_ls9-S21 z expnum 563104 exptime 80.0 propid 2014B-0404 seeing 1.02 MJD 57612.144 object DECaLS_11758_z decam/CP/V4.8.2a/CP20160811/c4d_160812_032939_ooi_z_ls9.fits.fz c4d_180905_013038_ooi_g_ls9-N16 g expnum 768987 exptime 66.0 propid 2014B-0404 seeing 1.15 MJD 58366.063 object DECaLS_52078_g decam/CP/V4.8.2a/CP20180904/c4d_180905_013038_ooi_g_ls9.fits.fz c4d_180905_012705_ooi_g_ls9-S31 g expnum 768985 exptime 66.0 propid 2014B-0404 seeing 1.32 MJD 58366.060 object DECaLS_51883_g decam/CP/V4.8.2a/CP20180904/c4d_180905_012705_ooi_g_ls9.fits.fz c4d_180906_005235_ooi_g_ls9-N19 g expnum 769481 exptime 57.0 propid 2014B-0404 seeing 1.05 MJD 58367.037 object DECaLS_59215_g decam/CP/V4.8.2a/CP20180905/c4d_180906_005235_ooi_g_ls9.fits.fz c4d_170722_042032_ooi_r_ls9-N31 r expnum 660878 exptime 40.0 propid 2014B-0404 seeing 0.85 MJD 57956.180 object DECaLS_11759_r decam/CP/V4.8.2a/CP20170721/c4d_170722_042032_ooi_r_ls9.fits.fz c4d_160813_024709_ooi_z_ls9-N31 z expnum 563504 exptime 82.0 propid 2014B-0404 seeing 0.82 MJD 57613.114 object DECaLS_11759_z decam/CP/V4.8.2a/CP20160812/c4d_160813_024709_ooi_z_ls9.fits.fz c4d_160803_043122_ooi_g_ls9-N31 g expnum 558558 exptime 57.0 propid 2014B-0404 seeing 1.14 MJD 57603.187 object DECaLS_11759_g decam/CP/V4.8.2a/CP20160802/c4d_160803_043122_ooi_g_ls9.fits.fz c4d_170916_005446_ooi_r_ls9-S24 r expnum 677952 exptime 175.0 propid 2014B-0404 seeing 1.73 MJD 58012.038 object DECaLS_43485_r decam/CP/V4.8.2a/CP20170915/c4d_170916_005446_ooi_r_ls9.fits.fz c4d_180901_053715_ooi_z_ls9-S24 z expnum 767582 exptime 124.0 propid 2014B-0404 seeing 1.26 MJD 58362.234 object DECaLS_43485_z decam/CP/V4.8.2a/CP20180831/c4d_180901_053715_ooi_z_ls9.fits.fz c4d_180902_011433_ooi_g_ls9-S24 g expnum 767844 exptime 122.0 propid 2014B-0404 seeing 1.73 MJD 58363.052 object DECaLS_43485_g decam/CP/V4.8.2a/CP20180901/c4d_180902_011433_ooi_g_ls9.fits.fz c4d_180903_010735_ooi_r_ls9-S20 r expnum 768251 exptime 72.0 propid 2014B-0404 seeing 1.31 MJD 58364.047 object DECaLS_27630_r decam/CP/V4.8.2a/CP20180902/c4d_180903_010735_ooi_r_ls9.fits.fz c4d_180914_010052_ooi_z_ls9-S20 z expnum 773188 exptime 104.0 propid 2014B-0404 seeing 1.17 MJD 58375.042 object DECaLS_27630_z decam/CP/V4.8.2a/CP20180913/c4d_180914_010052_ooi_z_ls9.fits.fz c4d_180830_005856_ooi_g_ls9-S20 g expnum 766972 exptime 158.0 propid 2014B-0404 seeing 1.67 MJD 58360.041 object DECaLS_27630_g decam/CP/V4.8.2a/CP20180829/c4d_180830_005856_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T010052_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T010735_oi[S20,noinherit][2046,4094][real]: DECaLS_2763 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T012705_oi[S31,noinherit][2046,4094][real]: DECaLS_ Clipping 12 pixels with anomalously large oow values: max 0.0608507 vs median 0.0446395 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180902T011433_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566d23-r-20160803T043100_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013038_oi[N16,noinherit][2046,4094][real]: DECaLS_ Clipping 2 pixels with anomalously large oow values: max 0.0558963 vs median 0.0428889 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T041859_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95338e1-g-20180830T005856_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024449_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T042933_oi[N31,noinherit][2046,4094][real]: DECaLS_ Clipping 7 pixels with anomalously large oow values: max 0.0713 vs median 0.0504244 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T005235_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032724_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T053715_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 Warning: splinesky does not have sky-template version/run/scale values Swapping in SKY_JOHN values for 1 splinesky cells; 2455.2285 -> 2453.7942 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T043222_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522dd2-r-20170916T005446_oi[S24,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 29.20 s, CPU: 1.79 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 181 MB, VmData: 213 MB, maxrss: 0.18496 MB Stage tims finished: 2020-08-05T19:01:55.014107 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T010052_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T010735_oi[S20,noinherit][2046,4094][real]: DECaLS_2763 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180902T011433_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T012705_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T041859_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566d23-r-20160803T043100_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013038_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032724_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024449_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T053715_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T005235_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T043222_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 9.701 s worker CPU, 186.579 s worker Wall, Wall: 29.205 s, Cores in use: 0.39, Total efficiency (on 16 cores): 2.5 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95338e1-g-20180830T005856_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522dd2-r-20170916T005446_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T19:01:55.054982 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06835.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/reference-custom-323335m05787.fits Stage refs : Wall: 12.89 s, CPU: 5.67 s, VmPeak: 1050 MB, VmSize: 1044 MB, VmRSS: 214 MB, VmData: 245 MB, maxrss: 0.218848 MB Stage refs finished: 2020-08-05T19:02:07.944840 WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T042933_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.892 s, Cores in use: 0.44, Total efficiency (on 16 cores): 2.8 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T19:02:08.009466 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outlier-mask-custom-323335m05787.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-pre-custom-323335m05787.jpg Image c4d_180905_012705_ooi_g_ls9-S31 g : masking 522 positive outlier pixels and 0 negative outlier pixels Image c4d_180830_005856_ooi_g_ls9-S20 g : masking 615 positive outlier pixels and 0 negative outlier pixels Image c4d_170722_042032_ooi_r_ls9-N31 r : masking 0 positive outlier pixels and 101 negative outlier pixels Image c4d_180914_010052_ooi_z_ls9-S20 z : masking 191 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outlier-mask-custom-323335m05787.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-post-custom-323335m05787.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-masked-pos-custom-323335m05787.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/outliers-masked-neg-custom-323335m05787.jpg Stage outliers : Wall: 1.89 s, CPU: 1.68 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.233172 MB Stage outliers finished: 2020-08-05T19:02:09.902477 Resources for stage outliers : 0.814 s worker CPU, 0.832 s worker Wall, Wall: 1.895 s, Cores in use: 1.32, Total efficiency (on 16 cores): 8.2 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T19:02:10.081283 Stage halos : Wall: 0.75 s, CPU: 0.43 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.233652 MB Stage halos finished: 2020-08-05T19:02:10.835929 Resources for stage halos : 0.166 s worker CPU, 1.407 s worker Wall, Wall: 0.756 s, Cores in use: 0.79, Total efficiency (on 16 cores): 4.9 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T19:02:10.995806 PSF sigmas in coadd pixels: ['1.88', '1.87', '2.15', '1.70', '1.86', '2.82', '2.71'] Using average PSF sigma 2.1407126260400555 Gaussian PSF norm 0.131776114338011 vs pixelized 0.10404325 average tim pixel scale / coadd scale: 1.0010981924665305 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.58', '1.38', '2.80', '2.13'] Using average PSF sigma 1.9745069851834676 Gaussian PSF norm 0.14286846989688742 vs pixelized 0.10988362 average tim pixel scale / coadd scale: 1.0011268567244116 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.33', '2.05', '1.90'] Using average PSF sigma 1.735157668292197 Gaussian PSF norm 0.1625758839838029 vs pixelized 0.12694782 average tim pixel scale / coadd scale: 1.0010461519136384 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.21 s, CPU: 0.17 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 230 MB, VmData: 257 MB, maxrss: 0.235912 MB Stage fit_on_coadds finished: 2020-08-05T19:02:11.205714 Resources for stage fit_on_coadds : 0.192 s worker CPU, 0.192 s worker Wall, Wall: 0.211 s, Cores in use: 1.74, Total efficiency (on 16 cores): 10.9 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T19:02:11.220989 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 6 in veto map, 5 cut by saddle test, 0 cut by aper test, 13 kept SED z : 13 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 15 potential peaks Of 15 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED g : 1 new peaks Found 18 potential peaks Of 18 potential peaks: 14 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 24 potential peaks Of 24 potential peaks: 19 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 15 new sources Median coadd sky for g : -7.395488e-05 Median coadd sky for r : -6.277906e-05 Median coadd sky for z : 3.178441e-05 Stage srcs : Wall: 2.54 s, CPU: 2.45 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 231 MB, VmData: 257 MB, maxrss: 0.23652 MB Stage srcs finished: 2020-08-05T19:02:13.759916 Resources for stage srcs : 0.057 s worker CPU, 0.057 s worker Wall, Wall: 2.540 s, Cores in use: 0.99, Total efficiency (on 16 cores): 6.2 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T19:02:13.785776 Blob 1 of 12, id: 4, sources: 3, size: 103x108, npix 7000, brick X: 59,162, Y: 68,176, one pixel: 134 68 Blob 2 of 12, id: 1, sources: 2, size: 58x56, npix 1850, brick X: 13,71, Y: 19,75, one pixel: 50 19 Blob 3 of 12, id: 3, sources: 2, size: 34x61, npix 1254, brick X: 199,233, Y: 63,124, one pixel: 217 63 Blob 4 of 12, id: 2, sources: 2, size: 46x50, npix 1146, brick X: 56,102, Y: 38,88, one pixel: 88 38 Blob 5 of 12, id: 6, sources: 2, size: 31x53, npix 959, brick X: 22,53, Y: 105,158, one pixel: 40 105 Blob 6 of 12, id: 10, sources: 1, size: 36x34, npix 953, brick X: 188,224, Y: 199,233, one pixel: 201 199 Blob 7 of 12, id: 8, sources: 1, size: 32x32, npix 683, brick X: 168,200, Y: 178,210, one pixel: 183 178 Blob 8 of 12, id: 11, sources: 2, size: 29x31, npix 592, brick X: 63,92, Y: 202,233, one pixel: 73 202 Blob 9 of 12, id: 0, sources: 2, size: 28x33, npix 578, brick X: 0,28, Y: 0,33, one pixel: 3 0 Blob 10 of 12, id: 5, sources: 1, size: 26x26, npix 429, brick X: 160,186, Y: 104,130, one pixel: 170 104 Blob 11 of 12, id: 7, sources: 1, size: 23x23, npix 328, brick X: 208,231, Y: 171,194, one pixel: 217 171 Blob 12 of 12, id: 9, sources: 1, size: 17x17, npix 145, brick X: 15,32, Y: 184,201, one pixel: 23 184 Blob 12 finished, total: Wall: 0.06 s, CPU: 0.05 s, VmPeak: 934 MB, VmSize: 732 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14788 MB Blob 10 finished, total: Wall: 0.66 s, CPU: 0.64 s, VmPeak: 939 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148696 MB Blob 11 finished, total: Wall: 0.82 s, CPU: 0.82 s, VmPeak: 906 MB, VmSize: 732 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148588 MB Blob 9 finished, total: Wall: 0.98 s, CPU: 0.98 s, VmPeak: 937 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149208 MB Blob 7 finished, total: Wall: 1.06 s, CPU: 1.04 s, VmPeak: 940 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 182 MB, maxrss: 0.149796 MB Measuring 1 iterative sources Measuring 1 iterative sources Blob 3 finished, total: Wall: 1.69 s, CPU: 1.67 s, VmPeak: 934 MB, VmSize: 730 MB, VmRSS: 144 MB, VmData: 179 MB, maxrss: 0.14716 MB Blob 8 finished, total: Wall: 1.74 s, CPU: 1.69 s, VmPeak: 694 MB, VmSize: 694 MB, VmRSS: 110 MB, VmData: 165 MB, maxrss: 0.112616 MB Blob 6 finished, total: Wall: 1.94 s, CPU: 1.90 s, VmPeak: 935 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149644 MB Measuring 1 iterative sources Blob 5 finished, total: Wall: 2.05 s, CPU: 2.02 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149132 MB Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.17 s, CPU: 2.13 s, VmPeak: 938 MB, VmSize: 733 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149224 MB Blob 2 finished, total: Wall: 2.71 s, CPU: 2.67 s, VmPeak: 905 MB, VmSize: 733 MB, VmRSS: 145 MB, VmData: 181 MB, maxrss: 0.148716 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.42174, ee1=-0.110381, ee2=0.347322 Measuring 2 iterative sources Blob 1 finished, total: Wall: 5.62 s, CPU: 5.62 s, VmPeak: 939 MB, VmSize: 733 MB, VmRSS: 148 MB, VmData: 182 MB, maxrss: 0.151356 MB Old catalog: 22 New catalog: 25 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/blobs-custom-323335m05787.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/metrics/cus/all-models-custom-323335m05787.fits Stage fitblobs : Wall: 8.35 s, CPU: 2.45 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 231 MB, VmData: 257 MB, maxrss: 0.236684 MB Stage fitblobs finished: 2020-08-05T19:02:22.139835 Resources for stage fitblobs : 21.385 s worker CPU, 22.993 s worker Wall, Wall: 8.355 s, Cores in use: 2.85, Total efficiency (on 16 cores): 17.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T19:02:22.158889 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-resid.jpg Stage coadds : Wall: 7.25 s, CPU: 1.14 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 232 MB, VmData: 257 MB, maxrss: 0.237196 MB Stage coadds finished: 2020-08-05T19:02:29.407477 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 9.817 s worker CPU, 13.434 s worker Wall, Wall: 7.250 s, Cores in use: 1.51, Total efficiency (on 16 cores): 9.4 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T19:02:29.426910 Cut to 1 unWISE tiles Reading WISE tile 3235m061 band 4 Reading WISE tile 3235m061 band 2 Reading WISE tile 3235m061 band 1 Reading WISE tile 3235m061 band 3 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 906 MB, VmSize: 815 MB, VmRSS: 154 MB, VmData: 180 MB, maxrss: 0.19682 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 934 MB, VmSize: 806 MB, VmRSS: 144 MB, VmData: 171 MB, maxrss: 0.20756 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 939 MB, VmSize: 870 MB, VmRSS: 210 MB, VmData: 235 MB, maxrss: 0.21464 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 942 MB, VmSize: 803 MB, VmRSS: 144 MB, VmData: 172 MB, maxrss: 0.207152 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/tmp-legacysurvey-custom-323335m05787-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.99 s, CPU: 1.41 s, VmPeak: 1054 MB, VmSize: 1054 MB, VmRSS: 232 MB, VmData: 257 MB, maxrss: 0.237904 MB Stage wise_forced finished: 2020-08-05T19:02:32.413172 Resources for stage wise_forced : 3.263 s worker CPU, 4.673 s worker Wall, Wall: 2.988 s, Cores in use: 1.56, Total efficiency (on 16 cores): 9.8 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T19:02:32.425408 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/coadd/cus/custom-323335m05787/legacysurvey-custom-323335m05787-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/tractor-i/cus/tractor-custom-323335m05787.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/tractor/cus/tractor-custom-323335m05787.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/tractor/cus/brick-custom-323335m05787.sha256sum Stage writecat : Wall: 3.05 s, CPU: 1.16 s, VmPeak: 1186 MB, VmSize: 1058 MB, VmRSS: 234 MB, VmData: 257 MB, maxrss: 0.37078 MB Stage writecat finished: 2020-08-05T19:02:35.477798 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 3.054 s, Cores in use: 0.38, Total efficiency (on 16 cores): 2.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/323/PGC1040411/PGC1040411-largegalaxy-writecat.p All done: 45.399 s worker CPU, 230.172 s worker Wall, Wall: 69.697 s, Cores in use: 0.92, Total efficiency (on 16 cores): 5.7 % Finished galaxy PGC1040411 in 1.260 minutes. Started working on galaxy PGC1040411 at Mon Aug 10 07:31:52 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.33568891582587 -5.786987886423325 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-10T07:31:53.737407 legacypipe git version: DR9.5.11-watershed-6-g6a2880fc Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '323.33568891582587', '-5.786987886423325', '--width', '233', '--height', '233', '--pixscale', '0.262', '--threads', '8', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 323.33568891582587 -5.786987886423325 --width 233 --height 233 --pixscale 0.262 --threads 8 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 323.33568891582587 -5.786987886423325 Starting process 4780 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 4781 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4782 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4783 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 4785 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 4786 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 4787 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 4788 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-10T07:31:54.414544 Keeping 15 CCDs: c4d_160803_043243_ooi_r_ls9-S21 r expnum 558559 exptime 52.0 propid 2014B-0404 seeing 0.97 MJD 57603.188 object DECaLS_11758_r decam/CP/V4.8.2a/CP20160802/c4d_160803_043243_ooi_r_ls9.fits.fz c4d_160803_043408_ooi_g_ls9-S21 g expnum 558560 exptime 56.0 propid 2014B-0404 seeing 1.16 MJD 57603.189 object DECaLS_11758_g decam/CP/V4.8.2a/CP20160802/c4d_160803_043408_ooi_g_ls9.fits.fz c4d_160812_032939_ooi_z_ls9-S21 z expnum 563104 exptime 80.0 propid 2014B-0404 seeing 1.02 MJD 57612.144 object DECaLS_11758_z decam/CP/V4.8.2a/CP20160811/c4d_160812_032939_ooi_z_ls9.fits.fz c4d_180905_013038_ooi_g_ls9-N16 g expnum 768987 exptime 66.0 propid 2014B-0404 seeing 1.15 MJD 58366.063 object DECaLS_52078_g decam/CP/V4.8.2a/CP20180904/c4d_180905_013038_ooi_g_ls9.fits.fz c4d_180905_012705_ooi_g_ls9-S31 g expnum 768985 exptime 66.0 propid 2014B-0404 seeing 1.32 MJD 58366.060 object DECaLS_51883_g decam/CP/V4.8.2a/CP20180904/c4d_180905_012705_ooi_g_ls9.fits.fz c4d_180906_005235_ooi_g_ls9-N19 g expnum 769481 exptime 57.0 propid 2014B-0404 seeing 1.05 MJD 58367.037 object DECaLS_59215_g decam/CP/V4.8.2a/CP20180905/c4d_180906_005235_ooi_g_ls9.fits.fz c4d_170722_042032_ooi_r_ls9-N31 r expnum 660878 exptime 40.0 propid 2014B-0404 seeing 0.85 MJD 57956.180 object DECaLS_11759_r decam/CP/V4.8.2a/CP20170721/c4d_170722_042032_ooi_r_ls9.fits.fz c4d_160813_024709_ooi_z_ls9-N31 z expnum 563504 exptime 82.0 propid 2014B-0404 seeing 0.82 MJD 57613.114 object DECaLS_11759_z decam/CP/V4.8.2a/CP20160812/c4d_160813_024709_ooi_z_ls9.fits.fz c4d_160803_043122_ooi_g_ls9-N31 g expnum 558558 exptime 57.0 propid 2014B-0404 seeing 1.14 MJD 57603.187 object DECaLS_11759_g decam/CP/V4.8.2a/CP20160802/c4d_160803_043122_ooi_g_ls9.fits.fz c4d_170916_005446_ooi_r_ls9-S24 r expnum 677952 exptime 175.0 propid 2014B-0404 seeing 1.73 MJD 58012.038 object DECaLS_43485_r decam/CP/V4.8.2a/CP20170915/c4d_170916_005446_ooi_r_ls9.fits.fz c4d_180901_053715_ooi_z_ls9-S24 z expnum 767582 exptime 124.0 propid 2014B-0404 seeing 1.26 MJD 58362.234 object DECaLS_43485_z decam/CP/V4.8.2a/CP20180831/c4d_180901_053715_ooi_z_ls9.fits.fz c4d_180902_011433_ooi_g_ls9-S24 g expnum 767844 exptime 122.0 propid 2014B-0404 seeing 1.73 MJD 58363.052 object DECaLS_43485_g decam/CP/V4.8.2a/CP20180901/c4d_180902_011433_ooi_g_ls9.fits.fz c4d_180903_010735_ooi_r_ls9-S20 r expnum 768251 exptime 72.0 propid 2014B-0404 seeing 1.31 MJD 58364.047 object DECaLS_27630_r decam/CP/V4.8.2a/CP20180902/c4d_180903_010735_ooi_r_ls9.fits.fz c4d_180914_010052_ooi_z_ls9-S20 z expnum 773188 exptime 104.0 propid 2014B-0404 seeing 1.17 MJD 58375.042 object DECaLS_27630_z decam/CP/V4.8.2a/CP20180913/c4d_180914_010052_ooi_z_ls9.fits.fz c4d_180830_005856_ooi_g_ls9-S20 g expnum 766972 exptime 158.0 propid 2014B-0404 seeing 1.67 MJD 58360.041 object DECaLS_27630_g decam/CP/V4.8.2a/CP20180829/c4d_180830_005856_ooi_g_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T012705_oi[S31,noinherit][2046,4094][real]: DECaLS_ Clipping 10 pixels with anomalously large oow values: max 0.0608507 vs median 0.0446395 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T005235_oi[N19,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013038_oi[N16,noinherit][2046,4094][real]: DECaLS_ Clipping 2 pixels with anomalously large oow values: max 0.0558963 vs median 0.0428889 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566d23-r-20160803T043100_oi[S21,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T041859_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024449_oi[N31,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032724_oi[S21,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T042933_oi[N31,noinherit][2046,4094][real]: DECaLS_ Clipping 7 pixels with anomalously large oow values: max 0.0713 vs median 0.0504244 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180902T011433_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T010735_oi[S20,noinherit][2046,4094][real]: DECaLS_2763 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T010052_oi[S20,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T053715_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95338e1-g-20180830T005856_oi[S20,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T043222_oi[S21,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values Swapping in SKY_JOHN values for 1 splinesky cells; 2455.2285 -> 2453.7942 Warning: splinesky does not have sky-template version/run/scale values The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522dd2-r-20170916T005446_oi[S24,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 106.31 s, CPU: 1.10 s, VmPeak: 1006 MB, VmSize: 1006 MB, VmRSS: 178 MB, VmData: 212 MB, maxrss: 0.182776 MB Stage tims finished: 2020-08-10T07:33:40.728948 Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_964e77a-g-20180906T005235_oi[N19,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T042933_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566d23-r-20160803T043100_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-r-20180903T010735_oi[S20,noinherit][2046,4094][real]: DECaLS_2763 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954922e-z-20160813T024449_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-g-20180902T011433_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T013038_oi[N16,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952da7f-z-20180914T010052_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951dcf7-r-20170722T041859_oi[N31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_N10-z-20180901T053715_oi[S24,noinherit][2046,4094][real]: DECaLS_4348 [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95b90ac-g-20160803T043222_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 6.553 s worker CPU, 586.727 s worker Wall, Wall: 106.316 s, Cores in use: 0.07, Total efficiency (on 8 cores): 0.9 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954a387-z-20160812T032724_oi[S21,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95338e1-g-20180830T005856_oi[S20,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9534322-g-20180905T012705_oi[S31,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9522dd2-r-20170916T005446_oi[S24,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-10T07:33:40.771138 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-06835.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/reference-custom-323335m05786.fits Stage refs : Wall: 12.83 s, CPU: 2.94 s, VmPeak: 1043 MB, VmSize: 1038 MB, VmRSS: 212 MB, VmData: 245 MB, maxrss: 0.21672 MB Stage refs finished: 2020-08-10T07:33:53.604250 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 12.834 s, Cores in use: 0.23, Total efficiency (on 8 cores): 2.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-10T07:33:53.809467 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/outlier-mask-custom-323335m05786.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/outliers-pre-custom-323335m05786.jpg Image c4d_160803_043408_ooi_g_ls9-S21 g : masking 66 positive outlier pixels and 0 negative outlier pixels Image c4d_180905_012705_ooi_g_ls9-S31 g : masking 796 positive outlier pixels and 0 negative outlier pixels Image c4d_180830_005856_ooi_g_ls9-S20 g : masking 617 positive outlier pixels and 0 negative outlier pixels Image c4d_180902_011433_ooi_g_ls9-S24 g : masking 0 positive outlier pixels and 55 negative outlier pixels Image c4d_180901_053715_ooi_z_ls9-S24 z : masking 80 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/outlier-mask-custom-323335m05786.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/outliers-post-custom-323335m05786.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/outliers-masked-pos-custom-323335m05786.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/outliers-masked-neg-custom-323335m05786.jpg Stage outliers : Wall: 0.83 s, CPU: 0.66 s, VmPeak: 1047 MB, VmSize: 1047 MB, VmRSS: 226 MB, VmData: 255 MB, maxrss: 0.231332 MB Stage outliers finished: 2020-08-10T07:33:54.643490 Resources for stage outliers : 0.897 s worker CPU, 0.899 s worker Wall, Wall: 0.835 s, Cores in use: 1.87, Total efficiency (on 8 cores): 23.4 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-10T07:33:54.690998 Stage halos : Wall: 2.33 s, CPU: 0.23 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 226 MB, VmData: 256 MB, maxrss: 0.2318 MB Stage halos finished: 2020-08-10T07:33:57.019406 Resources for stage halos : 0.153 s worker CPU, 3.345 s worker Wall, Wall: 2.330 s, Cores in use: 0.17, Total efficiency (on 8 cores): 2.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-10T07:33:57.229119 PSF sigmas in coadd pixels: ['1.88', '1.87', '2.15', '1.70', '1.86', '2.82', '2.71'] Using average PSF sigma 2.1407126260400555 Gaussian PSF norm 0.131776114338011 vs pixelized 0.10403906 average tim pixel scale / coadd scale: 1.0010981924665305 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.58', '1.38', '2.80', '2.13'] Using average PSF sigma 1.9745069851834676 Gaussian PSF norm 0.14286846989688742 vs pixelized 0.10988306 average tim pixel scale / coadd scale: 1.0011268567244116 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.65', '1.33', '2.05', '1.90'] Using average PSF sigma 1.735157668292197 Gaussian PSF norm 0.1625758839838029 vs pixelized 0.12694599 average tim pixel scale / coadd scale: 1.0010461519136384 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.19 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.2334 MB Stage fit_on_coadds finished: 2020-08-10T07:33:57.480818 Resources for stage fit_on_coadds : 0.237 s worker CPU, 0.237 s worker Wall, Wall: 0.253 s, Cores in use: 1.69, Total efficiency (on 8 cores): 21.2 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-10T07:33:57.495275 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 24 potential peaks Of 24 potential peaks: 8 in veto map, 4 cut by saddle test, 0 cut by aper test, 12 kept SED z : 12 new peaks Found 14 potential peaks Of 14 potential peaks: 12 in veto map, 2 cut by saddle test, 0 cut by aper test, 0 kept SED r : 0 new peaks Found 17 potential peaks Of 17 potential peaks: 11 in veto map, 3 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 21 potential peaks Of 21 potential peaks: 17 in veto map, 3 cut by saddle test, 0 cut by aper test, 1 kept SED Flat : 1 new peaks Found 26 potential peaks Of 26 potential peaks: 21 in veto map, 5 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 16 new sources Median coadd sky for g : -6.3134714e-05 Median coadd sky for r : -2.3738308e-05 Median coadd sky for z : 0.00010589454 Stage srcs : Wall: 0.60 s, CPU: 0.57 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 228 MB, VmData: 256 MB, maxrss: 0.23392 MB Stage srcs finished: 2020-08-10T07:33:58.092624 Resources for stage srcs : 0.072 s worker CPU, 0.072 s worker Wall, Wall: 0.598 s, Cores in use: 1.07, Total efficiency (on 8 cores): 13.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-10T07:33:58.103595 Blob 1 of 14, id: 4, sources: 2, size: 103x108, npix 7019, brick X: 67,170, Y: 67,175, one pixel: 141 67 Blob 2 of 14, id: 1, sources: 2, size: 58x56, npix 1863, brick X: 21,79, Y: 18,74, one pixel: 58 18 Blob 3 of 14, id: 2, sources: 2, size: 45x50, npix 1157, brick X: 64,109, Y: 37,87, one pixel: 95 37 Blob 4 of 14, id: 3, sources: 2, size: 26x60, npix 1005, brick X: 207,233, Y: 63,123, one pixel: 223 63 Blob 5 of 14, id: 12, sources: 1, size: 38x35, npix 998, brick X: 195,233, Y: 198,233, one pixel: 209 198 Blob 6 of 14, id: 6, sources: 2, size: 31x53, npix 966, brick X: 30,61, Y: 104,157, one pixel: 48 104 Blob 7 of 14, id: 9, sources: 1, size: 32x32, npix 674, brick X: 176,208, Y: 177,209, one pixel: 191 177 Blob 8 of 14, id: 13, sources: 2, size: 29x32, npix 630, brick X: 71,100, Y: 201,233, one pixel: 81 201 Blob 9 of 14, id: 0, sources: 2, size: 30x32, npix 585, brick X: 5,35, Y: 0,32, one pixel: 10 0 Measuring 1 iterative sources Blob 5 finished, total: Wall: 1.54 s, CPU: 1.54 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146084 MB Blob 10 of 14, id: 5, sources: 1, size: 26x26, npix 429, brick X: 168,194, Y: 103,129, one pixel: 178 103 Blob 8 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 962 MB, VmSize: 727 MB, VmRSS: 142 MB, VmData: 182 MB, maxrss: 0.145348 MB Blob 11 of 14, id: 7, sources: 1, size: 22x23, npix 312, brick X: 0,22, Y: 111,134, one pixel: 8 111 Blob 7 finished, total: Wall: 1.96 s, CPU: 1.43 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143976 MB Blob 12 of 14, id: 11, sources: 1, size: 17x25, npix 285, brick X: 0,17, Y: 192,217, one pixel: 4 192 Measuring 1 iterative sources Measuring 1 iterative sources Blob 4 finished, total: Wall: 2.43 s, CPU: 2.43 s, VmPeak: 934 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145388 MB Blob 13 of 14, id: 8, sources: 1, size: 17x23, npix 268, brick X: 216,233, Y: 170,193, one pixel: 225 170 Measuring 1 iterative sources Blob 3 finished, total: Wall: 2.52 s, CPU: 2.52 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146124 MB Blob 14 of 14, id: 10, sources: 1, size: 17x17, npix 145, brick X: 23,40, Y: 183,200, one pixel: 31 183 Blob 11 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143976 MB Blob 14 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 970 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.143976 MB Blob 10 finished, total: Wall: 0.83 s, CPU: 0.83 s, VmPeak: 962 MB, VmSize: 727 MB, VmRSS: 143 MB, VmData: 182 MB, maxrss: 0.146892 MB Blob 13 finished, total: Wall: 0.57 s, CPU: 0.57 s, VmPeak: 967 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146364 MB Blob 9 finished, total: Wall: 1.57 s, CPU: 1.57 s, VmPeak: 966 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146084 MB Blob 6 finished, total: Wall: 3.32 s, CPU: 2.76 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146228 MB Blob 2 finished, total: Wall: 3.46 s, CPU: 3.45 s, VmPeak: 971 MB, VmSize: 727 MB, VmRSS: 141 MB, VmData: 182 MB, maxrss: 0.144532 MB Blob 12 finished, total: Wall: 1.15 s, CPU: 1.15 s, VmPeak: 934 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.145996 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.29644, ee1=-0.10444, ee2=0.32404 Measuring 2 iterative sources Blob 1 finished, total: Wall: 5.38 s, CPU: 5.05 s, VmPeak: 972 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.147236 MB Old catalog: 23 New catalog: 26 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/blobs-custom-323335m05786.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/metrics/cus/all-models-custom-323335m05786.fits Stage fitblobs : Wall: 5.76 s, CPU: 0.39 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.234084 MB Stage fitblobs finished: 2020-08-10T07:34:03.860893 Resources for stage fitblobs : 26.152 s worker CPU, 27.616 s worker Wall, Wall: 5.758 s, Cores in use: 4.61, Total efficiency (on 8 cores): 57.6 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-10T07:34:03.873219 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/tmp-legacysurvey-custom-323335m05786-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/tmp-legacysurvey-custom-323335m05786-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/tmp-legacysurvey-custom-323335m05786-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/tmp-legacysurvey-custom-323335m05786-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-resid.jpg Stage coadds : Wall: 1.40 s, CPU: 0.53 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 229 MB, VmData: 256 MB, maxrss: 0.2346 MB Stage coadds finished: 2020-08-10T07:34:05.273918 Resources for stage coadds : 4.025 s worker CPU, 4.670 s worker Wall, Wall: 1.402 s, Cores in use: 3.25, Total efficiency (on 8 cores): 40.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-10T07:34:05.286092 Cut to 1 unWISE tiles Reading WISE tile 3235m061 band 1 Reading WISE tile 3235m061 band 2 Reading WISE tile 3235m061 band 3 Reading WISE tile 3235m061 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 934 MB, VmSize: 804 MB, VmRSS: 147 MB, VmData: 175 MB, maxrss: 0.19142 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 972 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.20658 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 970 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.20714 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/323/3235m061/unwise-3235m061-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.04 s, CPU: 0.04 s, VmPeak: 967 MB, VmSize: 809 MB, VmRSS: 151 MB, VmData: 180 MB, maxrss: 0.208532 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/tmp-legacysurvey-custom-323335m05786-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/tmp-legacysurvey-custom-323335m05786-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 1.90 s, CPU: 0.39 s, VmPeak: 1048 MB, VmSize: 1048 MB, VmRSS: 230 MB, VmData: 256 MB, maxrss: 0.235304 MB Stage wise_forced finished: 2020-08-10T07:34:07.183424 Resources for stage wise_forced : 3.590 s worker CPU, 4.809 s worker Wall, Wall: 1.899 s, Cores in use: 2.10, Total efficiency (on 8 cores): 26.2 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-10T07:34:07.199063 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/coadd/cus/custom-323335m05786/legacysurvey-custom-323335m05786-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/tractor-i/cus/tractor-custom-323335m05786.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/tractor/cus/tractor-custom-323335m05786.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/tractor/cus/brick-custom-323335m05786.sha256sum Stage writecat : Wall: 0.83 s, CPU: 0.55 s, VmPeak: 1180 MB, VmSize: 1052 MB, VmRSS: 232 MB, VmData: 256 MB, maxrss: 0.368184 MB Stage writecat finished: 2020-08-10T07:34:08.026588 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.829 s, Cores in use: 0.67, Total efficiency (on 8 cores): 8.4 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/323/PGC1040411/PGC1040411-largegalaxy-writecat.p All done: 41.682 s worker CPU, 628.376 s worker Wall, Wall: 133.631 s, Cores in use: 0.37, Total efficiency (on 8 cores): 4.6 % Finished galaxy PGC1040411 in 2.268 minutes.