Started working on galaxy PGC1909900 at Wed Aug 5 20:48:31 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.91375 30.5914 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T20:48:32.534891 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.91375', '30.5914', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.91375 30.5914 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.91375 30.5914 Starting process 26702 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059232 MB Starting process 26703 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 26704 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 26705 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059236 MB Starting process 26706 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059532 MB Starting process 26707 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 26708 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059544 MB Starting process 26709 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 26710 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 26711 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 26712 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 26714 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 26715 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 26713 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 26716 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 26717 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T20:48:33.129441 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 13 CCDs: c4d_181102_051956_ooi_z_ls9-N23 z expnum 789984 exptime 81.0 propid 2014B-0404 seeing 0.90 MJD 58424.222 object DECaLS_4933_z decam/CP/V4.8.2a/CP20181101/c4d_181102_051956_ooi_z_ls9.fits.fz c4d_181102_041339_ooi_r_ls9-N23 r expnum 789955 exptime 80.0 propid 2014B-0404 seeing 1.11 MJD 58424.176 object DECaLS_4933_r decam/CP/V4.8.2a/CP20181101/c4d_181102_041339_ooi_r_ls9.fits.fz c4d_181103_035825_ooi_g_ls9-N23 g expnum 790262 exptime 149.0 propid 2014B-0404 seeing 1.39 MJD 58425.166 object DECaLS_4933_g decam/CP/V4.8.2a/CP20181102/c4d_181103_035825_ooi_g_ls9.fits.fz c4d_181105_051141_ooi_z_ls9-N23 z expnum 790940 exptime 146.0 propid 2014B-0404 seeing 1.01 MJD 58427.216 object DECaLS_4933_z decam/CP/V4.8.2a/CP20181104/c4d_181105_051141_ooi_z_ls9.fits.fz c4d_181017_052143_ooi_z_ls9-N26 z expnum 784263 exptime 213.0 propid 2014B-0404 seeing 1.63 MJD 58408.223 object DECaLS_36677_z decam/CP/V4.8.2a/CP20181016/c4d_181017_052143_ooi_z_ls9.fits.fz c4d_181104_043241_ooi_r_ls9-N26 r expnum 790580 exptime 81.0 propid 2014B-0404 seeing 1.31 MJD 58426.189 object DECaLS_36677_r decam/CP/V4.8.2a/CP20181103/c4d_181104_043241_ooi_r_ls9.fits.fz c4d_181103_045318_ooi_g_ls9-N26 g expnum 790282 exptime 195.0 propid 2014B-0404 seeing 1.60 MJD 58425.204 object DECaLS_36677_g decam/CP/V4.8.2a/CP20181102/c4d_181103_045318_ooi_g_ls9.fits.fz c4d_181101_041427_ooi_r_ls9-N27 r expnum 789635 exptime 146.0 propid 2014B-0404 seeing 1.52 MJD 58423.177 object DECaLS_20805_r decam/CP/V4.8.2a/CP20181031/c4d_181101_041427_ooi_r_ls9.fits.fz c4d_181101_034523_ooi_g_ls9-N27 g expnum 789626 exptime 179.0 propid 2014B-0404 seeing 1.83 MJD 58423.157 object DECaLS_20805_g decam/CP/V4.8.2a/CP20181031/c4d_181101_034523_ooi_g_ls9.fits.fz c4d_181002_060458_ooi_z_ls9-N27 z expnum 779934 exptime 93.0 propid 2014B-0404 seeing 1.04 MJD 58393.253 object DECaLS_20805_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060458_ooi_z_ls9.fits.fz c4d_140813_100741_ooi_z_ls9-S29 z expnum 347519 exptime 137.0 propid 2014B-0404 seeing 1.02 MJD 56882.420 object DECaLS_4932_z decam/CP/V4.8.2a/CP20140812/c4d_140813_100741_ooi_z_ls9.fits.fz c4d_180906_072940_ooi_g_ls9-S29 g expnum 769698 exptime 110.0 propid 2014B-0404 seeing 1.52 MJD 58367.312 object DECaLS_4932_g decam/CP/V4.8.2a/CP20180905/c4d_180906_072940_ooi_g_ls9.fits.fz c4d_180811_093253_ooi_r_ls9-S29 r expnum 764308 exptime 43.0 propid 2014B-0404 seeing 1.11 MJD 58341.398 object DECaLS_4932_r decam/CP/V4.8.2a/CP20180810/c4d_180811_093253_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180811T093253_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T045318_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060458_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T035825_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140813T100433_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181101T041427_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T051141_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T051956_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T043241_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532159-z-20181017T052143_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T041339_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T072940_oi[S29,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181101T034523_oi[N27,noinherit][2046,4094][real]: DECaLS_ Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 85.13 s, CPU: 1.01 s, VmPeak: 1012 MB, VmSize: 1012 MB, VmRSS: 184 MB, VmData: 216 MB, maxrss: 0.188 MB Stage tims finished: 2020-08-05T20:49:58.255844 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T043241_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060458_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181101T041427_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T051141_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T051956_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T035825_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T045318_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T041339_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140813T100433_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T072940_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181101T034523_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage tims : 8.724 s worker CPU, 709.159 s worker Wall, Wall: 85.128 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-tims.p Running stage refs WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180811T093253_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532159-z-20181017T052143_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage refs at 2020-08-05T20:49:58.288160 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03018.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02891.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/reference-custom-029913p30591.fits Stage refs : Wall: 8.26 s, CPU: 2.88 s, VmPeak: 1043 MB, VmSize: 1036 MB, VmRSS: 209 MB, VmData: 240 MB, maxrss: 0.21394 MB Stage refs finished: 2020-08-05T20:50:06.543556 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 8.257 s, Cores in use: 0.35, Total efficiency (on 16 cores): 2.2 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T20:50:06.784304 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/outlier-mask-custom-029913p30591.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/outliers-pre-custom-029913p30591.jpg Image c4d_181101_034523_ooi_g_ls9-N27 g : masking 0 positive outlier pixels and 83 negative outlier pixels Image c4d_181103_035825_ooi_g_ls9-N23 g : masking 588 positive outlier pixels and 0 negative outlier pixels Image c4d_181101_041427_ooi_r_ls9-N27 r : masking 160 positive outlier pixels and 0 negative outlier pixels Image c4d_181102_041339_ooi_r_ls9-N23 r : masking 0 positive outlier pixels and 76 negative outlier pixels Image c4d_181104_043241_ooi_r_ls9-N26 r : masking 300 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_051141_ooi_z_ls9-N23 z : masking 1232 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/outlier-mask-custom-029913p30591.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/outliers-post-custom-029913p30591.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/outliers-masked-pos-custom-029913p30591.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/outliers-masked-neg-custom-029913p30591.jpg Stage outliers : Wall: 2.70 s, CPU: 2.27 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.235292 MB Stage outliers finished: 2020-08-05T20:50:09.488078 Resources for stage outliers : 1.441 s worker CPU, 1.565 s worker Wall, Wall: 2.705 s, Cores in use: 1.37, Total efficiency (on 16 cores): 8.6 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T20:50:09.794027 Stage halos : Wall: 1.65 s, CPU: 1.07 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.23586 MB Stage halos finished: 2020-08-05T20:50:11.442122 Resources for stage halos : 0.171 s worker CPU, 1.637 s worker Wall, Wall: 1.650 s, Cores in use: 0.75, Total efficiency (on 16 cores): 4.7 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T20:50:11.475350 PSF sigmas in coadd pixels: ['2.26', '2.60', '2.98', '2.47'] Using average PSF sigma 2.5781974720435086 Gaussian PSF norm 0.10941551018987178 vs pixelized 0.099566616 average tim pixel scale / coadd scale: 1.0014114355337842 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.80', '2.13', '2.47', '1.80'] Using average PSF sigma 2.0495109025437412 Gaussian PSF norm 0.13764005423135708 vs pixelized 0.11557216 average tim pixel scale / coadd scale: 1.0014251321074303 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.47', '1.63', '2.64', '1.68', '1.65'] Using average PSF sigma 1.8166721625924473 Gaussian PSF norm 0.15528106698751862 vs pixelized 0.12575784 average tim pixel scale / coadd scale: 1.0014226027401805 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.25 s, CPU: 0.24 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 232 MB, VmData: 258 MB, maxrss: 0.237452 MB Stage fit_on_coadds finished: 2020-08-05T20:50:11.724196 Resources for stage fit_on_coadds : 0.310 s worker CPU, 0.310 s worker Wall, Wall: 0.250 s, Cores in use: 2.21, Total efficiency (on 16 cores): 13.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T20:50:11.736493 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 59 potential peaks Of 59 potential peaks: 35 in veto map, 4 cut by saddle test, 0 cut by aper test, 20 kept SED z : 20 new peaks Found 48 potential peaks Of 48 potential peaks: 38 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 39 potential peaks Of 39 potential peaks: 31 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 56 potential peaks Of 56 potential peaks: 48 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept SED Flat : 4 new peaks Found 66 potential peaks Of 66 potential peaks: 58 in veto map, 6 cut by saddle test, 0 cut by aper test, 2 kept SED Red : 2 new peaks Adding 35 new sources Median coadd sky for g : 5.055737e-05 Median coadd sky for r : 0.00014519767 Median coadd sky for z : 0.00042414333 Stage srcs : Wall: 1.20 s, CPU: 1.15 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 232 MB, VmData: 258 MB, maxrss: 0.2378 MB Stage srcs finished: 2020-08-05T20:50:12.934563 Resources for stage srcs : 0.086 s worker CPU, 0.086 s worker Wall, Wall: 1.199 s, Cores in use: 1.03, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T20:50:13.172305 Blob 1 of 20, id: 4, sources: 12, size: 197x181, npix 22565, brick X: 36,233, Y: 56,237, one pixel: 143 56 Blob 2 of 20, id: 13, sources: 4, size: 68x66, npix 2939, brick X: 37,105, Y: 221,287, one pixel: 60 221 Blob 3 of 20, id: 14, sources: 1, size: 38x42, npix 1067, brick X: 233,271, Y: 239,281, one pixel: 251 239 Blob 4 of 20, id: 0, sources: 1, size: 51x28, npix 1028, brick X: 14,65, Y: 0,28, one pixel: 22 0 Blob 5 of 20, id: 9, sources: 2, size: 44x33, npix 955, brick X: 224,268, Y: 125,158, one pixel: 234 125 Blob 6 of 20, id: 15, sources: 2, size: 42x43, npix 949, brick X: 192,234, Y: 244,287, one pixel: 204 244 Blob 7 of 20, id: 11, sources: 2, size: 30x44, npix 735, brick X: 236,266, Y: 172,216, one pixel: 252 172 Blob 8 of 20, id: 7, sources: 1, size: 30x31, npix 613, brick X: 15,45, Y: 89,120, one pixel: 27 89 Blob 9 of 20, id: 6, sources: 1, size: 23x33, npix 569, brick X: 264,287, Y: 83,116, one pixel: 280 83 Blob 10 of 20, id: 10, sources: 1, size: 27x27, npix 459, brick X: 5,32, Y: 155,182, one pixel: 17 155 Blob 11 of 20, id: 5, sources: 1, size: 26x26, npix 427, brick X: 244,270, Y: 58,84, one pixel: 255 58 Blob 12 of 20, id: 17, sources: 1, size: 26x24, npix 411, brick X: 165,191, Y: 263,287, one pixel: 176 263 Blob 13 of 20, id: 12, sources: 1, size: 23x24, npix 342, brick X: 57,80, Y: 193,217, one pixel: 66 193 Blob 14 of 20, id: 8, sources: 1, size: 22x24, npix 336, brick X: 238,260, Y: 89,113, one pixel: 248 89 Blob 15 of 20, id: 16, sources: 1, size: 22x23, npix 325, brick X: 110,132, Y: 247,270, one pixel: 119 247 Blob 16 of 20, id: 19, sources: 1, size: 22x15, npix 227, brick X: 2,24, Y: 272,287, one pixel: 12 272 Blob 17 of 20, id: 18, sources: 1, size: 17x19, npix 214, brick X: 270,287, Y: 268,287, one pixel: 279 268 Blob 13 finished, total: Wall: 0.35 s, CPU: 0.31 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149328 MB Blob 18 of 20, id: 2, sources: 1, size: 18x19, npix 189, brick X: 177,195, Y: 6,25, one pixel: 185 6 Blob 11 finished, total: Wall: 0.47 s, CPU: 0.45 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.1146 MB Blob 19 of 20, id: 3, sources: 1, size: 19x18, npix 180, brick X: 147,166, Y: 27,45, one pixel: 156 27 Blob 18 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.114776 MB Blob 20 of 20, id: 1, sources: 1, size: 18x18, npix 171, brick X: 81,99, Y: 2,20, one pixel: 89 2 Blob 17 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149328 MB Blob 15 finished, total: Wall: 0.64 s, CPU: 0.63 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149532 MB Blob 19 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.114776 MB Blob 20 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 961 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149328 MB Blob 14 finished, total: Wall: 0.76 s, CPU: 0.75 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149532 MB Blob 10 finished, total: Wall: 0.78 s, CPU: 0.78 s, VmPeak: 671 MB, VmSize: 671 MB, VmRSS: 97 MB, VmData: 142 MB, maxrss: 0.098896 MB Blob 16 finished, total: Wall: 0.90 s, CPU: 0.82 s, VmPeak: 954 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149468 MB Blob 12 finished, total: Wall: 0.91 s, CPU: 0.91 s, VmPeak: 963 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149632 MB Blob 8 finished, total: Wall: 0.99 s, CPU: 0.96 s, VmPeak: 695 MB, VmSize: 695 MB, VmRSS: 112 MB, VmData: 166 MB, maxrss: 0.11474 MB Blob 7 finished, total: Wall: 1.18 s, CPU: 1.16 s, VmPeak: 958 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149088 MB Blob 9 finished, total: Wall: 1.30 s, CPU: 1.30 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150192 MB Measuring 1 iterative sources Measuring 2 iterative sources Blob 5 finished, total: Wall: 1.61 s, CPU: 1.59 s, VmPeak: 960 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149432 MB Blob 6 finished, total: Wall: 1.64 s, CPU: 1.57 s, VmPeak: 954 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.15564 MB Blob 4 finished, total: Wall: 1.74 s, CPU: 1.73 s, VmPeak: 956 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150344 MB Blob 3 finished, total: Wall: 1.91 s, CPU: 1.89 s, VmPeak: 962 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.14996 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.92020, 30.60196), pm (3.3, -3.6), parallax 1.506 with NanoMaggies: g=20.1, r=18.4, z=17.3 Reset brightness to NanoMaggies: g=19.8, r=18.4, z=17.5 Blob 2 finished, total: Wall: 3.88 s, CPU: 3.85 s, VmPeak: 957 MB, VmSize: 732 MB, VmRSS: 148 MB, VmData: 181 MB, maxrss: 0.151096 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.30089, ee1=-0.0339746, ee2=-0.0931892 Measuring 9 iterative sources Blob 1 finished, total: Wall: 17.45 s, CPU: 17.43 s, VmPeak: 957 MB, VmSize: 741 MB, VmRSS: 161 MB, VmData: 190 MB, maxrss: 0.16506 MB Old catalog: 38 New catalog: 44 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/blobs-custom-029913p30591.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/metrics/cus/all-models-custom-029913p30591.fits Stage fitblobs : Wall: 18.59 s, CPU: 1.09 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 233 MB, VmData: 258 MB, maxrss: 0.238224 MB Stage fitblobs finished: 2020-08-05T20:50:31.767033 Resources for stage fitblobs : 36.896 s worker CPU, 38.212 s worker Wall, Wall: 18.596 s, Cores in use: 2.04, Total efficiency (on 16 cores): 12.8 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T20:50:31.783499 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-blobmodel-z.fits.fz CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/tmp-legacysurvey-custom-029913p30591-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/tmp-legacysurvey-custom-029913p30591-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/tmp-legacysurvey-custom-029913p30591-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/tmp-legacysurvey-custom-029913p30591-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-resid.jpg Stage coadds : Wall: 2.76 s, CPU: 0.81 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 233 MB, VmData: 258 MB, maxrss: 0.238676 MB Stage coadds finished: 2020-08-05T20:50:34.538817 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Resources for stage coadds : 10.098 s worker CPU, 12.577 s worker Wall, Wall: 2.757 s, Cores in use: 3.96, Total efficiency (on 16 cores): 24.7 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-coadds.p Running stage wise_forced WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Running stage wise_forced at 2020-08-05T20:50:34.552849 Cut to 1 unWISE tiles Reading WISE tile 0295p302 band 1 Reading WISE tile 0295p302 band 2 Reading WISE tile 0295p302 band 3 Reading WISE tile 0295p302 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 960 MB, VmSize: 807 MB, VmRSS: 149 MB, VmData: 172 MB, maxrss: 0.213536 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.08 s, CPU: 0.08 s, VmPeak: 954 MB, VmSize: 814 MB, VmRSS: 153 MB, VmData: 179 MB, maxrss: 0.1966 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 807 MB, VmRSS: 146 MB, VmData: 172 MB, maxrss: 0.209476 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 808 MB, VmSize: 805 MB, VmRSS: 149 MB, VmData: 173 MB, maxrss: 0.213212 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/tmp-legacysurvey-custom-029913p30591-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/tmp-legacysurvey-custom-029913p30591-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.15 s, CPU: 0.72 s, VmPeak: 1046 MB, VmSize: 1046 MB, VmRSS: 234 MB, VmData: 258 MB, maxrss: 0.23938 MB Stage wise_forced finished: 2020-08-05T20:50:36.704799 Resources for stage wise_forced : 3.215 s worker CPU, 4.661 s worker Wall, Wall: 2.153 s, Cores in use: 1.83, Total efficiency (on 16 cores): 11.4 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T20:50:36.718748 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/coadd/cus/custom-029913p30591/legacysurvey-custom-029913p30591-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/tractor-i/cus/tractor-custom-029913p30591.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/tractor/cus/tractor-custom-029913p30591.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/tractor/cus/brick-custom-029913p30591.sha256sum Stage writecat : Wall: 0.77 s, CPU: 0.61 s, VmPeak: 1178 MB, VmSize: 1050 MB, VmRSS: 236 MB, VmData: 258 MB, maxrss: 0.372388 MB Stage writecat finished: 2020-08-05T20:50:37.487544 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.771 s, Cores in use: 0.79, Total efficiency (on 16 cores): 5.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC1909900/PGC1909900-largegalaxy-writecat.p All done: 60.944 s worker CPU, 768.211 s worker Wall, Wall: 124.379 s, Cores in use: 0.59, Total efficiency (on 16 cores): 3.7 % Finished galaxy PGC1909900 in 2.109 minutes. Started working on galaxy PGC1909900 at Fri Aug 7 09:47:49 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.9142729006169 30.591415654685647 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-07T09:47:50.633909 legacypipe git version: DR9.5.11-watershed-3-gd509eaaf Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.9142729006169', '30.591415654685647', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-%%(stage)s.p', '--force-all', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.9142729006169 30.591415654685647 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-%%(stage)s.p --force-all --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.9142729006169 30.591415654685647 Starting process 18399 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 18400 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 18401 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 18402 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 18403 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05954 MB Starting process 18404 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 18405 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059552 MB Starting process 18406 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 18407 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059256 MB Starting process 18408 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 18409 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05926 MB Starting process 18410 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 18412 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 18413 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 18414 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Starting process 18411 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059268 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-07T09:47:51.069996 Keeping 13 CCDs: c4d_181102_051956_ooi_z_ls9-N23 z expnum 789984 exptime 81.0 propid 2014B-0404 seeing 0.90 MJD 58424.222 object DECaLS_4933_z decam/CP/V4.8.2a/CP20181101/c4d_181102_051956_ooi_z_ls9.fits.fz c4d_181102_041339_ooi_r_ls9-N23 r expnum 789955 exptime 80.0 propid 2014B-0404 seeing 1.11 MJD 58424.176 object DECaLS_4933_r decam/CP/V4.8.2a/CP20181101/c4d_181102_041339_ooi_r_ls9.fits.fz c4d_181103_035825_ooi_g_ls9-N23 g expnum 790262 exptime 149.0 propid 2014B-0404 seeing 1.39 MJD 58425.166 object DECaLS_4933_g decam/CP/V4.8.2a/CP20181102/c4d_181103_035825_ooi_g_ls9.fits.fz c4d_181105_051141_ooi_z_ls9-N23 z expnum 790940 exptime 146.0 propid 2014B-0404 seeing 1.01 MJD 58427.216 object DECaLS_4933_z decam/CP/V4.8.2a/CP20181104/c4d_181105_051141_ooi_z_ls9.fits.fz c4d_181017_052143_ooi_z_ls9-N26 z expnum 784263 exptime 213.0 propid 2014B-0404 seeing 1.63 MJD 58408.223 object DECaLS_36677_z decam/CP/V4.8.2a/CP20181016/c4d_181017_052143_ooi_z_ls9.fits.fz c4d_181104_043241_ooi_r_ls9-N26 r expnum 790580 exptime 81.0 propid 2014B-0404 seeing 1.31 MJD 58426.189 object DECaLS_36677_r decam/CP/V4.8.2a/CP20181103/c4d_181104_043241_ooi_r_ls9.fits.fz c4d_181103_045318_ooi_g_ls9-N26 g expnum 790282 exptime 195.0 propid 2014B-0404 seeing 1.60 MJD 58425.204 object DECaLS_36677_g decam/CP/V4.8.2a/CP20181102/c4d_181103_045318_ooi_g_ls9.fits.fz c4d_181101_041427_ooi_r_ls9-N27 r expnum 789635 exptime 146.0 propid 2014B-0404 seeing 1.52 MJD 58423.177 object DECaLS_20805_r decam/CP/V4.8.2a/CP20181031/c4d_181101_041427_ooi_r_ls9.fits.fz c4d_181101_034523_ooi_g_ls9-N27 g expnum 789626 exptime 179.0 propid 2014B-0404 seeing 1.83 MJD 58423.157 object DECaLS_20805_g decam/CP/V4.8.2a/CP20181031/c4d_181101_034523_ooi_g_ls9.fits.fz c4d_181002_060458_ooi_z_ls9-N27 z expnum 779934 exptime 93.0 propid 2014B-0404 seeing 1.04 MJD 58393.253 object DECaLS_20805_z decam/CP/V4.8.2a/CP20181001/c4d_181002_060458_ooi_z_ls9.fits.fz c4d_140813_100741_ooi_z_ls9-S29 z expnum 347519 exptime 137.0 propid 2014B-0404 seeing 1.02 MJD 56882.420 object DECaLS_4932_z decam/CP/V4.8.2a/CP20140812/c4d_140813_100741_ooi_z_ls9.fits.fz c4d_180906_072940_ooi_g_ls9-S29 g expnum 769698 exptime 110.0 propid 2014B-0404 seeing 1.52 MJD 58367.312 object DECaLS_4932_g decam/CP/V4.8.2a/CP20180905/c4d_180906_072940_ooi_g_ls9.fits.fz c4d_180811_093253_ooi_r_ls9-S29 r expnum 764308 exptime 43.0 propid 2014B-0404 seeing 1.11 MJD 58341.398 object DECaLS_4932_r decam/CP/V4.8.2a/CP20180810/c4d_180811_093253_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181101T041427_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T045318_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T051956_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T043241_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060458_oi[N27,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T041339_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T035825_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532159-z-20181017T052143_oi[N26,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T051141_oi[N23,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180811T093253_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140813T100433_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T072940_oi[S29,noinherit][2046,4094][real]: DECaLS_ The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181101T034523_oi[N27,noinherit][2046,4094][real]: DECaLS_ Stage tims : Wall: 266.97 s, CPU: 1.09 s, VmPeak: 1005 MB, VmSize: 1005 MB, VmRSS: 182 MB, VmData: 215 MB, maxrss: 0.186232 MB Stage tims finished: 2020-08-07T09:52:18.041609 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532bf3-z-20181105T051141_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95326b5-z-20181102T051956_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537a95-r-20181102T041339_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T045318_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9537eb2-r-20181104T043241_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95376f2-r-20181101T041427_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_954c6e6-z-20140813T100433_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95382f9-g-20181101T034523_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95353ee-g-20180906T072940_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage tims : 8.247 s worker CPU, 1098.868 s worker Wall, Wall: 266.973 s, Cores in use: 0.03, Total efficiency (on 16 cores): 0.2 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953878f-g-20181103T035825_oi[N23,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9532159-z-20181017T052143_oi[N26,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_953255f-r-20180811T093253_oi[S29,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Running stage refs at 2020-08-07T09:52:18.175989 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-03018.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-02891.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/reference-custom-029914p30591.fits Stage refs : Wall: 21.70 s, CPU: 2.29 s, VmPeak: 1036 MB, VmSize: 1030 MB, VmRSS: 207 MB, VmData: 240 MB, maxrss: 0.212304 MB Stage refs finished: 2020-08-07T09:52:39.871299 Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9530016-z-20181002T060458_oi[N27,noinherit][2046,4094][real]: DECaLS_ [astropy.io.fits.card] Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 21.697 s, Cores in use: 0.11, Total efficiency (on 16 cores): 0.7 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-07T09:52:40.157382 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/outlier-mask-custom-029914p30591.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/outliers-pre-custom-029914p30591.jpg Image c4d_181103_035825_ooi_g_ls9-N23 g : masking 571 positive outlier pixels and 0 negative outlier pixels Image c4d_181104_043241_ooi_r_ls9-N26 r : masking 293 positive outlier pixels and 0 negative outlier pixels Image c4d_181101_041427_ooi_r_ls9-N27 r : masking 92 positive outlier pixels and 0 negative outlier pixels Image c4d_181017_052143_ooi_z_ls9-N26 z : masking 75 positive outlier pixels and 0 negative outlier pixels Image c4d_181105_051141_ooi_z_ls9-N23 z : masking 1255 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/outlier-mask-custom-029914p30591.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/outliers-post-custom-029914p30591.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/outliers-masked-pos-custom-029914p30591.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/outliers-masked-neg-custom-029914p30591.jpg Stage outliers : Wall: 1.12 s, CPU: 0.78 s, VmPeak: 1039 MB, VmSize: 1039 MB, VmRSS: 228 MB, VmData: 258 MB, maxrss: 0.233404 MB Stage outliers finished: 2020-08-07T09:52:41.272860 Resources for stage outliers : 1.344 s worker CPU, 1.408 s worker Wall, Wall: 1.117 s, Cores in use: 1.90, Total efficiency (on 16 cores): 11.9 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-07T09:52:41.475802 Stage halos : Wall: 6.47 s, CPU: 0.37 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 228 MB, VmData: 258 MB, maxrss: 0.23396 MB Stage halos finished: 2020-08-07T09:52:47.945370 Resources for stage halos : 0.206 s worker CPU, 7.061 s worker Wall, Wall: 6.471 s, Cores in use: 0.09, Total efficiency (on 16 cores): 0.6 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-07T09:52:47.978200 PSF sigmas in coadd pixels: ['2.26', '2.60', '2.98', '2.47'] Using average PSF sigma 2.5781974720435086 Gaussian PSF norm 0.10941551018987178 vs pixelized 0.099566214 average tim pixel scale / coadd scale: 1.0014114355337842 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.80', '2.13', '2.47', '1.80'] Using average PSF sigma 2.0495109025437412 Gaussian PSF norm 0.13764005423135708 vs pixelized 0.11557186 average tim pixel scale / coadd scale: 1.0014251321074303 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.47', '1.63', '2.64', '1.68', '1.65'] Using average PSF sigma 1.8166721625924473 Gaussian PSF norm 0.15528106698751862 vs pixelized 0.12575603 average tim pixel scale / coadd scale: 1.0014226027401805 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.31 s, CPU: 0.24 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.235556 MB Stage fit_on_coadds finished: 2020-08-07T09:52:48.289239 Resources for stage fit_on_coadds : 0.286 s worker CPU, 0.286 s worker Wall, Wall: 0.313 s, Cores in use: 1.68, Total efficiency (on 16 cores): 10.5 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-07T09:52:48.322528 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 59 potential peaks Of 59 potential peaks: 36 in veto map, 4 cut by saddle test, 0 cut by aper test, 19 kept SED z : 19 new peaks Found 50 potential peaks Of 50 potential peaks: 40 in veto map, 5 cut by saddle test, 0 cut by aper test, 5 kept SED r : 5 new peaks Found 40 potential peaks Of 40 potential peaks: 32 in veto map, 4 cut by saddle test, 0 cut by aper test, 4 kept SED g : 4 new peaks Found 54 potential peaks Of 54 potential peaks: 47 in veto map, 4 cut by saddle test, 0 cut by aper test, 3 kept SED Flat : 3 new peaks Found 64 potential peaks Of 64 potential peaks: 56 in veto map, 7 cut by saddle test, 0 cut by aper test, 1 kept SED Red : 1 new peaks Adding 32 new sources Median coadd sky for g : 2.9780897e-05 Median coadd sky for r : 0.00013905852 Median coadd sky for z : 0.00041575817 Stage srcs : Wall: 0.66 s, CPU: 0.61 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 230 MB, VmData: 258 MB, maxrss: 0.235952 MB Stage srcs finished: 2020-08-07T09:52:48.983276 Resources for stage srcs : 0.105 s worker CPU, 0.105 s worker Wall, Wall: 0.662 s, Cores in use: 1.08, Total efficiency (on 16 cores): 6.8 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-07T09:52:48.994962 Blob 1 of 19, id: 4, sources: 10, size: 198x181, npix 22561, brick X: 42,240, Y: 56,237, one pixel: 148 56 Blob 2 of 19, id: 13, sources: 4, size: 68x66, npix 2961, brick X: 43,111, Y: 221,287, one pixel: 66 221 Blob 3 of 19, id: 14, sources: 1, size: 38x42, npix 1081, brick X: 239,277, Y: 239,281, one pixel: 257 239 Blob 4 of 19, id: 0, sources: 1, size: 50x28, npix 1013, brick X: 21,71, Y: 0,28, one pixel: 28 0 Blob 5 of 19, id: 15, sources: 2, size: 42x43, npix 973, brick X: 198,240, Y: 244,287, one pixel: 209 244 Blob 6 of 19, id: 9, sources: 2, size: 44x34, npix 951, brick X: 230,274, Y: 124,158, one pixel: 242 124 Blob 7 of 19, id: 11, sources: 2, size: 31x44, npix 738, brick X: 242,273, Y: 172,216, one pixel: 257 172 Blob 8 of 19, id: 7, sources: 1, size: 30x31, npix 605, brick X: 21,51, Y: 89,120, one pixel: 33 89 Blob 9 of 19, id: 10, sources: 1, size: 27x27, npix 466, brick X: 11,38, Y: 155,182, one pixel: 23 155 Blob 10 of 19, id: 17, sources: 1, size: 27x24, npix 423, brick X: 171,198, Y: 263,287, one pixel: 182 263 Blob 11 of 19, id: 5, sources: 1, size: 25x26, npix 405, brick X: 251,276, Y: 58,84, one pixel: 261 58 Blob 12 of 19, id: 12, sources: 1, size: 24x24, npix 349, brick X: 63,87, Y: 193,217, one pixel: 72 193 Blob 13 of 19, id: 8, sources: 1, size: 22x24, npix 346, brick X: 244,266, Y: 89,113, one pixel: 254 89 Blob 14 of 19, id: 6, sources: 1, size: 17x28, npix 340, brick X: 270,287, Y: 86,114, one pixel: 281 86 Blob 15 of 19, id: 16, sources: 1, size: 22x23, npix 315, brick X: 116,138, Y: 247,270, one pixel: 125 247 Blob 16 of 19, id: 18, sources: 1, size: 22x15, npix 228, brick X: 8,30, Y: 272,287, one pixel: 17 272 Blob 17 of 19, id: 2, sources: 1, size: 18x19, npix 189, brick X: 183,201, Y: 5,24, one pixel: 191 5 Blob 15 finished, total: Wall: 0.27 s, CPU: 0.27 s, VmPeak: 954 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145784 MB Blob 12 finished, total: Wall: 0.31 s, CPU: 0.31 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144328 MB Blob 18 of 19, id: 3, sources: 1, size: 19x18, npix 189, brick X: 153,172, Y: 27,45, one pixel: 162 27 Blob 19 of 19, id: 1, sources: 1, size: 17x19, npix 179, brick X: 88,105, Y: 1,20, one pixel: 96 1 Blob 11 finished, total: Wall: 0.37 s, CPU: 0.37 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144936 MB Blob 18 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144328 MB Blob 17 finished, total: Wall: 0.08 s, CPU: 0.08 s, VmPeak: 954 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.145784 MB Blob 19 finished, total: Wall: 0.07 s, CPU: 0.07 s, VmPeak: 963 MB, VmSize: 726 MB, VmRSS: 142 MB, VmData: 181 MB, maxrss: 0.144936 MB Blob 16 finished, total: Wall: 0.67 s, CPU: 0.65 s, VmPeak: 954 MB, VmSize: 725 MB, VmRSS: 142 MB, VmData: 180 MB, maxrss: 0.145904 MB Blob 9 finished, total: Wall: 0.76 s, CPU: 0.74 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144672 MB Blob 13 finished, total: Wall: 0.77 s, CPU: 0.75 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.115868 MB Blob 10 finished, total: Wall: 1.08 s, CPU: 1.08 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14432 MB Blob 8 finished, total: Wall: 1.09 s, CPU: 1.09 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 113 MB, VmData: 167 MB, maxrss: 0.115892 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 1.33 s, CPU: 1.32 s, VmPeak: 957 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144348 MB Blob 14 finished, total: Wall: 1.33 s, CPU: 1.27 s, VmPeak: 961 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14436 MB Measuring 2 iterative sources Blob 6 finished, total: Wall: 1.46 s, CPU: 1.41 s, VmPeak: 958 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.144448 MB Blob 5 finished, total: Wall: 1.47 s, CPU: 1.46 s, VmPeak: 960 MB, VmSize: 726 MB, VmRSS: 141 MB, VmData: 181 MB, maxrss: 0.14454 MB Blob 4 finished, total: Wall: 1.75 s, CPU: 1.75 s, VmPeak: 962 MB, VmSize: 726 MB, VmRSS: 143 MB, VmData: 181 MB, maxrss: 0.146316 MB Blob 3 finished, total: Wall: 1.85 s, CPU: 1.85 s, VmPeak: 696 MB, VmSize: 696 MB, VmRSS: 114 MB, VmData: 167 MB, maxrss: 0.1168 MB Dropped reference star: GaiaSource at GaiaPosition: RA, Dec = (29.92020, 30.60196), pm (3.3, -3.6), parallax 1.506 with NanoMaggies: g=20.1, r=18.5, z=17.4 Reset brightness to NanoMaggies: g=19.8, r=18.4, z=17.5 Blob 2 finished, total: Wall: 3.48 s, CPU: 3.48 s, VmPeak: 956 MB, VmSize: 726 MB, VmRSS: 144 MB, VmData: 181 MB, maxrss: 0.14724 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=0.880946, ee1=-0.0210536, ee2=-0.0867281 Measuring 7 iterative sources Blob 1 finished, total: Wall: 13.44 s, CPU: 13.43 s, VmPeak: 957 MB, VmSize: 727 MB, VmRSS: 151 MB, VmData: 182 MB, maxrss: 0.15416 MB Old catalog: 35 New catalog: 39 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/blobs-custom-029914p30591.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/metrics/cus/all-models-custom-029914p30591.fits Stage fitblobs : Wall: 13.87 s, CPU: 0.37 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 231 MB, VmData: 258 MB, maxrss: 0.236376 MB Stage fitblobs finished: 2020-08-07T09:53:02.869325 Resources for stage fitblobs : 31.701 s worker CPU, 32.115 s worker Wall, Wall: 13.876 s, Cores in use: 2.31, Total efficiency (on 16 cores): 14.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-07T09:53:02.922507 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/tmp-legacysurvey-custom-029914p30591-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/tmp-legacysurvey-custom-029914p30591-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/tmp-legacysurvey-custom-029914p30591-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/tmp-legacysurvey-custom-029914p30591-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-resid.jpg Stage coadds : Wall: 17.81 s, CPU: 0.67 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 231 MB, VmData: 258 MB, maxrss: 0.236828 MB Stage coadds finished: 2020-08-07T09:53:20.730361 Resources for stage coadds : 9.409 s worker CPU, 10.677 s worker Wall, Wall: 17.809 s, Cores in use: 0.57, Total efficiency (on 16 cores): 3.5 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-07T09:53:20.784493 Cut to 1 unWISE tiles Reading WISE tile 0295p302 band 1 Reading WISE tile 0295p302 band 2 Reading WISE tile 0295p302 band 3 Reading WISE tile 0295p302 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 962 MB, VmSize: 800 MB, VmRSS: 142 MB, VmData: 171 MB, maxrss: 0.205124 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.05 s, CPU: 0.05 s, VmPeak: 963 MB, VmSize: 800 MB, VmRSS: 143 MB, VmData: 171 MB, maxrss: 0.207132 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.06 s, CPU: 0.06 s, VmPeak: 956 MB, VmSize: 802 MB, VmRSS: 144 MB, VmData: 173 MB, maxrss: 0.207044 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/029/0295p302/unwise-0295p302-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.07 s, CPU: 0.07 s, VmPeak: 956 MB, VmSize: 804 MB, VmRSS: 146 MB, VmData: 175 MB, maxrss: 0.19056 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/tmp-legacysurvey-custom-029914p30591-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/tmp-legacysurvey-custom-029914p30591-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 9.17 s, CPU: 0.64 s, VmPeak: 1040 MB, VmSize: 1040 MB, VmRSS: 232 MB, VmData: 258 MB, maxrss: 0.237532 MB Stage wise_forced finished: 2020-08-07T09:53:29.949732 Resources for stage wise_forced : 3.065 s worker CPU, 11.629 s worker Wall, Wall: 9.167 s, Cores in use: 0.40, Total efficiency (on 16 cores): 2.5 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-07T09:53:29.980348 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/coadd/cus/custom-029914p30591/legacysurvey-custom-029914p30591-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/tractor-i/cus/tractor-custom-029914p30591.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/tractor/cus/tractor-custom-029914p30591.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/tractor/cus/brick-custom-029914p30591.sha256sum Stage writecat : Wall: 0.87 s, CPU: 0.69 s, VmPeak: 1172 MB, VmSize: 1044 MB, VmRSS: 234 MB, VmData: 258 MB, maxrss: 0.37052 MB Stage writecat finished: 2020-08-07T09:53:30.845856 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 0.867 s, Cores in use: 0.80, Total efficiency (on 16 cores): 5.0 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9alpha/029/PGC1909900/PGC1909900-largegalaxy-writecat.p All done: 54.367 s worker CPU, 1162.154 s worker Wall, Wall: 339.886 s, Cores in use: 0.18, Total efficiency (on 16 cores): 1.1 % Finished galaxy PGC1909900 in 5.729 minutes.