Started working on galaxy PGC780659 at Wed Aug 5 21:00:13 2020 Bands touching this brick, g r z python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.3883765 -25.285705 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 runbrick.py starting at 2020-08-05T21:00:14.239059 legacypipe git version: DR9.5.10-12-gf22e529f Command-line args: ['/global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py', '--radec', '29.3883765', '-25.285705', '--width', '287', '--height', '287', '--pixscale', '0.262', '--threads', '16', '--outdir', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659', '--survey-dir', '/global/cfs/cdirs/cosmo/work/legacysurvey/dr9', '--run', 'south', '--skip-calibs', '--checkpoint', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-checkpoint.p', '--pickle', '/global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-%%(stage)s.p', '--fit-on-coadds', '--saddle-fraction', '0.2', '--saddle-min', '4.0'] python /global/homes/i/ioannis/repos/git/legacypipe/py/legacypipe/runbrick.py --radec 29.3883765 -25.285705 --width 287 --height 287 --pixscale 0.262 --threads 16 --outdir /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659 --survey-dir /global/cfs/cdirs/cosmo/work/legacysurvey/dr9 --run south --skip-calibs --checkpoint /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-checkpoint.p --pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-%%(stage)s.p --fit-on-coadds --saddle-fraction 0.2 --saddle-min 4.0 Parsed RA,Dec 29.3883765 -25.285705 Starting process 6034 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05922 MB Starting process 6035 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 6036 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 6037 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059228 MB Starting process 6038 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059328 MB Starting process 6039 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 6040 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059316 MB Starting process 6041 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 6042 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.05924 MB Starting process 6043 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059244 MB Starting process 6044 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 6045 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 6046 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 6047 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059248 MB Starting process 6048 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Starting process 6049 Wall: -0.00 s, CPU: -0.00 s, VmPeak: 642 MB, VmSize: 642 MB, VmRSS: 58 MB, VmData: 129 MB, maxrss: 0.059252 MB Runstage writecat Runstage wise_forced Runstage coadds Runstage fitblobs Runstage srcs Runstage fit_on_coadds Runstage halos Runstage outliers Runstage refs Runstage tims Running stage tims Running stage tims at 2020-08-05T21:00:14.850257 CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Keeping 28 CCDs: c4d_150817_101222_ooi_z_ls9-N11 z expnum 464605 exptime 90.0 propid 2012B-0001 seeing 1.08 MJD 57251.424 object DES survey hex 292-258 tiling 4 decam/CP/V4.8.2a/CP20150816/c4d_150817_101222_ooi_z_ls9.fits.fz c4d_150913_084328_ooi_r_ls9-N11 r expnum 474404 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57278.362 object DES survey hex 292-258 tiling 4 decam/CP/V4.8.2a/CP20150912/c4d_150913_084328_ooi_r_ls9.fits.fz c4d_150913_084518_ooi_g_ls9-N11 g expnum 474405 exptime 90.0 propid 2012B-0001 seeing 1.11 MJD 57278.363 object DES survey hex 292-258 tiling 4 decam/CP/V4.8.2a/CP20150912/c4d_150913_084518_ooi_g_ls9.fits.fz c4d_151023_061100_ooi_z_ls9-S11 z expnum 486785 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57318.256 object DES survey hex 292-258 tiling 5 decam/CP/V4.8.2a/CP20151022/c4d_151023_061100_ooi_z_ls9.fits.fz c4d_151108_034804_ooi_r_ls9-S11 r expnum 491074 exptime 90.0 propid 2012B-0001 seeing 1.12 MJD 57334.157 object DES survey hex 292-258 tiling 5 decam/CP/V4.8.2a/CP20151107/c4d_151108_034804_ooi_r_ls9.fits.fz c4d_150911_094454_ooi_z_ls9-S7 z expnum 473644 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 57276.405 object DES survey hex 292-258 tiling 2 decam/CP/V4.8.2a/CP20150910/c4d_150911_094454_ooi_z_ls9.fits.fz c4d_150911_094454_ooi_z_ls9-N7 z expnum 473644 exptime 90.0 propid 2012B-0001 seeing 1.36 MJD 57276.405 object DES survey hex 292-258 tiling 2 decam/CP/V4.8.2a/CP20150910/c4d_150911_094454_ooi_z_ls9.fits.fz c4d_151106_050100_ooi_r_ls9-N7 r expnum 490322 exptime 90.0 propid 2012B-0001 seeing 1.07 MJD 57332.207 object DES survey hex 292-258 tiling 2 decam/CP/V4.8.2a/CP20151105/c4d_151106_050100_ooi_r_ls9.fits.fz c4d_151107_034535_ooi_g_ls9-N7 g expnum 490685 exptime 90.0 propid 2012B-0001 seeing 1.13 MJD 57333.155 object DES survey hex 292-258 tiling 2 decam/CP/V4.8.2a/CP20151106/c4d_151107_034535_ooi_g_ls9.fits.fz c4d_161109_062341_ooi_g_ls9-N6 g expnum 591515 exptime 90.0 propid 2012B-0001 seeing 1.01 MJD 57701.265 object DES survey hex 292-258 tiling 6 decam/CP/V4.8.2/CP20161108/c4d_161109_062341_ooi_g_ls9.fits.fz c4d_161109_062142_ooi_r_ls9-N6 r expnum 591514 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 57701.263 object DES survey hex 292-258 tiling 6 decam/CP/V4.8.2/CP20161108/c4d_161109_062142_ooi_r_ls9.fits.fz c4d_161203_015252_ooi_z_ls9-N6 z expnum 598958 exptime 90.0 propid 2012B-0001 seeing 1.03 MJD 57725.077 object DES survey hex 292-258 tiling 6 decam/CP/V4.8.2/CP20161202/c4d_161203_015252_ooi_z_ls9.fits.fz c4d_151103_042406_ooi_r_ls9-S17 r expnum 489477 exptime 90.0 propid 2012B-0001 seeing 1.28 MJD 57329.182 object DES survey hex 292-258 tiling 1 decam/CP/V4.8.2a/CP20151102/c4d_151103_042406_ooi_r_ls9.fits.fz c4d_151017_052759_ooi_r_ls9-S17 r expnum 484932 exptime 90.0 propid 2012B-0001 seeing 1.53 MJD 57312.226 object DES survey hex 292-258 tiling 1 decam/CP/V4.8.2a/CP20151016/c4d_151017_052759_ooi_r_ls9.fits.fz c4d_151017_052958_ooi_g_ls9-S17 g expnum 484933 exptime 90.0 propid 2012B-0001 seeing 1.41 MJD 57312.228 object DES survey hex 292-258 tiling 1 decam/CP/V4.8.2a/CP20151016/c4d_151017_052958_ooi_g_ls9.fits.fz c4d_150904_091525_ooi_z_ls9-S17 z expnum 471119 exptime 90.0 propid 2012B-0001 seeing 1.00 MJD 57269.384 object DES survey hex 292-258 tiling 1 decam/CP/V4.8.2a/CP20150903/c4d_150904_091525_ooi_z_ls9.fits.fz c4d_171224_010152_ooi_z_ls9-S23 z expnum 706745 exptime 90.0 propid 2012B-0001 seeing 0.99 MJD 58111.043 object DES survey hex 292-258 tiling 8 decam/CP/V4.8.2a/CP20171223/c4d_171224_010152_ooi_z_ls9.fits.fz c4d_171124_052347_ooi_r_ls9-S23 r expnum 699234 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 58081.225 object DES survey hex 292-258 tiling 8 decam/CP/V4.8.2a/CP20171123/c4d_171124_052347_ooi_r_ls9.fits.fz c4d_171124_052546_ooi_g_ls9-S23 g expnum 699235 exptime 90.0 propid 2012B-0001 seeing 1.02 MJD 58081.226 object DES survey hex 292-258 tiling 8 decam/CP/V4.8.2a/CP20171123/c4d_171124_052546_ooi_g_ls9.fits.fz c4d_141231_032245_ooi_z_ls9-N28 z expnum 393521 exptime 90.0 propid 2012B-0001 seeing 0.98 MJD 57022.139 object DES survey hex 295-237 tiling 3 decam/CP/V4.8.2a/CP20141230/c4d_141231_032245_ooi_z_ls9.fits.fz c4d_151106_033256_ooi_g_ls9-N28 g expnum 490280 exptime 90.0 propid 2012B-0001 seeing 1.15 MJD 57332.146 object DES survey hex 295-237 tiling 3 decam/CP/V4.8.2a/CP20151105/c4d_151106_033256_ooi_g_ls9.fits.fz c4d_150114_020403_ooi_r_ls9-N28 r expnum 397730 exptime 90.0 propid 2012B-0001 seeing 1.10 MJD 57036.085 object DES survey hex 295-237 tiling 3 decam/CP/V4.8.2a/CP20150113/c4d_150114_020403_ooi_r_ls9.fits.fz c4d_171011_075322_ooi_z_ls9-S1 z expnum 685848 exptime 90.0 propid 2012B-0001 seeing 1.22 MJD 58037.329 object DES survey hex 292-258 tiling 7 decam/CP/V4.8.2a/CP20171010/c4d_171011_075322_ooi_z_ls9.fits.fz c4d_161203_020048_ooi_g_ls9-S1 g expnum 598962 exptime 90.0 propid 2012B-0001 seeing 1.43 MJD 57725.082 object DES survey hex 292-258 tiling 7 decam/CP/V4.8.2/CP20161202/c4d_161203_020048_ooi_g_ls9.fits.fz c4d_161203_015450_ooi_r_ls9-S1 r expnum 598959 exptime 90.0 propid 2012B-0001 seeing 1.29 MJD 57725.078 object DES survey hex 292-258 tiling 7 decam/CP/V4.8.2/CP20161202/c4d_161203_015450_ooi_r_ls9.fits.fz c4d_180127_010014_ooi_z_ls9-S2 z expnum 716058 exptime 90.0 propid 2012B-0001 seeing 1.17 MJD 58145.042 object DES survey hex 292-258 tiling 9 decam/CP/V4.8.2a/CP20180126/c4d_180127_010014_ooi_z_ls9.fits.fz c4d_180116_015511_ooi_g_ls9-S2 g expnum 712475 exptime 90.0 propid 2012B-0001 seeing 1.34 MJD 58134.080 object DES survey hex 292-258 tiling 9 decam/CP/V4.8.2a/CP20180115/c4d_180116_015511_ooi_g_ls9.fits.fz c4d_180116_015112_ooi_r_ls9-S2 r expnum 712473 exptime 90.0 propid 2012B-0001 seeing 1.49 MJD 58134.077 object DES survey hex 292-258 tiling 9 decam/CP/V4.8.2a/CP20180115/c4d_180116_015112_ooi_r_ls9.fits.fz The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566260-z-20150904T091302_oi[S17,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95645c8-r-20151108T034544_oi[S11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95589f7-r-20150913T084056_oi[N11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9567936-z-20150817T101004_oi[N11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563c11-r-20151103T042146_oi[S17,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95638ac-g-20150913T084254_oi[N11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_958078a-g-20151107T034313_oi[N7,noinherit][2046,4094][real]: DES surv Clipping 2 pixels with anomalously large oow values: max 0.0454531 vs median 0.0346118 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9502cdc-z-20161203T015031_oi[N6,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560459-z-20151023T060840_oi[S11,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9501365-r-20161109T061921_oi[N6,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9562265-r-20151017T052539_oi[S17,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524f0b-z-20171224T010152_oi[S23,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9564a60-z-20150911T094231_oi[N7,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161109T062119_oi[N6,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563c11-r-20151106T045840_oi[N7,noinherit][2046,4094][real]: DES surv Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9551b36-r-20150114T020143_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95282f4-g-20171124T052546_oi[S23,noinherit][2046,4094][real]: DES sur Clipping 1 pixels with anomalously large oow values: max 0.0493155 vs median 0.0378994 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95284ad-r-20171124T052347_oi[S23,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9504be0-r-20161203T015230_oi[S1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559743-z-20141231T032026_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951fbc0-z-20171011T075322_oi[S1,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95297f5-g-20180116T015511_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95048f6-g-20161203T015828_oi[S1,noinherit][2046,4094][real]: DES surv Clipping 1 pixels with anomalously large oow values: max 0.0551446 vs median 0.0403586 The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9525b6d-z-20180127T010014_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952946a-r-20180116T015112_oi[S2,noinherit][2046,4094][real]: DES surv The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_958078a-g-20151106T033038_oi[N28,noinherit][2046,4094][real]: DES sur The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9584981-g-20151017T052738_oi[S17,noinherit][2046,4094][real]: DES sur Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Warning: splinesky does not have sky-template version/run/scale values CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' Stage tims : Wall: 92.06 s, CPU: 1.28 s, VmPeak: 1015 MB, VmSize: 1015 MB, VmRSS: 198 MB, VmData: 230 MB, maxrss: 0.202496 MB Stage tims finished: 2020-08-05T21:01:46.913318 WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9524f0b-z-20171224T010152_oi[S23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9501365-r-20161109T061921_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563c11-r-20151106T045840_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9502cdc-z-20161203T015031_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9551b36-r-20150114T020143_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9567936-z-20150817T101004_oi[N11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9504be0-r-20161203T015230_oi[S1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9566260-z-20150904T091302_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95282f4-g-20171124T052546_oi[S23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95589f7-r-20150913T084056_oi[N11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95284ad-r-20171124T052347_oi[S23,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9562265-r-20151017T052539_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_951fbc0-z-20171011T075322_oi[S1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95645c8-r-20151108T034544_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95048f6-g-20161203T015828_oi[S1,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9560459-z-20151023T060840_oi[S11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9525b6d-z-20180127T010014_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9584981-g-20151017T052738_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_958078a-g-20151107T034313_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_958078a-g-20151106T033038_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9563c11-r-20151103T042146_oi[S17,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9500ef2-g-20161109T062119_oi[N6,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95297f5-g-20180116T015511_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Resources for stage tims : 14.610 s worker CPU, 738.599 s worker Wall, Wall: 92.065 s, Cores in use: 0.17, Total efficiency (on 16 cores): 1.1 % Stage tims finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-tims.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-tims.p Running stage refs Warning: splinesky does not have sky-template version/run/scale values Warning: splinesky does not have sky-template version/run/scale values WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_95638ac-g-20150913T084254_oi[N11,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9559743-z-20141231T032026_oi[N28,noinherit][2046,4094][real]: DES sur [astropy.io.fits.card] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_9564a60-z-20150911T094231_oi[N7,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] WARNING: CacheMissingWarning: Not clearing data cache - cache inaccessible due to OSError: [Errno 30] Read-only file system: '/homedir/.astropy/cache/download/py3/lock' [astropy.utils.data] WARNING: The following header keyword is invalid or follows an unrecognized non-standard convention: DECALS_DR9_952946a-r-20180116T015112_oi[S2,noinherit][2046,4094][real]: DES surv [astropy.io.fits.card] Running stage refs at 2020-08-05T21:01:47.498742 Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08650.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08779.fits Reading /global/cfs/cdirs/cosmo/work/gaia/chunks-gaia-dr2-astrom-2/chunk-08778.fits Matched 4 large galaxies to Gaia stars. Matched 0 large galaxies to Tycho-2 stars. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/reference-custom-029388m25285.fits Stage refs : Wall: 18.98 s, CPU: 2.67 s, VmPeak: 1046 MB, VmSize: 1026 MB, VmRSS: 210 MB, VmData: 241 MB, maxrss: 0.214896 MB Stage refs finished: 2020-08-05T21:02:06.481884 Resources for stage refs : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 18.985 s, Cores in use: 0.14, Total efficiency (on 16 cores): 0.9 % Stage refs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-refs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-refs.p Running stage outliers Running stage outliers at 2020-08-05T21:02:06.543755 Failed to apply outlier mask: No such file: /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/outlier-mask-custom-029388m25285.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/outliers-pre-custom-029388m25285.jpg Image c4d_151017_052958_ooi_g_ls9-S17 g : masking 0 positive outlier pixels and 122 negative outlier pixels Image c4d_171124_052546_ooi_g_ls9-S23 g : masking 246 positive outlier pixels and 98 negative outlier pixels Image c4d_161203_020048_ooi_g_ls9-S1 g : masking 161 positive outlier pixels and 102 negative outlier pixels Image c4d_151106_050100_ooi_r_ls9-N7 r : masking 407 positive outlier pixels and 0 negative outlier pixels Image c4d_150913_084328_ooi_r_ls9-N11 r : masking 199 positive outlier pixels and 126 negative outlier pixels Image c4d_151103_042406_ooi_r_ls9-S17 r : masking 330 positive outlier pixels and 0 negative outlier pixels Image c4d_151108_034804_ooi_r_ls9-S11 r : masking 51 positive outlier pixels and 0 negative outlier pixels Image c4d_161203_015252_ooi_z_ls9-N6 z : masking 0 positive outlier pixels and 136 negative outlier pixels Image c4d_141231_032245_ooi_z_ls9-N28 z : masking 342 positive outlier pixels and 0 negative outlier pixels Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/outlier-mask-custom-029388m25285.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/outliers-post-custom-029388m25285.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/outliers-masked-pos-custom-029388m25285.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/outliers-masked-neg-custom-029388m25285.jpg Stage outliers : Wall: 2.61 s, CPU: 1.66 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 243 MB, VmData: 271 MB, maxrss: 0.24916 MB Stage outliers finished: 2020-08-05T21:02:09.155793 Resources for stage outliers : 2.988 s worker CPU, 2.999 s worker Wall, Wall: 2.614 s, Cores in use: 1.78, Total efficiency (on 16 cores): 11.1 % Stage outliers finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-outliers.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-outliers.p Running stage halos Running stage halos at 2020-08-05T21:02:09.625921 Stage halos : Wall: 3.16 s, CPU: 1.72 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 244 MB, VmData: 271 MB, maxrss: 0.249752 MB Stage halos finished: 2020-08-05T21:02:12.787560 Resources for stage halos : 0.336 s worker CPU, 8.033 s worker Wall, Wall: 3.163 s, Cores in use: 0.65, Total efficiency (on 16 cores): 4.1 % Stage halos finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-halos.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-halos.p Running stage fit_on_coadds Running stage fit_on_coadds at 2020-08-05T21:02:12.858118 PSF sigmas in coadd pixels: ['1.81', '1.84', '1.65', '2.30', '1.65', '1.87', '2.32', '2.18'] Using average PSF sigma 1.952626768254127 Gaussian PSF norm 0.14446938675643753 vs pixelized 0.12712117 average tim pixel scale / coadd scale: 1.001043952463856 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-copsf-g.fits.fz PSF sigmas in coadd pixels: ['1.83', '1.82', '1.73', '1.61', '2.08', '2.48', '1.79', '1.78', '2.09', '2.42'] Using average PSF sigma 1.9647111729299147 Gaussian PSF norm 0.1435807948061896 vs pixelized 0.13411891 average tim pixel scale / coadd scale: 1.0010617930008425 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-copsf-r.fits.fz PSF sigmas in coadd pixels: ['1.76', '1.68', '2.21', '1.67', '1.63', '1.61', '1.59', '1.99', '1.90'] Using average PSF sigma 1.7819140755330685 Gaussian PSF norm 0.15830998567621063 vs pixelized 0.13022344 average tim pixel scale / coadd scale: 1.0010242712762178 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-copsf-z.fits.fz Stage fit_on_coadds : Wall: 0.47 s, CPU: 0.47 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.252464 MB Stage fit_on_coadds finished: 2020-08-05T21:02:13.323568 Resources for stage fit_on_coadds : 0.634 s worker CPU, 0.635 s worker Wall, Wall: 0.467 s, Cores in use: 2.37, Total efficiency (on 16 cores): 14.8 % Stage fit_on_coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-fit_on_coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-fit_on_coadds.p Running stage srcs Running stage srcs at 2020-08-05T21:02:13.339421 SED-matched filters: [('z', array([0., 0., 1.])), ('r', array([0., 1., 0.])), ('g', array([1., 0., 0.])), ('Flat', [1.0, 1.0, 1.0]), ('Red', [2.5, 1.0, 0.4])] Found 53 potential peaks Of 53 potential peaks: 19 in veto map, 5 cut by saddle test, 0 cut by aper test, 29 kept SED z : 29 new peaks Found 61 potential peaks Of 61 potential peaks: 35 in veto map, 11 cut by saddle test, 0 cut by aper test, 15 kept SED r : 15 new peaks Found 50 potential peaks Of 50 potential peaks: 42 in veto map, 5 cut by saddle test, 0 cut by aper test, 3 kept SED g : 3 new peaks Found 72 potential peaks Of 72 potential peaks: 54 in veto map, 12 cut by saddle test, 0 cut by aper test, 6 kept SED Flat : 6 new peaks Found 74 potential peaks Of 74 potential peaks: 62 in veto map, 12 cut by saddle test, 0 cut by aper test, 0 kept SED Red : 0 new peaks Adding 53 new sources Median coadd sky for g : -9.499503e-05 Median coadd sky for r : -5.7448735e-05 Median coadd sky for z : 6.3879605e-05 Stage srcs : Wall: 1.40 s, CPU: 1.32 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.252936 MB Stage srcs finished: 2020-08-05T21:02:14.740003 Resources for stage srcs : 0.103 s worker CPU, 0.103 s worker Wall, Wall: 1.402 s, Cores in use: 1.02, Total efficiency (on 16 cores): 6.4 % Stage srcs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-srcs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-srcs.p Running stage fitblobs Running stage fitblobs at 2020-08-05T21:02:14.757226 Blob 1 of 22, id: 6, sources: 20, size: 190x188, npix 16045, brick X: 2,192, Y: 34,222, one pixel: 166 34 Blob 2 of 22, id: 3, sources: 5, size: 48x69, npix 1971, brick X: 0,48, Y: 6,75, one pixel: 17 6 Blob 3 of 22, id: 16, sources: 3, size: 57x45, npix 1552, brick X: 178,235, Y: 210,255, one pixel: 186 210 Blob 4 of 22, id: 14, sources: 3, size: 40x54, npix 1128, brick X: 0,40, Y: 200,254, one pixel: 23 200 Blob 5 of 22, id: 17, sources: 2, size: 32x51, npix 1053, brick X: 37,69, Y: 219,270, one pixel: 49 219 Blob 6 of 22, id: 8, sources: 4, size: 45x48, npix 1050, brick X: 208,253, Y: 47,95, one pixel: 239 47 Blob 7 of 22, id: 0, sources: 2, size: 41x25, npix 772, brick X: 203,244, Y: 0,25, one pixel: 209 0 Blob 8 of 22, id: 15, sources: 2, size: 33x30, npix 585, brick X: 254,287, Y: 200,230, one pixel: 281 200 Blob 9 of 22, id: 11, sources: 1, size: 28x31, npix 564, brick X: 193,221, Y: 110,141, one pixel: 208 110 Blob 10 of 22, id: 7, sources: 2, size: 32x34, npix 522, brick X: 69,101, Y: 47,81, one pixel: 91 47 Blob 11 of 22, id: 4, sources: 1, size: 28x31, npix 497, brick X: 108,136, Y: 7,38, one pixel: 122 7 Blob 12 of 22, id: 5, sources: 1, size: 28x28, npix 488, brick X: 123,151, Y: 33,61, one pixel: 134 33 Blob 13 of 22, id: 18, sources: 1, size: 27x27, npix 470, brick X: 69,96, Y: 233,260, one pixel: 80 233 Blob 14 of 22, id: 2, sources: 1, size: 24x30, npix 467, brick X: 41,65, Y: 3,33, one pixel: 51 3 Blob 15 of 22, id: 19, sources: 1, size: 28x25, npix 445, brick X: 229,257, Y: 260,285, one pixel: 238 260 Blob 16 of 22, id: 20, sources: 1, size: 26x19, npix 366, brick X: 158,184, Y: 268,287, one pixel: 169 268 Blob 17 of 22, id: 10, sources: 1, size: 24x24, npix 353, brick X: 260,284, Y: 107,131, one pixel: 271 107 Measuring 1 iterative sources Blob 13 finished, total: Wall: 0.88 s, CPU: 0.88 s, VmPeak: 978 MB, VmSize: 738 MB, VmRSS: 150 MB, VmData: 187 MB, maxrss: 0.153756 MB Blob 18 of 22, id: 12, sources: 1, size: 22x23, npix 303, brick X: 191,213, Y: 148,171, one pixel: 200 148 Measuring 1 iterative sources Blob 12 finished, total: Wall: 1.22 s, CPU: 1.21 s, VmPeak: 975 MB, VmSize: 738 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.154848 MB Blob 19 of 22, id: 13, sources: 1, size: 22x22, npix 292, brick X: 184,206, Y: 172,194, one pixel: 193 172 Blob 17 finished, total: Wall: 0.34 s, CPU: 0.34 s, VmPeak: 978 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155644 MB Blob 20 of 22, id: 1, sources: 1, size: 18x17, npix 162, brick X: 264,282, Y: 1,18, one pixel: 272 1 Blob 16 finished, total: Wall: 1.54 s, CPU: 1.52 s, VmPeak: 979 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156892 MB Blob 21 of 22, id: 21, sources: 1, size: 18x15, npix 156, brick X: 128,146, Y: 272,287, one pixel: 136 272 Blob 11 finished, total: Wall: 1.67 s, CPU: 1.67 s, VmPeak: 969 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155912 MB Blob 22 of 22, id: 9, sources: 1, size: 17x17, npix 145, brick X: 192,209, Y: 87,104, one pixel: 200 87 Blob 8 finished, total: Wall: 1.70 s, CPU: 1.70 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149828 MB Blob 9 finished, total: Wall: 1.71 s, CPU: 1.70 s, VmPeak: 971 MB, VmSize: 705 MB, VmRSS: 120 MB, VmData: 154 MB, maxrss: 0.154392 MB Blob 15 finished, total: Wall: 1.68 s, CPU: 1.68 s, VmPeak: 973 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156696 MB Blob 14 finished, total: Wall: 1.88 s, CPU: 1.86 s, VmPeak: 959 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.15602 MB Blob 18 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 975 MB, VmSize: 738 MB, VmRSS: 151 MB, VmData: 187 MB, maxrss: 0.154848 MB Measuring 2 iterative sources Blob 10 finished, total: Wall: 1.93 s, CPU: 1.93 s, VmPeak: 951 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149692 MB Blob 6 finished, total: Wall: 1.97 s, CPU: 1.97 s, VmPeak: 974 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155532 MB Blob 20 finished, total: Wall: 0.39 s, CPU: 0.39 s, VmPeak: 979 MB, VmSize: 738 MB, VmRSS: 153 MB, VmData: 187 MB, maxrss: 0.156892 MB Blob 22 finished, total: Wall: 0.28 s, CPU: 0.28 s, VmPeak: 950 MB, VmSize: 732 MB, VmRSS: 146 MB, VmData: 181 MB, maxrss: 0.149828 MB Blob 19 finished, total: Wall: 0.86 s, CPU: 0.86 s, VmPeak: 978 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155644 MB Blob 5 finished, total: Wall: 2.36 s, CPU: 2.36 s, VmPeak: 953 MB, VmSize: 732 MB, VmRSS: 147 MB, VmData: 181 MB, maxrss: 0.150152 MB Blob 21 finished, total: Wall: 0.69 s, CPU: 0.69 s, VmPeak: 969 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155912 MB Blob 3 finished, total: Wall: 2.51 s, CPU: 2.51 s, VmPeak: 936 MB, VmSize: 734 MB, VmRSS: 148 MB, VmData: 183 MB, maxrss: 0.15184 MB Measuring 1 iterative sources Blob 7 finished, total: Wall: 2.88 s, CPU: 2.88 s, VmPeak: 976 MB, VmSize: 739 MB, VmRSS: 154 MB, VmData: 188 MB, maxrss: 0.157352 MB Blob 4 finished, total: Wall: 2.88 s, CPU: 2.88 s, VmPeak: 972 MB, VmSize: 736 MB, VmRSS: 150 MB, VmData: 185 MB, maxrss: 0.154056 MB Blob 2 finished, total: Wall: 3.13 s, CPU: 3.13 s, VmPeak: 973 MB, VmSize: 738 MB, VmRSS: 152 MB, VmData: 187 MB, maxrss: 0.155744 MB Known galaxy. Initial shape: EllipseWithPriors(0.25): log r_e=1.41472, ee1=0.283113, ee2=0.852981 Measuring 10 iterative sources Blob 1 finished, total: Wall: 33.16 s, CPU: 33.15 s, VmPeak: 971 MB, VmSize: 739 MB, VmRSS: 160 MB, VmData: 188 MB, maxrss: 0.163392 MB Old catalog: 58 New catalog: 66 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/blobs-custom-029388m25285.fits.gz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/metrics/cus/all-models-custom-029388m25285.fits Stage fitblobs : Wall: 33.87 s, CPU: 0.69 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 247 MB, VmData: 272 MB, maxrss: 0.253356 MB Stage fitblobs finished: 2020-08-05T21:02:48.630832 Resources for stage fitblobs : 66.573 s worker CPU, 66.941 s worker Wall, Wall: 33.875 s, Cores in use: 1.99, Total efficiency (on 16 cores): 12.4 % Stage fitblobs finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-fitblobs.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-fitblobs.p Running stage coadds Running stage coadds at 2020-08-05T21:02:48.646471 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-ccds.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-invvar-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-nexp-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-depth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-galdepth-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-psfsize-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-chi2-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-blobmodel-g.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-invvar-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-nexp-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-depth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-galdepth-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-psfsize-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-chi2-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-blobmodel-r.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-invvar-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-nexp-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-depth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-galdepth-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-psfsize-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-chi2-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-blobmodel-z.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-depth.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/tmp-legacysurvey-custom-029388m25285-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/tmp-legacysurvey-custom-029388m25285-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/tmp-legacysurvey-custom-029388m25285-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-blobmodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/tmp-legacysurvey-custom-029388m25285-resid.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-resid.jpg Stage coadds : Wall: 1.96 s, CPU: 0.77 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 248 MB, VmData: 272 MB, maxrss: 0.253808 MB Stage coadds finished: 2020-08-05T21:02:50.605423 Resources for stage coadds : 11.316 s worker CPU, 14.289 s worker Wall, Wall: 1.960 s, Cores in use: 6.17, Total efficiency (on 16 cores): 38.6 % Stage coadds finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-coadds.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-coadds.p Running stage wise_forced Running stage wise_forced at 2020-08-05T21:02:50.718911 Cut to 1 unWISE tiles Reading WISE tile 0300m258 band 2 Reading WISE tile 0300m258 band 1 Reading WISE tile 0300m258 band 3 Reading WISE tile 0300m258 band 4 Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w4-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w4-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w4-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w4-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.14 s, CPU: 0.38 s, VmPeak: 1017 MB, VmSize: 1017 MB, VmRSS: 155 MB, VmData: 191 MB, maxrss: 0.198524 MB Does not exist: /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w3-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w3-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w3-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/allwise/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w3-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.11 s, CPU: 0.25 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 147 MB, VmData: 184 MB, maxrss: 0.208504 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w2-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w2-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w2-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w2-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.22 s, VmPeak: 1011 MB, VmSize: 1011 MB, VmRSS: 148 MB, VmData: 184 MB, maxrss: 0.208792 MB Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w1-img-m.fits Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w1-invvar-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w1-n-m.fits.gz Reading /global/cfs/cdirs/cosmo/data/unwise/neo6/unwise-coadds/fulldepth/030/0300m258/unwise-0300m258-w1-n-u.fits.gz Reading /usr/local/lib/python/wise/wise-psf-avg.fits unWISE forced photometry took Wall: 0.10 s, CPU: 0.22 s, VmPeak: 1020 MB, VmSize: 1020 MB, VmRSS: 159 MB, VmData: 193 MB, maxrss: 0.217368 MB Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-invvar-W1.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-invvar-W2.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-invvar-W3.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-image-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-model-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-invvar-W4.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/tmp-legacysurvey-custom-029388m25285-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-wise.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/tmp-legacysurvey-custom-029388m25285-wisemodel.jpg Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-wisemodel.jpg Setting WISE apphot Setting WISE apphot Setting WISE apphot Setting WISE apphot Stage wise_forced : Wall: 2.18 s, CPU: 0.64 s, VmPeak: 1046 MB, VmSize: 1036 MB, VmRSS: 249 MB, VmData: 272 MB, maxrss: 0.254512 MB Stage wise_forced finished: 2020-08-05T21:02:52.903903 Resources for stage wise_forced : 4.117 s worker CPU, 4.715 s worker Wall, Wall: 2.186 s, Cores in use: 2.18, Total efficiency (on 16 cores): 13.6 % Stage wise_forced finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-wise_forced.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-wise_forced.p Running stage writecat Running stage writecat at 2020-08-05T21:02:52.964299 Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/coadd/cus/custom-029388m25285/legacysurvey-custom-029388m25285-maskbits.fits.fz Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/tractor-i/cus/tractor-custom-029388m25285.fits Reading SFD maps... END Rejected (1), keyrecords following the END keyrecord were ignored. END Rejected (1), keyrecords following the END keyrecord were ignored. Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/tractor/cus/tractor-custom-029388m25285.fits Wrote /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/tractor/cus/brick-custom-029388m25285.sha256sum Stage writecat : Wall: 1.10 s, CPU: 0.83 s, VmPeak: 1169 MB, VmSize: 1041 MB, VmRSS: 250 MB, VmData: 272 MB, maxrss: 0.387392 MB Stage writecat finished: 2020-08-05T21:02:54.060399 Resources for stage writecat : 0.000 s worker CPU, 0.000 s worker Wall, Wall: 1.098 s, Cores in use: 0.76, Total efficiency (on 16 cores): 4.7 % Stage writecat finished Saving pickle /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-writecat.p Saved /global/cscratch1/sd/ioannis/SGA-data-dr9delta/029/PGC780659/PGC780659-largegalaxy-writecat.p All done: 100.681 s worker CPU, 836.317 s worker Wall, Wall: 159.292 s, Cores in use: 0.71, Total efficiency (on 16 cores): 4.4 % Finished galaxy PGC780659 in 2.684 minutes.