geminispace.info

Unnamed repository; edit this file 'description' to name the repository.
git clone git://code.clttr.info/geminispace.info.git
Log | Files | Refs | README | LICENSE

commit d54e65a4cdea4f14390c395472da1ac498be28ea
parent 429b9d4de04bf8b95967cd7ad15ac46f2d751cbc
Author: Natalie Pendragon <natpen@natpen.net>
Date:   Sun, 15 Nov 2020 10:56:01 -0500

[crawl] Increase increment to temp error change frequency

The crawls seem to be spending too much time on these, and there seems
to be a steady stream of new ones that all look like a common word
followed by a common TLD. Each one of these causes a long-running,
ultimately failed DNS lookup, so it ends up taking a long time. This
change should help naturally filter them out of crawls more quickly.

Diffstat:
Mgus/lib/gemini.py | 2+-
1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/gus/lib/gemini.py b/gus/lib/gemini.py @@ -351,7 +351,7 @@ class GeminiResource: elif category == "redirect": return existing_change_frequency + 24 * 2 elif category == "temp_error": - return existing_change_frequency + 12 + return existing_change_frequency + 24 * 3 elif category == "perm_error": return existing_change_frequency + 24 * 30 elif category == "prompt":