| commit | ed7880c3aa7d1b8e1c618be00735398d76f0f507 | [log] [tgz] |
|---|---|---|
| author | Zack Williams <zdw@opennetworking.org> | Fri Oct 09 10:55:10 2020 -0700 |
| committer | Zack Williams <zdw@opennetworking.org> | Fri Oct 09 10:55:10 2020 -0700 |
| tree | fc04fb8fb62241b697635f3f376b9fccaaaad9e2 | |
| parent | b313baee16bd5606f793dea1b367f1ec07fbeefd [diff] [blame] |
Add user-agent blocking for dealing with webscrapers Change-Id: I9c26791a9f96bb2e87f0f427f7ff4adcb46a2b9e
diff --git a/defaults/main.yml b/defaults/main.yml index 70e2731..14ee763 100644 --- a/defaults/main.yml +++ b/defaults/main.yml
@@ -39,3 +39,6 @@ # authentication scope dict to create htpasswd files - see README.md auth_scopes: {} + +# block specific user agents (webscrapers) +blocked_user_agents: "DotBot|MJ12bot|SemrushBot|PetalBot|AhrefsBot"