diff options
| author | Tyler Murphy <tylermurphy534@gmail.com> | 2023-03-06 18:50:08 -0500 |
|---|---|---|
| committer | Tyler Murphy <tylermurphy534@gmail.com> | 2023-03-06 18:50:08 -0500 |
| commit | b1fb410affb7bcd2e714abac01d22c4a5332c344 (patch) | |
| tree | 7ebb621ab9b73e3e1fbaeb0ef8c19abef95b7c9f /public/robots.txt | |
| parent | finialize initial dns + caching (diff) | |
| download | wrapper-b1fb410affb7bcd2e714abac01d22c4a5332c344.tar.gz wrapper-b1fb410affb7bcd2e714abac01d22c4a5332c344.tar.bz2 wrapper-b1fb410affb7bcd2e714abac01d22c4a5332c344.zip | |
finish dns and start webserver
Diffstat (limited to 'public/robots.txt')
| -rw-r--r-- | public/robots.txt | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/public/robots.txt b/public/robots.txt new file mode 100644 index 0000000..b1b4ec3 --- /dev/null +++ b/public/robots.txt @@ -0,0 +1,9 @@ +User-agent: Googlebot +Disallow: /api + +User-agent: Googlebot +User-agent: AdsBot-Google +Disallow: /api + +User-agent: * +Disallow: /api
\ No newline at end of file |