Add dynamic robots.txt generation and update sitemap handling

- Remove static robots.txt file.
- Implement dynamic robots.txt generator script (`generate_robots_txt.js`) to allow hostname flexibility.
- Update sitemap generation script to also use dynamic hostname from arguments.
- Modify Vite config to include automated generation of both sitemap and robots.txt during build.
- Add `public/robots.txt` to `.gitignore`.
This commit is contained in:
geoffsee
2025-05-28 22:04:28 -04:00
parent 82ba490dae
commit db5137e772
5 changed files with 56 additions and 10 deletions

1
.gitignore vendored
View File

@@ -3,6 +3,7 @@
**/.wrangler/
/.idea/
public/sitemap.xml
public/robots.txt
.dev.vars
secrets.json
wrangler.dev.jsonc