Security Considerations
If you're going to give app access to untrusted users, there's some security considerations that you'll need to be aware of given how the crawler works. The crawler is basically running a browser to fetch the content of the bookmarks. Any untrusted user can submit bookmarks to be crawled from your server and they'll be able to see the crawling result. This can be abused in multiple ways:
- Untrused users can submit crawl requests to websites that you don't want to be coming out of your IPs.
- Crawling user controlled websites can expose your origin IP (and location) even if your service is hosted behind cloudflare for example.
- The crawling requests will be coming out from your own network, which untrusted users can leverage to crawl internal non-internet exposed endpoints.
To mitigate those risks, you can do one of the following:
- Limit access to trusted users
- Let the browser traffic go through some VPN with restricted network policies.
- Host the browser container outside of your network.
- Use a hosted browser as a service (e.g. browserless). Note: I've never used them before.