AI crawler directory
What is Google-CloudVertexBot?
Last verified
Crawls that a site's owner has requested for building Vertex AI Agents on Google Cloud. Google says it has no effect on Google Search or other products.
Google-CloudVertexBot at a glance
- Operator
- Kind
- Crawler: fetches on its own schedule
- Used for
- Other
- Feeds
- Vertex AI Agents
- robots.txt token
Google-CloudVertexBot- User agent string
- Google publishes only the substring Google-CloudVertexBot, not a full user agent string.
- Follows robots.txt
- Yes. Google: common crawlers always obey robots.txt when crawling automatically.
- Runs JavaScript
- Not documented by the operator
- Published IP ranges
- common-crawlers.json: https://developers.google.com/static/crawling/ipranges/common-crawlers.jsonCheck an address against these ranges
- Official source
- List of Google's common crawlershttps://developers.google.com/crawling/docs/crawlers-fetchers/google-common-crawlers
- Verified
Every AI crawler in one table
Google-CloudVertexBot is one of 29 crawlers and fetchers in the AI crawler directory, each checked against its operator's own documentation.