Method v1.0
How we review
Every review on RankShark is an automated evaluation: we fetch the product's public pages, measure what we can, and write the review from that evidence only. Each fact links to the page it came from, with the date we checked it.
What we do
- Fetch the home, pricing, docs, changelog, privacy, terms and security pages we can find from the home page, as RankSharkBot, respecting robots.txt.
- Read the public repository, package downloads (npm, PyPI) and model cards (Hugging Face) where they exist.
- Check the product's address every hour for 30 days: uptime and median response time.
- For MCP servers with a public endpoint: connect, and list the tools. We never call a tool, and we never run third-party code.
What we never claim
- We do not sign up, pay or use a product as a customer, so we never write “we used” or “hands-on”.
- Vendor claims are written as the vendor's: “The vendor says…”, “Vendor states SOC 2 Type II”. We never call a product secure, safe or compliant.
- Anything the pages do not say is shown as “Not stated”, with the date we looked — never filled in from memory.
- No hype words and no ratings of our own; the only ranking is the SharkScore.
Checks before anything is published
Every quote must appear word for word on the page it cites. Every number must appear in the evidence. Claims without a source are dropped. Some drawbacks are always added when true: no public prices, no free plan or trial stated, data use for training not stated, uptime below 99%, no release in 180 days.
A full review needs enough evidence: the home page, at least eight checked facts from at least three kinds of source, and at least two of our own measurements. Otherwise the listing shows only the facts we could check, stays out of search engines, and is tried again later.
Payment never touches a review
The part that writes the review never learns whether a vendor paid for fast-track or a sponsored slot. Fast-track changes only when the review runs. Vendors cannot edit, delay or remove a review; they can report an error with a public link, which re-runs it.
Freshness
Measured facts refresh daily with the score. Reviews are re-run every 60 days and keep a dated history of what changed. A review that has not been checked for 120 days is marked “May be out of date” and leaves search engines until it is re-run.