Newsletter drafts · No. 15 / 20
What technical work deserves priority?
Last updated

Check actual access controls before buying speculative optimisation. OpenAI documents OAI-SearchBot and GPTBot as independent controls: a publisher can allow search access while declining crawling for model training. Its guidance also distinguishes search answers from navigational links. Allowing access should not be described as a guarantee of citation or recommendation. (developers.openai.com)
Ask your technical owner to inspect important product, integration, pricing and security pages, including relevant robots and infrastructure rules. Agree the desired search and training policy with the appropriate internal stakeholders.
For Google, use its official optimisation guidance to challenge proprietary ranking claims rather than accepting a supplier’s explanation as privileged access to the system. (developers.google.com)
Sources cited on this page
- developers.openai.com developers.openai.com/api/docs/bots?app=1
- developers.google.com developers.google.com/search/docs/fundamentals/ai-optimization-guide