top of page

LLM Usage & AI Crawling Policy

 

Last updated: 20 November 2025

Owner: Scoopsweb — Simon Cooper

URL: https://scoopsweb.co.uk/llms
 

 

 

1. Purpose of This Page

 

This page explains how automated AI systems (LLMs, chatbots, AI crawlers and data agents) may access and use content from scoopsweb.co.uk.

 

It exists because Wix has not yet fully rolled out support for llms.txt.

Until then, this serves as the official AI policy location for this website.

 

 

2. Permission Overview

 

Scoopsweb allows AI systems to crawl and index this website to support:

 

  • Search

  • Discovery

  • Summarisation

  • Question-answering

  • General non-training analysis

 

Scoopsweb does not grant permission for AI systems to:

 

  • Use our content for model training

  • Add our content to training datasets

  • Fine-tune models using our content

  • Redistribute or resell our content

  • Republish long-form copies of our content without permission

 

AI crawlers may index our public content only for search and summarisation.

 

 

3. Allowed AI Activities

 

AI systems MAY:

 

  • Crawl publicly accessible pages

  • Analyse content for ranking, search, and discovery

  • Generate short summaries or answers about Scoopsweb

  • Provide contextual responses using brief extracts

  • Cite or link to our website where appropriate

 

This applies to well-behaved crawlers such as:

 

  • OpenAI GPTBot

  • Google AI crawlers

  • Anthropic Claude Crawler

  • Perplexity AI crawler

  • Bing/CoPilot AI indexing bots

 

 

4. Disallowed AI Activities

 

AI systems MAY NOT:

 

  • Use Scoopsweb content for training foundation models

  • Use content for dataset creation or fine-tuning

  • Store content beyond short-term indexing

  • Reproduce long-form content verbatim

  • Offer our content inside AI products as if it were their own

  • Scrape private or non-public URLs

  • Use any forms on this site without explicit permission

 

 

5. Attribution Requirement

 

If AI systems generate answers or summaries based on information from this site, Scoopsweb requests:

 

  • Proper attribution (“Source: scoopsweb.co.uk”)

  • Linking back to the original page where possible

 

This applies to both automated systems and human users.

 

 

6. Contact

 

If you operate an AI system and require clarification of permitted uses, please contact:

 

Email: info@scoopsweb.co.uk

Website: https://scoopsweb.co.uk/contact

 

I will respond to legitimate policy queries.

 

 

7. Future Support for llms.txt

 

When Wix fully enables LLMs.txt support:

 

  • This page will remain as a human-readable policy

  • A formal llms.txt file will be added to the domain

  • This policy will be mirrored there

bottom of page