LLMs.txt

Publish a curated catalog that ChatGPT, Claude, Gemini, Perplexity, and similar tools can fetch from your storefront.


Overview#

llms.txt is a markdown file at the root of a site that tells AI systems what you sell and where to read more. AIReady generates that file from your BigCommerce catalog, hosts it on CDN, and (when Sites permission is available) adds storefront redirects so https://your-store.com/llms.txt works.

Two root files are always produced, plus extra catalog-index files for large stores:

  • /llms.txt — short summary: store voice, top collections, and pointers to the full file
  • /llms-full.txt — expanded catalog of products, collections, and pages
  • Partitioned indexes (for example under catalog/category-…/llms.txt) when the catalog is large

Why it is important#

Assistants do not shop your theme. They fetch a few well-known URLs and whatever they already crawled. Without llms.txt they guess from messy HTML — or they cite a competitor with a cleaner file.

  • Accurate product names, URLs, and collection structure for recommendations
  • A place to state your brand voice and what you want assistants to emphasize
  • An optional license line that tells crawlers whether training is allowed
  • Weekly or monthly republish so files do not go stale after catalog changes

Published files#

Files are written to the CDN and then exposed on your domain via BigCommerce storefront redirects:

  • https://your-store.com/llms.txt
  • https://your-store.com/llms-full.txt

Status in the app: Not created, Live (created), or Needs attention (failed). After a successful publish you will see catalog coverage, file sizes, and health. The root file is kept under a 250 KB cap; the full file under 2 MB. Oversized catalogs are split into category partitions.


Settings#

Every publish uses the settings below. Save keeps a draft; Publish regenerates files.

Setting What it does Options / default
Collections Include category structure so assistants can navigate the catalog On by default. Mode: All / Selected / All except selected
Products Include product names, URLs, and summaries On by default. Same three modes. Picker appears unless mode is All
Pages Include content pages (about, shipping, policies) On by default. Same three modes
Store description Optional intro copied near the top of the files Empty by default
Update frequency When files regenerate after the first publish Manual (default), Weekly, or Monthly
License type A short license line in the file telling AI crawlers what they may do See license list below
Selection modes
  • All — every visible record of that type
  • Selected — only the IDs you pick
  • All except selected — everything minus the IDs you pick
License types
  • Allow full commercial training — content may be displayed and used for commercial AI training
  • Allow display & non-commercial training — default. Display and non-commercial training only
  • Allow display, forbid training — display allowed; training forbidden
  • Forbid all AI use — all AI use of this content is forbidden

A license line is a request to crawlers. It is not a legal block.


Configure & publish#

  1. Open the LLMs.txt tab.
  2. Toggle Collections, Products, and Pages. Set All / Selected / All except as needed.
  3. Add an optional store description.
  4. Pick update frequency and license.
  5. Click Save if you want to keep a draft without generating files.
  6. Click Publish LLMs files (or Republish files).

Unsaved edits are included when you publish. After success, use the file links in the sidebar to open llms.txt and llms-full.txt on the storefront.

Manual frequency only updates when you republish. Weekly or Monthly regenerates automatically, and catalog edits can schedule a refresh (at most once every few minutes per store).


Verify on storefront#

After a successful publish, open:

  • https://your-store.com/llms.txt
  • https://your-store.com/llms-full.txt

You should see markdown that starts with your store name and description. If the URL 404s, the CDN file may exist but the storefront redirect was skipped. Open the CDN link shown in the app, or see Files not showing. If status is Failed, read the last error, fix the cause, and republish.