Feeding docs to an LLM, step by step:0. Check /llms.txt and /llms-full.txt first1. One page: convert only the main conte...

Feeding docs to an LLM, step by step:0. Check /llms.txt and /llms-full.txt first1. One page: convert only the main content, with absolute links2. A whole section: script it, and demote headings in the HTML. A regex on the Markdown turned YAML comments into headings3. Add a table of contents4. Count tokens. The MkDocs user guide went from 59,773 (HTML) to 25,004 (Markdown)https://medium.com/@findutils/feed-docs-to-your-llm-as-clean-markdown-check-for-llms-txt-convert-add-a-toc-count-tokens-d42ff067cfe4#llm #markdown

Read Original

Related