How to use built in RAG API to provide extensive info from a documentation?

[michnovka]

I would like to improve my agent when it comes to programming in specific frameworks. For example lets tak the PHP Symfony framework - their docs are at https://symfony.com/doc/current/index.html.

I wonder what is the best approach to get the vast knowledgebase that the docs are into my RAG? I have both openai token as well as local nomic-embedding running on ollama (even tho the GPU I have is not the best), so I can use either.

Shoul I just scrape the documentation into one .md file and upload that? Symfony has whole docs in github - https://github.com/symfony/symfony-docs/ - I can perhaps use that and make a script to create the huge md file. But is this the best approach?

And another question - will other users get access to this file? Or will it be "bound" only to my account?

Thanks!

If you have other ideas how to improve agents to work with documentation, please share.