Sitemap Loader: 413 Content Too Large

[kangfenmao]

🐛 Describe the bug

Sitemap URL: https://llm-tools.mintlify.app/sitemap.xml

chunks size too large

Sitemap URL: https://kangfenmao.com/sitemap.xml

This can work well

---

Is there a way to embed on each website once?

OpenAI.makeStatusError APIError: 413 status code (no body)

[kangfenmao]

new RAGApplicationBuilder()
      .setModel('NO_MODEL')
      .setEmbeddingModel(
        new OpenAiEmbeddings({
          model,
          apiKey,
          configuration: { baseURL },
          dimensions: 1024,
          batchSize: 10 // <------ Add this line
        })
      )
      .setVectorDatabase(new LibSqlDb({ path: path.join(this.storageDir, id) }))
      .build()

Fixed with change batchSize to 10