File tree Expand file tree Collapse file tree 2 files changed +4
-2
lines changed Expand file tree Collapse file tree 2 files changed +4
-2
lines changed Original file line number Diff line number Diff line change @@ -32,6 +32,7 @@ Pkg.add(url="https://github.com/JuliaGenAI/DocsScraper.jl")
32
32
33
33
## Building the Index
34
34
``` julia
35
+ using DocsScraper
35
36
crawlable_urls = [" https://juliagenai.github.io/DocsScraper.jl/dev" ]
36
37
37
38
index_path = make_knowledge_packs (crawlable_urls;
@@ -120,4 +121,4 @@ index_name\
120
121
```
121
122
- Index\: contains the .hdf5 and .tar.gz files along with the artifact__info.txt. Artifact info contains sha256 and git-tree-sha1 hashes.
122
123
- Scraped_files\: contains the scraped chunks and sources. These are separated by the hostnames of the URLs.
123
- - URL_mapping.csv contains the scraped URLs mapping them with the estimated package name.
124
+ - URL_mapping.csv contains the scraped URLs mapping them with the estimated package name.
Original file line number Diff line number Diff line change @@ -30,6 +30,7 @@ Pkg.add(url="https://github.com/JuliaGenAI/DocsScraper.jl")
30
30
31
31
## Building the Index
32
32
``` julia
33
+ using DocsScraper
33
34
crawlable_urls = [" https://juliagenai.github.io/DocsScraper.jl/dev" ]
34
35
35
36
index_path = make_knowledge_packs (crawlable_urls;
@@ -117,4 +118,4 @@ index_name\
117
118
```
118
119
- Index\: contains the .hdf5 and .tar.gz files along with the artifact__info.txt. Artifact info contains sha256 and git-tree-sha1 hashes.
119
120
- Scraped_files\: contains the scraped chunks and sources. These are separated by the hostnames of the URLs.
120
- - URL_mapping.csv contains the scraped URLs mapping them with the estimated package name.
121
+ - URL_mapping.csv contains the scraped URLs mapping them with the estimated package name.
You can’t perform that action at this time.
0 commit comments