Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

documentation views analytics for crate maintaners #472

Open
petr-tik opened this issue Nov 14, 2019 · 6 comments
Open

documentation views analytics for crate maintaners #472

petr-tik opened this issue Nov 14, 2019 · 6 comments
Labels
A-frontend Area: Web frontend P-low Low priority issues S-needs-design Status: There's a problem here, but no obvious solution; or the solution raises other questions

Comments

@petr-tik
Copy link

hey,
Thanks for building and maintaining such a great documentation resource. I am one of the contributors to tantivy - a library for building custom search applications.

I was wondering if you collect and would be able to share (privately, if you prefer) analytics for views of specific pages on docs.rs/tantivy.

Since we are building a library, not an application, our main method of helping our users is through examples, good code and documentation.

There are many types, traits and enums in our library and we would like to prioritise our effort to document them (ideally we would like to document all of them, but it's hard).

I think it will be useful to see the top 50 most visited pages on docs.rs/tantivy so we can spend time documenting the most sought-after items.

I appreciate the privacy concerns (entirely valid) and would only request anonymised, aggregated data for only docs.rs/tantivy.

Thanks again for all your great work on this!
@petr-tik petr-tik changed the title view analytics for crate maintaners documentation views analytics for crate maintaners Nov 14, 2019
@pietroalbini
Copy link
Member

Thanks for reaching out! At the moment we don't collect access logs for documentation views, so we're unable to provide you with the data. Anonymized access stats for crate authors would be good to have though, so that's something we could consider in the future.

@petr-tik
Copy link
Author

Hey, thanks for your swift reply - appreciate you are busy with normal maintenance.

Glad to hear this is useful and I think many other library developers will appreciate such analytics.

What's the best way for me to start a conversation about this and get more opinions/thoughts/suggestions from other library developers?

I feel that an RFC is too heavy duty for this, so keen to hear your advice on the best format.

I'm curious - does your web server not have any logging of GET requests that we could grep "tantivy" over to get a tough idea?

@jyn514
Copy link
Member

jyn514 commented Feb 12, 2020

I'm looking over this now, and it seems we do have some logs in /var/log/nginx we could grep for. Note that these logs are not accurate because we cache using cloudfront, but they might be enough for a rough estimate.

I think @pietroalbini might have meant that we don't track accesses in the application, so this only happens to work in production, and won't be reproducible anywhere else (e.g. if we wanted to show it on the website).

With that said, here are the logs of pages with more than one visit (showing only the URLs without metadata):

logs 
      2 GET /tantivy/%5E0.10
      2 GET /tantivy/%5E0.11.3
      2 GET /tantivy/0.10.0/aliases-20190624-1.37.0-nightly-8aa42ed7c.js
      2 GET /tantivy/0.10.0/search-index-20190624-1.37.0-nightly-8aa42ed7c.js
      2 GET /tantivy/0.10.0/tantivy/merge_policy/struct.NoMergePolicy.html
      2 GET /tantivy/0.10.0/tantivy/schema/struct.NamedFieldDocument.html
      2 GET /tantivy/0.10.0/tantivy/schema/struct.Schema.html
      2 GET /tantivy/0.10.0/tantivy/struct.Document.html
      2 GET /tantivy/0.10.1/search-index-20190720-1.38.0-nightly-95b1fe560.js
      2 GET /tantivy/0.10.1/tantivy/collector/index.html
      2 GET /tantivy/0.10.1/tantivy/postings/index.html
      2 GET /tantivy/0.10.1/tantivy/query/struct.AllScorer.html
      2 GET /tantivy/0.10.1/tantivy/query/struct.FuzzyTermQuery.html
      2 GET /tantivy/0.10.1/tantivy/query/struct.QueryParser.html
      2 GET /tantivy/0.10.1/tantivy/query/trait.Query.html
      2 GET /tantivy/0.10.1/tantivy/schema/index.html
      2 GET /tantivy/0.10.1/tantivy/struct.Document.html
      2 GET /tantivy/0.10.1/tantivy/struct.Index.html
      2 GET /tantivy/0.10.1/tantivy/struct.IndexMeta.html
      2 GET /tantivy/0.10.1/tantivy/struct.IndexReaderBuilder.html
      2 GET /tantivy/0.10.1/tantivy/tokenizer/index.html
      2 GET /tantivy/0.10.2/i686-pc-windows-msvc/tantivy/
      2 GET /tantivy/0.10.2/implementors/tantivy/query/trait.Query.js
      2 GET /tantivy/0.10.2/src/tantivy/fieldnorm/code.rs.html
      2 GET /tantivy/0.10.2/struct.Term.html
      2 GET /tantivy/0.10.2/tantivy/collector/index.html
      2 GET /tantivy/0.10.2/tantivy/collector/sidebar-items.js
      2 GET /tantivy/0.10.2/tantivy/collector/struct.Count.html
      2 GET /tantivy/0.10.2/tantivy/directory/error/enum.LockError.html
      2 GET /tantivy/0.10.2/tantivy/directory/struct.ReadOnlySource.html
      2 GET /tantivy/0.10.2/tantivy/fastfield/sidebar-items.js
      2 GET /tantivy/0.10.2/tantivy/index.html
      2 GET /tantivy/0.10.2/tantivy/query/struct.AllQuery.html
      2 GET /tantivy/0.10.2/tantivy/query/trait.Query.html
      2 GET /tantivy/0.10.2/tantivy/schema/constant.FAST.html
      2 GET /tantivy/0.10.2/tantivy/tokenizer/sidebar-items.js
      2 GET /tantivy/0.10.2/tantivy/type.Opstamp.html
      2 GET /tantivy/0.10.2/x86_64-unknown-linux-gnu/tantivy/
      2 GET /tantivy/0.10.3/implementors/tantivy/query/trait.Query.js
      2 GET /tantivy/0.10.3/src/tantivy/lib.rs.html
      2 GET /tantivy/0.10.3/tantivy/collector/index.html
      2 GET /tantivy/0.10.3/tantivy/enum.ReloadPolicy.html
      2 GET /tantivy/0.10.3/tantivy/enum.SegmentComponent.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.AllScorer.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.EmptyScorer.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.EmptyWeight.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.PhraseQuery.html
      2 GET /tantivy/0.10.3/tantivy/query/struct.TermQuery.html
      2 GET /tantivy/0.10.3/tantivy/query/trait.Query.html
      2 GET /tantivy/0.10.3/tantivy/query/trait.Scorer.html
      2 GET /tantivy/0.10.3/tantivy/schema/struct.Field.html
      2 GET /tantivy/0.10.3/tantivy/struct.DocAddress.html
      2 GET /tantivy/0.10.3/tantivy/struct.IndexReader.html
      2 GET /tantivy/0.10.3/tantivy/struct.IndexReaderBuilder.html
      2 GET /tantivy/0.10.3/tantivy/struct.SegmentMeta.html
      2 GET /tantivy/0.10.3/tantivy/struct.SegmentReader.html
      2 GET /tantivy/0.10.3/tantivy/struct.Term.html
      2 GET /tantivy/0.10.3/tantivy/trait.Directory.html
      2 GET /tantivy/0.10.3/tantivy/trait.DocSet.html
      2 GET /tantivy/0.10.3/tantivy/type.Opstamp.html
      2 GET /tantivy/0.10.3/tantivy/type.Score.html
      2 GET /tantivy/0.10.3/tantivy/type.SegmentLocalId.html
      2 GET /tantivy/0.11.3
      2 GET /tantivy/0.11.3/i686-apple-darwin/tantivy/?search=RegexQuery
      2 GET /tantivy/0.11.3/i686-pc-windows-msvc/tantivy/
      2 GET /tantivy/0.11.3/implementors/tantivy/merge_policy/trait.MergePolicy.js
      2 GET /tantivy/0.11.3/implementors/tantivy/postings/trait.HasLen.js
      2 GET /tantivy/0.11.3/implementors/tantivy/trait.Postings.js
      2 GET /tantivy/0.11.3/src/tantivy/collector/mod.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/common/mod.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/core/index_meta.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/directory/directory.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/indexer/merge_policy.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/lib.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/macros.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/query/query_parser/query_parser.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/query/term_query/term_query.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/schema/schema.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/schema/text_options.rs.html
      2 GET /tantivy/0.11.3/src/tantivy/tokenizer/ascii_folding_filter.rs.html
      2 GET /tantivy/0.11.3/struct.Term.html
      2 GET /tantivy/0.11.3/tantivy/collector/trait.SegmentCollector.html
      2 GET /tantivy/0.11.3/tantivy/directory/
      2 GET /tantivy/0.11.3/tantivy/directory/error/enum.OpenDirectoryError.html
      2 GET /tantivy/0.11.3/tantivy/directory/struct.AntiCallToken.html
      2 GET /tantivy/0.11.3/tantivy/enum.SegmentComponent.html
      2 GET /tantivy/0.11.3/tantivy/enum.TantivyError.html
      2 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldSerializer.html
      2 GET /tantivy/0.11.3/tantivy/fastfield/struct.IntFastFieldWriter.html
      2 GET /tantivy/0.11.3/tantivy/fn.u64_to_f64.html
      2 GET /tantivy/0.11.3/tantivy/merge_policy/sidebar-items.js
      2 GET /tantivy/0.11.3/tantivy/merge_policy/type.DefaultMergePolicy.html
      2 GET /tantivy/0.11.3/tantivy/postings/struct.FieldSerializer.html
      2 GET /tantivy/0.11.3/tantivy/query/fn.intersect_scorers.html
      2 GET /tantivy/0.11.3/tantivy/query/struct.ConstScorer.html
      2 GET /tantivy/0.11.3/tantivy/query/struct.Union.html
      2 GET /tantivy/0.11.3/tantivy/schema/constant.STRING.html
      2 GET /tantivy/0.11.3/tantivy/schema/enum.FieldType.html
      2 GET /tantivy/0.11.3/tantivy/schema/enum.Type.html
      2 GET /tantivy/0.11.3/tantivy/schema/enum.Value.html
      2 GET /tantivy/0.11.3/tantivy/schema/struct.FieldEntry.html
      2 GET /tantivy/0.11.3/tantivy/schema/struct.NamedFieldDocument.html
      2 GET /tantivy/0.11.3/tantivy/store/constant.COMPRESSION.html
      2 GET /tantivy/0.11.3/tantivy/store/sidebar-items.js
      2 GET /tantivy/0.11.3/tantivy/struct.IndexWriter.html?search=postings
      2 GET /tantivy/0.11.3/tantivy/struct.Version.html
      2 GET /tantivy/0.11.3/tantivy/termdict/sidebar-items.js
      2 GET /tantivy/0.11.3/tantivy/termdict/struct.TermDictionaryBuilder.html
      2 GET /tantivy/0.11.3/tantivy/termdict/struct.TermStreamer.html
      2 GET /tantivy/0.11.3/tantivy/tokenizer/struct.RemoveLongFilter.html
      2 GET /tantivy/0.11.3/x86_64-pc-windows-msvc/aliases-20191219-1.42.0-nightly-0de96d37f.js
      2 GET /tantivy/0.11.3/x86_64-pc-windows-msvc/search-index-20191219-1.42.0-nightly-0de96d37f.js
      2 GET /tantivy/0.2.0/tantivy/collector/trait.Collector.html
      2 GET /tantivy/0.2.0/tantivy/schema/index.html
      2 GET /tantivy/0.2.0/tantivy/sidebar-items.js
      2 GET /tantivy/0.3.1/search-index.js
      2 GET /tantivy/0.4.2/search-index.js
      2 GET /tantivy/0.4.3/src/tantivy/schema/schema.rs.html
      2 GET /tantivy/0.4.3/tantivy/
      2 GET /tantivy/0.4.3/tantivy/postings/
      2 GET /tantivy/0.4.3/tantivy/postings/index.html
      2 GET /tantivy/0.4.3/tantivy/postings/trait.Postings.html
      2 GET /tantivy/0.4.3/tantivy/schema/sidebar-items.js
      2 GET /tantivy/0.4.3/tantivy/schema/struct.IntOptions.html
      2 GET /tantivy/0.4.3/tantivy/sidebar-items.js
      2 GET /tantivy/0.4.3/tantivy/struct.DocAddress.html
      2 GET /tantivy/0.4.3/tantivy/struct.IndexWriter.html
      2 GET /tantivy/0.5.0/search-index.js
      2 GET /tantivy/0.5.1/x86_64-apple-darwin/search-index.js
      2 GET /tantivy/0.6.0/implementors/tantivy/query/trait.Scorer.js
      2 GET /tantivy/0.6.0/settings.html
      2 GET /tantivy/0.6.0/tantivy/fieldnorm/index.html
      2 GET /tantivy/0.6.0/tantivy/query/sidebar-items.js
      2 GET /tantivy/0.6.0/tantivy/query/trait.Scorer.html
      2 GET /tantivy/0.6.0/tantivy/tokenizer/sidebar-items.js
      2 GET /tantivy/0.7.0/i686-apple-darwin/tantivy/schema/sidebar-items.js
      2 GET /tantivy/0.7.0/i686-pc-windows-msvc/aliases.js
      2 GET /tantivy/0.7.0/i686-pc-windows-msvc/search-index.js
      2 GET /tantivy/0.7.0/src/tantivy/tokenizer/stop_word_filter.rs.html
      2 GET /tantivy/0.7.0/tantivy/query/sidebar-items.js
      2 GET /tantivy/0.7.0/tantivy/schema/enum.Value.html
      2 GET /tantivy/0.7.0/tantivy/schema/sidebar-items.js
      2 GET /tantivy/0.7.1/i686-apple-darwin/tantivy/fastfield/sidebar-items.js
      2 GET /tantivy/0.7.1/tantivy/
      2 GET /tantivy/0.8.0/source-files.js
      2 GET /tantivy/0.8.0/source-script-20181217-1.33.0-nightly-adbfec229.js
      2 GET /tantivy/0.8.0/src/tantivy/fastfield/multivalued/writer.rs.html
      2 GET /tantivy/0.8.0/tantivy/
      2 GET /tantivy/0.8.0/tantivy/sidebar-items.js
      2 GET /tantivy/0.8.1/tantivy/
      2 GET /tantivy/0.8.1/tantivy/schema/enum.Value.html
      2 GET /tantivy/0.8.1/tantivy/struct.Document.html
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/aliases.js
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/search-index.js
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/tantivy/query/enum.QueryParserError.html
      2 GET /tantivy/0.8.1/x86_64-apple-darwin/tantivy/query/sidebar-items.js
      2 GET /tantivy/0.9.0/tantivy/
      2 GET /tantivy/0.9.1/tantivy/collector/sidebar-items.js
      3 GET /tantivy/%5E0.11
      3 GET /tantivy/0.10.0/tantivy/schema/enum.Value.html
      3 GET /tantivy/0.10.0/tantivy/struct.Searcher.html
      3 GET /tantivy/0.10.2/tantivy/collector/trait.Collector.html
      3 GET /tantivy/0.10.2/tantivy/directory/index.html
      3 GET /tantivy/0.10.2/tantivy/query/struct.BooleanQuery.html
      3 GET /tantivy/0.10.2/tantivy/schema/index.html
      3 GET /tantivy/0.10.2/tantivy/schema/sidebar-items.js
      3 GET /tantivy/0.10.2/tantivy/struct.IndexWriter.html
      3 GET /tantivy/0.10.3/tantivy/enum.SkipResult.html
      3 GET /tantivy/0.10.3/tantivy/query/struct.EmptyQuery.html
      3 GET /tantivy/0.10.3/tantivy/query/struct.Exclude.html
      3 GET /tantivy/0.10.3/tantivy/struct.Segment.html
      3 GET /tantivy/0.11.0/tantivy/
      3 GET /tantivy/0.11.2/tantivy/
      3 GET /tantivy/0.11.3/implementors/tantivy/tokenizer/trait.TokenStream.js
      3 GET /tantivy/0.11.3/implementors/tantivy/trait.DocSet.js
      3 GET /tantivy/0.11.3/postings/struct.TermInfo.html
      3 GET /tantivy/0.11.3/src/tantivy/fastfield/mod.rs.html
      3 GET /tantivy/0.11.3/src/tantivy/indexer/log_merge_policy.rs.html
      3 GET /tantivy/0.11.3/src/tantivy/postings/postings.rs.html
      3 GET /tantivy/0.11.3/src/tantivy/tokenizer/alphanum_only.rs.html
      3 GET /tantivy/0.11.3/tantivy/directory/struct.RAMDirectory.html
      3 GET /tantivy/0.11.3/tantivy/enum.Error.html
      3 GET /tantivy/0.11.3/tantivy/fastfield/sidebar-items.js
      3 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldReaders.html
      3 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldsWriter.html
      3 GET /tantivy/0.11.3/tantivy/fn.i64_to_u64.html
      3 GET /tantivy/0.11.3/tantivy/fn.u64_to_i64.html
      3 GET /tantivy/0.11.3/tantivy/fn.version.html
      3 GET /tantivy/0.11.3/tantivy/fn.version_string.html
      3 GET /tantivy/0.11.3/tantivy/postings/struct.TermInfo.html
      3 GET /tantivy/0.11.3/tantivy/query/struct.RequiredOptionalScorer.html
      3 GET /tantivy/0.11.3/tantivy/store/struct.StoreReader.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.AsciiFoldingFilter.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.PreTokenizedString.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.SimpleTokenizer.html
      3 GET /tantivy/0.11.3/tantivy/tokenizer/struct.Token.html
      3 GET /tantivy/0.11.3/tantivy/trait.Directory.html
      3 GET /tantivy/0.11.3/tantivy/type.SegmentLocalId.html
      3 GET /tantivy/0.2.0/tantivy/struct.SegmentReader.html
      3 GET /tantivy/0.3.1/tantivy/
      3 GET /tantivy/0.4.3/tantivy/schema/
      3 GET /tantivy/0.4.4/tantivy/
      3 GET /tantivy/0.5.0/tantivy/
      3 GET /tantivy/0.7.0/i686-apple-darwin/tantivy/query/sidebar-items.js
      3 GET /tantivy/0.7.0/i686-apple-darwin/tantivy/query/struct.RegexQuery.html
      3 GET /tantivy/0.7.0/tantivy/
      3 GET /tantivy/0.7.0/tantivy/query/struct.FuzzyTermQuery.html
      3 GET /tantivy/0.7.0/tantivy/query/struct.QueryParser.html
      3 GET /tantivy/0.7.0/tantivy/sidebar-items.js
      3 GET /tantivy/0.7.2/light-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.7.2/rustdoc-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.7.2/settings.html
      3 GET /tantivy/0.7.2/storage-20181217-1.33.0-nightly-adbfec229.js
      3 GET /tantivy/0.8.0/brush-20181217-1.33.0-nightly-adbfec229.svg
      3 GET /tantivy/0.8.0/dark-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/down-arrow-20181217-1.33.0-nightly-adbfec229.svg
      3 GET /tantivy/0.8.0/light-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/normalize-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/rustdoc-20181217-1.33.0-nightly-adbfec229.css
      3 GET /tantivy/0.8.0/storage-20181217-1.33.0-nightly-adbfec229.js
      3 GET /tantivy/0.8.0/tantivy/collector/index.html
      3 GET /tantivy/0.8.0/wheel-20181217-1.33.0-nightly-adbfec229.svg
      3 GET /tantivy/0.9.0/aliases.js
      3 GET /tantivy/0.9.0/search-index.js
      3 GET /tantivy/0.9.1/tantivy/query/index.html
      3 GET /tantivy/0.9.1/tantivy/sidebar-items.js
      4 GET /tantivy/%5E0.9
      4 GET /tantivy/0.1.1/tantivy/
      4 GET /tantivy/0.10.2/source-files-20190923-1.39.0-nightly-66bf391c3.js
      4 GET /tantivy/0.10.3/source-files-20191109-1.40.0-nightly-ac162c6ab.js
      4 GET /tantivy/0.10.3/src/tantivy/collector/mod.rs.html
      4 GET /tantivy/0.10.3/tantivy/query/sidebar-items.js
      4 GET /tantivy/0.10.3/tantivy/query/struct.Explanation.html
      4 GET /tantivy/0.10.3/tantivy/query/struct.QueryParser.html
      4 GET /tantivy/0.10.3/tantivy/struct.IndexMeta.html
      4 GET /tantivy/0.11.3/implementors/tantivy/collector/trait.Fruit.js
      4 GET /tantivy/0.11.3/implementors/tantivy/query/trait.Weight.js
      4 GET /tantivy/0.11.3/implementors/tantivy/tokenizer/trait.Tokenizer.js
      4 GET /tantivy/0.11.3/src/tantivy/core/searcher.rs.html
      4 GET /tantivy/0.11.3/src/tantivy/query/boolean_query/boolean_query.rs.html
      4 GET /tantivy/0.11.3/tantivy/collector/struct.FacetCollector.html
      4 GET /tantivy/0.11.3/tantivy/directory/struct.ManagedDirectory.html
      4 GET /tantivy/0.11.3/tantivy/fastfield/struct.MultiValueIntFastFieldReader.html
      4 GET /tantivy/0.11.3/tantivy/fastfield/trait.FastValue.html
      4 GET /tantivy/0.11.3/tantivy/merge_policy/
      4 GET /tantivy/0.11.3/tantivy/postings/trait.HasLen.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.AllQuery.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.AutomatonWeight.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.Explanation.html
      4 GET /tantivy/0.11.3/tantivy/query/struct.RangeQuery.html
      4 GET /tantivy/0.11.3/tantivy/schema/constant.INDEXED.html
      4 GET /tantivy/0.11.3/tantivy/struct.SegmentId.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/enum.Language.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/struct.AlphaNumOnlyFilter.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/struct.BoxedTokenizer.html
      4 GET /tantivy/0.11.3/tantivy/tokenizer/struct.Stemmer.html
      4 GET /tantivy/0.11.3/tantivy/trait.Postings.html
      4 GET /tantivy/0.11.3/x86_64-pc-windows-msvc/tantivy/
      4 GET /tantivy/0.4.2/tantivy/
      4 GET /tantivy/0.4.3/tantivy/schema/struct.Schema.html
      4 GET /tantivy/0.6.0/tantivy/tokenizer/struct.NgramTokenizer.html
      4 GET /tantivy/0.7.0/i686-apple-darwin/search-index.js
      4 GET /tantivy/0.7.2/brush-20181217-1.33.0-nightly-adbfec229.svg
      4 GET /tantivy/0.7.2/dark-20181217-1.33.0-nightly-adbfec229.css
      4 GET /tantivy/0.7.2/down-arrow-20181217-1.33.0-nightly-adbfec229.svg
      4 GET /tantivy/0.7.2/normalize-20181217-1.33.0-nightly-adbfec229.css
      4 GET /tantivy/0.7.2/tantivy/sidebar-items.js
      4 GET /tantivy/0.7.2/wheel-20181217-1.33.0-nightly-adbfec229.svg
      4 GET /tantivy/0.8.0/aliases.js
      4 GET /tantivy/0.8.0/main-20181217-1.33.0-nightly-adbfec229.js
      4 GET /tantivy/0.8.0/search-index.js
      4 GET /tantivy/0.8.0/theme-20181217-1.33.0-nightly-adbfec229.js
      4 GET /tantivy/0.9.1/tantivy/query/struct.QueryParser.html
      5 GET /tantivy/0.10.2/implementors/tantivy/trait.DocSet.js
      5 GET /tantivy/0.11.3/src/tantivy/postings/segment_postings.rs.html
      5 GET /tantivy/0.11.3/tantivy/all.html
      5 GET /tantivy/0.11.3/tantivy/enum.ReloadPolicy.html
      5 GET /tantivy/0.11.3/tantivy/fn.f64_to_u64.html
      5 GET /tantivy/0.11.3/tantivy/merge_policy/struct.LogMergePolicy.html
      5 GET /tantivy/0.11.3/tantivy/postings/sidebar-items.js
      5 GET /tantivy/0.11.3/tantivy/postings/struct.BlockSegmentPostings.html
      5 GET /tantivy/0.11.3/tantivy/schema/constant.STORED.html
      5 GET /tantivy/0.11.3/tantivy/schema/constant.TEXT.html
      5 GET /tantivy/0.11.3/tantivy/struct.LeasedItem.html
      5 GET /tantivy/0.11.3/tantivy/struct.SegmentMeta.html
      5 GET /tantivy/0.11.3/tantivy/tokenizer/sidebar-items.js
      5 GET /tantivy/0.11.3/tantivy/tokenizer/struct.NgramTokenizer.html
      5 GET /tantivy/0.11.3/tantivy/tokenizer/struct.StopWordFilter.html
      5 GET /tantivy/0.11.3/tantivy/trait.DocSet.html
      5 GET /tantivy/0.11.3/tantivy/type.DateTime.html
      5 GET /tantivy/0.4.3/search-index.js
      5 GET /tantivy/0.4.3/tantivy/schema/struct.SchemaBuilder.html
      5 GET /tantivy/0.7.0/i686-apple-darwin/aliases.js
      5 GET /tantivy/0.7.2/aliases.js
      5 GET /tantivy/0.7.2/main-20181217-1.33.0-nightly-adbfec229.js
      5 GET /tantivy/0.7.2/search-index.js
      5 GET /tantivy/0.7.2/theme-20181217-1.33.0-nightly-adbfec229.js
      5 GET /tantivy/0.8.1/tantivy/sidebar-items.js
      6 GET /tantivy/0.10.0/tantivy/
      6 GET /tantivy/0.10.1/tantivy/
      6 GET /tantivy/0.10.2/tantivy/query/sidebar-items.js
      6 GET /tantivy/0.11.3/implementors/tantivy/collector/trait.Collector.js
      6 GET /tantivy/0.11.3/tantivy/collector/trait.Fruit.html
      6 GET /tantivy/0.11.3/tantivy/fieldnorm/index.html
      6 GET /tantivy/0.11.3/tantivy/macro.doc.html
      6 GET /tantivy/0.11.3/tantivy/merge_policy/index.html
      6 GET /tantivy/0.11.3/tantivy/schema/struct.Document.html
      6 GET /tantivy/0.11.3/tantivy/schema/struct.Facet.html
      6 GET /tantivy/0.11.3/tantivy/struct.IndexReaderBuilder.html
      6 GET /tantivy/0.11.3/tantivy/struct.InvertedIndexReader.html
      6 GET /tantivy/0.11.3/tantivy/termdict/struct.TermDictionary.html
      6 GET /tantivy/0.11.3/tantivy/tokenizer/
      6 GET /tantivy/0.11.3/tantivy/tokenizer/struct.TokenizerManager.html
      6 GET /tantivy/0.11.3/tantivy/tokenizer/trait.TokenStream.html
      6 GET /tantivy/0.11.3/tantivy/type.Opstamp.html
      6 GET /tantivy/0.6.0/aliases.js
      6 GET /tantivy/0.6.0/search-index.js
      6 GET /tantivy/0.9.1/search-index.js
      7 GET /tantivy/0.10.2/tantivy/trait.DocSet.html
      7 GET /tantivy/0.11.3/implementors/tantivy/directory/trait.Directory.js
      7 GET /tantivy/0.11.3/implementors/tantivy/query/trait.Query.js
      7 GET /tantivy/0.11.3/src/tantivy/core/index.rs.html
      7 GET /tantivy/0.11.3/tantivy/fastfield/struct.FastFieldReader.html
      7 GET /tantivy/0.11.3/tantivy/postings/
      7 GET /tantivy/0.11.3/tantivy/postings/trait.Postings.html
      7 GET /tantivy/0.11.3/tantivy/schema/struct.IntOptions.html
      7 GET /tantivy/0.11.3/tantivy/type.Score.html
      7 GET /tantivy/0.2.0/search-index.js
      7 GET /tantivy/0.8.1/aliases.js
      7 GET /tantivy/0.8.1/search-index.js
      7 GET /tantivy/0.8.1/tantivy/struct.Index.html
      7 GET /tantivy/0.9.1/aliases.js
      7 GET /tantivy/0.9.1/tantivy/
      8 GET /tantivy/0.10.3/aliases-20191109-1.40.0-nightly-ac162c6ab.js
      8 GET /tantivy/0.11.3/tantivy/directory/sidebar-items.js
      8 GET /tantivy/0.11.3/tantivy/postings/struct.SegmentPostings.html
      8 GET /tantivy/0.11.3/tantivy/query/trait.Weight.html
      8 GET /tantivy/0.11.3/tantivy/schema/constant.FAST.html
      8 GET /tantivy/0.11.3/tantivy/schema/struct.Field.html
      8 GET /tantivy/0.11.3/tantivy/space_usage/index.html
      8 GET /tantivy/0.11.3/tantivy/struct.Snippet.html
      8 GET /tantivy/0.11.3/tantivy/struct.SnippetGenerator.html
      8 GET /tantivy/0.11.3/tantivy/termdict/index.html
      8 GET /tantivy/0.11.3/tantivy/tokenizer/trait.Tokenizer.html
      8 GET /tantivy/0.11.3/tantivy/type.Result.html
      8 GET /tantivy/0.7.0/aliases.js
      8 GET /tantivy/0.7.0/tantivy/query/index.html
      9 GET /tantivy/0.10.3/search-index-20191109-1.40.0-nightly-ac162c6ab.js
      9 GET /tantivy/0.10.3/tantivy/sidebar-items.js
      9 GET /tantivy/0.11.3/tantivy/collector/sidebar-items.js
      9 GET /tantivy/0.11.3/tantivy/merge_policy/trait.MergePolicy.html
      9 GET /tantivy/0.11.3/tantivy/postings/index.html
      9 GET /tantivy/0.11.3/tantivy/struct.Segment.html
      9 GET /tantivy/0.11.3/tantivy/struct.Term.html
      9 GET /tantivy/0.7.0/search-index.js
     10 GET /tantivy/0.10.2/tantivy/
     10 GET /tantivy/0.11.3/tantivy/query/struct.PhraseQuery.html
     10 GET /tantivy/0.11.3/tantivy/schema/enum.IndexRecordOption.html
     10 GET /tantivy/0.11.3/tantivy/schema/sidebar-items.js
     10 GET /tantivy/0.11.3/tantivy/store/index.html
     10 GET /tantivy/0.11.3/tantivy/type.DocId.html
     11 GET /tantivy/0.10.2/tantivy/sidebar-items.js
     11 GET /tantivy/0.10.3/tantivy/
     11 GET /tantivy/0.11.3/tantivy/collector/struct.TopDocs.html
     11 GET /tantivy/0.11.3/tantivy/collector/trait.Collector.html
     11 GET /tantivy/0.11.3/tantivy/query/sidebar-items.js
     11 GET /tantivy/0.11.3/tantivy/query/struct.BooleanQuery.html
     11 GET /tantivy/0.11.3/tantivy/schema/
     11 GET /tantivy/0.2.0/tantivy/
     12 GET /tantivy/0.11.3/source-files-20191219-1.42.0-nightly-0de96d37f.js
     12 GET /tantivy/0.11.3/tantivy/directory/index.html
     12 GET /tantivy/0.11.3/tantivy/directory/struct.MmapDirectory.html
     12 GET /tantivy/0.11.3/tantivy/schema/struct.TextFieldIndexing.html
     12 GET /tantivy/0.11.3/tantivy/struct.DocAddress.html
     12 GET /tantivy/0.11.3/tantivy/struct.IndexMeta.html
     12 GET /tantivy/0.11.3/tantivy/struct.SegmentReader.html
     13 GET /tantivy/0.11.3/tantivy/fastfield/index.html
     13 GET /tantivy/0.11.3/tantivy/query/struct.FuzzyTermQuery.html
     13 GET /tantivy/0.11.3/tantivy/query/trait.Query.html
     13 GET /tantivy/0.11.3/tantivy/struct.Document.html
     14 GET /tantivy/0.10.2/aliases-20190923-1.39.0-nightly-66bf391c3.js
     14 GET /tantivy/0.10.2/search-index-20190923-1.39.0-nightly-66bf391c3.js
     14 GET /tantivy/0.11.3/tantivy/query/struct.RegexQuery.html
     14 GET /tantivy/0.11.3/tantivy/query/struct.TermQuery.html
     14 GET /tantivy/0.11.3/tantivy/schema/struct.TextOptions.html
     15 GET /tantivy/0.11.3/tantivy/directory/trait.Directory.html
     15 GET /tantivy/0.11.3/tantivy/schema/struct.Schema.html
     15 GET /tantivy/0.11.3/tantivy/struct.IndexReader.html
     17 GET /tantivy/0.11.3/tantivy/collector/index.html
     19 GET /tantivy/0.11.3/tantivy/schema/struct.SchemaBuilder.html
     20 GET /tantivy/0.11.3/search-index-20191219-1.42.0-nightly-0de96d37f.js
     20 GET /tantivy/0.11.3/tantivy/sidebar-items.js
     21 GET /tantivy/0.11.3/aliases-20191219-1.42.0-nightly-0de96d37f.js
     21 GET /tantivy/0.11.3/tantivy/query/struct.QueryParser.html
     25 GET /tantivy/0.11.3/tantivy/tokenizer/index.html
     27 GET /tantivy/0.11.3/tantivy/struct.IndexWriter.html
     32 GET /tantivy/0.11.3/tantivy/struct.Searcher.html
     43 GET /tantivy/0.11.3/tantivy/query/index.html
     43 GET /tantivy/0.11.3/tantivy/struct.Index.html
     48 GET /tantivy/0.11.3/tantivy/schema/index.html
     65 GET /tantivy/0.11.3/tantivy/index.html
     96 GET /tantivy/
    194 GET /tantivy/0.11.3/tantivy/

@petr-tik
Copy link
Author

Hey @jyn514 - thanks for providing this.

Should be helpful in tackling most important/least documented pages.

Is there any scope to extend this log summaries in the future, so maintainers can keep improving documentation using this information?

@jyn514
Copy link
Member

jyn514 commented Feb 20, 2020

It would be a fairly large time and storage investment (where would we store the logs?). I would be willing to take a PR adding this, but I don't plan to add it myself any time soon.

@jyn514 jyn514 added A-frontend Area: Web frontend P-low Low priority issues S-needs-design Status: There's a problem here, but no obvious solution; or the solution raises other questions labels Jul 6, 2020
@syphar
Copy link
Member

syphar commented Oct 21, 2024

Small update here:

since we cache in the CDN now, this tracking would either have to be JS, or based on the CDN logs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-frontend Area: Web frontend P-low Low priority issues S-needs-design Status: There's a problem here, but no obvious solution; or the solution raises other questions
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@syphar @pietroalbini @petr-tik @jyn514