-
Notifications
You must be signed in to change notification settings - Fork 223
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
bug-1945556: omit example data when elasticsearch would error #6890
Conversation
and enable full version of all text fields so they can have example data
# text fields only get example data if they have a full version or | ||
# include fielddata, like for semicolon_keywords fields. | ||
super_search_field["has_full_version"] | ||
or super_search_field["storage_mapping"]["type"] != "text" |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this will also work for es 1.4 because there the type is "string" and does support aggregations
"type": "text", | ||
}, | ||
}, | ||
"minidump_sha256_hash": text_field("minidump_sha256_hash"), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should this be a keyword field?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I computed FIELDS in the main branch and in this branch and manually compared the two structures and everything looks good.
I had one cosmetic suggestion about Elasticsearch and that's it.
@@ -78,16 +78,15 @@ <h1>{{ field_name }}</h1> | |||
{% for item in example_data %} | |||
<div class="field-example"><code>{{ item|string|truncate(100, killwords=True, end="...") }}</code></div> | |||
{% endfor %} | |||
{% elif "protected" in permissions %} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Weird. I wonder why I didn't do an elif before.
webapp/crashstats/documentation/jinja2/docs/datadictionary/field_doc.html
Outdated
Show resolved
Hide resolved
Co-authored-by: Will Kahn-Greene <[email protected]>
and enable full version of all text fields so they still have example data under elasticsearch 8
context: the page
/documentation/datadictionary/dataset/{dataset}/field/{field}
for dataset=processed currently throws a 500 error for text fields with no full version and no fielddatathis only changes the mapping to include multi-fields where there was none before, which is a valid mapping update, so it can theoretically be applied in-place in stage so we don't need a backfill