Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

future: Pathfinder scoring #863

Open
colleenXu opened this issue Sep 9, 2024 · 1 comment
Open

future: Pathfinder scoring #863

colleenXu opened this issue Sep 9, 2024 · 1 comment
Assignees
Labels
enhancement New feature or request next phase for future if we're funded

Comments

@colleenXu
Copy link
Collaborator

While we have a working version of Pathfinder (#794 #832) now...its scoring of results is not meaningful. Lab Slack convo:

Jackson:

[...] the context in which the scores are generated is completely lost when we change the result format for pathfinder
The scores are generated on the template-level and then merged ad-hoc on each result, but the results in pathfinder are by intermediate node, not by template result, so the score is taken almost completely out of meaningful context
It has some fuzzy use but it's not as useful as standard creative mode scores

Andrew:

so BTE's lack of meaningful scoring aside, how much has the broader pathfinder group prioritized scoring?
right now, it's not clear that the paths are ordered in any meaningful way...

Jackson:

I haven't really heard any discussion of scoring. I think it's broadly assumed that it's a problem for later

@colleenXu colleenXu added the enhancement New feature or request label Sep 9, 2024
@colleenXu colleenXu added the next phase for future if we're funded label Sep 9, 2024
@rjawesome
Copy link
Contributor

Possible idea?

  • disable scoring when running the trapi queries
  • after pathfinder has run its queries, then score subject -> intermediate and intermediate -> object based on NGD & number of supporting edges

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request next phase for future if we're funded
Projects
None yet
Development

No branches or pull requests

3 participants