Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is it possible to control the output? #13

Open
SolanaFox2 opened this issue Jan 13, 2025 · 2 comments
Open

Is it possible to control the output? #13

SolanaFox2 opened this issue Jan 13, 2025 · 2 comments
Labels
enhancement New feature or request

Comments

@SolanaFox2
Copy link

Love this tool/ your work. I was curious if there was a way to control the output summaries? For example, each chapter broken down summarized in 5 sentences or less? Or does this require fine tuning the model?

@cognitivetech cognitivetech added the enhancement New feature or request label Jan 13, 2025
@cognitivetech
Copy link
Owner

hey thanks, Fox!

This is among my "near term" goals.

I intend to make an option to collect the summaries from each chapter and make a summary for those.. Like a recursive summary.

another option that I haven't played with is to simply feed the entire chapter (context allowing) into a model directly, but I think intermediate summaries would be more effective.

since you've made interest known, I will see about doing that sooner than later.. you'll notice the output already has a chapter column..

You could put True at the beginning of each row which starts a chapter, and false until the next, then have some code collect the summaries... depending on their size it may need several intermediate summaries until context allows.

As I recall anywhere around 2500tokens and higher leads to unexpected outputs...

@SolanaFox2
Copy link
Author

I appreciate you. I will play around and report back if I come-up with any useful ideas!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants