From 502595ea6692c31b7022d09c4e94045fa7829b68 Mon Sep 17 00:00:00 2001 From: jkantarek <10119570+jkantarek@users.noreply.github.com> Date: Thu, 29 Feb 2024 19:49:20 -0600 Subject: [PATCH 1/2] fix minor typos --- _posts/2024-02-29-prompt-engineering.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/_posts/2024-02-29-prompt-engineering.md b/_posts/2024-02-29-prompt-engineering.md index ffaebb6..6db8619 100644 --- a/_posts/2024-02-29-prompt-engineering.md +++ b/_posts/2024-02-29-prompt-engineering.md @@ -14,7 +14,7 @@ mermaid: true
-One of my absolute favorite Ted talks that I share with _every_ new parent is called "The Birth of a Word." It unlocked an idea for me that learning words and meaning is as much about context as it is content. +One of my absolute favorite Ted talks that I share with _every_ new parent is called "The Birth of a Word." It unlocked an idea for me that learning words is as much about context as it is content.
@@ -28,7 +28,7 @@ The vast majority of newborn experience and early child development is a race to -What it also means is that words and the _context_ of those words matter. With kids (and lets be honest adults too) you have to keep things simple so they actually hear what you have to say and it has to be relevant to their current situation. Hey kids, can you make sure to put the bowl (that you're currently holding in your hand) in the sink?? On top of that you have to repeat yourself _a lot_ until they get it. Every time you start a conversation with ChatGPT _you_ have to supply the framing and context for the specific thing you're trying to do. On top of that you have to give it as much context with as few tokens as possible in a way that isn't confusing. +What it also means is that words and the _context_ of those words matter. With kids (and lets be honest adults too) you have to keep things simple so they actually hear what you have to say. It has to be relevant to their current situation. Hey kids, can you make sure to put the bowl (that you're currently holding in your hand) in the sink?? You have to repeat yourself _a lot_ until they get it. Every time you start a conversation with ChatGPT _you_ have to supply the framing and context for the specific thing you're trying to do. On top of that you have to give it as much context with as few tokens as possible in a way that isn't confusing.
@@ -40,7 +40,7 @@ A quick aside on tokens. They aren't just letters, or spaces they're a way to co
-You might wonder if using emojis to convey context is a way to build a higher density prompt. Asking ChatGPT to convert the original message into _just_ emojis results in ðŸ‘Ļ‍ðŸ‘Ķ⚔ïļðŸŠĶðŸ˜ĄðŸ‘ŠðŸ”œ or ðŸ‘Ļ‍ðŸ‘Ķ⚔ïļðŸ˜ĩ👋ðŸĪš. These _almost_ feel like [rebus puzzles](https://en.wikipedia.org/wiki/Rebus) where it's a bit of a crap shoot if the reader will understand. The Tokenizer tool says that 6 emojis ultimately results in *23* and 15 characters vs the original text only being 16 tokens! The tool also adds a specific note: +You might wonder if using emojis to convey context is a way to build a higher density prompt. Asking ChatGPT to convert the original message into _just_ emojis results in ðŸ‘Ļ‍ðŸ‘Ķ⚔ïļðŸŠĶðŸ˜ĄðŸ‘ŠðŸ”œ or ðŸ‘Ļ‍ðŸ‘Ķ⚔ïļðŸ˜ĩ👋ðŸĪš. These _almost_ feel like [rebus puzzles](https://en.wikipedia.org/wiki/Rebus) where it's a bit of a crap shoot if the reader will understand. The Tokenizer tool says that 6 emojis ultimately results in *23 tokens* and 15 characters vs the original text only being 16 tokens! The tool also adds a specific note: > Note: Your input contained one or more unicode characters that map to multiple tokens. The output visualization may display the bytes in each token in a non-standard way. What's important to remember here is that the tokenizer itself is a tool used to interact with the underlying model. So a bug in a tokenizer or a more sophisticated tokenizer might be better or worse at interacting with a foundational model. Pretending that a child is a foundational language model it's equivalent to parents being able to speak to and understand their child _much better_ than a stranger. It can be easy for parents to miss a child that needs speach therapy because we've already developed a tokenizer that is _more_ compatible with the way our child speaks and communicates! So what are strategies for building out high quality, high density prompts that more quickly get you where you want to go? From 4534488f672f99cab7657c0ce2d02f4f10123736 Mon Sep 17 00:00:00 2001 From: jkantarek <10119570+jkantarek@users.noreply.github.com> Date: Thu, 29 Feb 2024 20:10:40 -0600 Subject: [PATCH 2/2] [TOC] make sure posts show up on the home page --- README.md | 7 ++++++- _config.yml | 7 +++++++ _posts/2024-02-29-prompt-engineering.md | 4 ++-- 3 files changed, 15 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 01f425f..5986e67 100644 --- a/README.md +++ b/README.md @@ -4,4 +4,9 @@ title: Human built with mostly AI, some real world experience permalink: / --- -Rubyist and Elixir Dev with a flare for F1, comics, cooking and showing up every day for my family. My main hobby is having hobbies. My current obsession is remodeling my home that was originally built in 1892! \ No newline at end of file +Rubyist and Elixir dev with a flare for F1, comics, cooking and showing up every day for my family. My main hobby is having hobbies. My current obsession is remodeling my home that was originally built in 1892! + +{% for post in site.posts %} +## [{{ post.title }}]({{ post.url | absolute_url }}) +{{ post.excerpt }} +{% endfor %} \ No newline at end of file diff --git a/_config.yml b/_config.yml index fd65746..a35702f 100644 --- a/_config.yml +++ b/_config.yml @@ -64,6 +64,13 @@ destination: ./_site incremental: false regenerate: true +excerpt_separator: "" + +readme_index: + enabled: false + remove_originals: false + with_frontmatter: false + plugins: - jekyll-feed - jekyll-readme-index diff --git a/_posts/2024-02-29-prompt-engineering.md b/_posts/2024-02-29-prompt-engineering.md index 6db8619..588ff01 100644 --- a/_posts/2024-02-29-prompt-engineering.md +++ b/_posts/2024-02-29-prompt-engineering.md @@ -6,11 +6,9 @@ layout: post mermaid: true --- -
-
@@ -18,6 +16,8 @@ One of my absolute favorite Ted talks that I share with _every_ new parent is ca
+ +
The vast majority of newborn experience and early child development is a race to help your child communicate with you. Help them tell you what they need or guessing better at their needs then they realize. If you've ever had to deal with a meltdown that _magically disappears_ after a few bites of food you just experienced a child that doesn't understand when they are HANGRY.