diff --git a/cyber/static/robots.txt b/cyber/static/robots.txt index 005bc7b..b9a7141 100644 --- a/cyber/static/robots.txt +++ b/cyber/static/robots.txt @@ -1,7 +1,8 @@ +# Hey! What are you doing snooping around here! +# I sure hope you don't visit that secret site... + User-agent: Googlebot-Image Disallow: / User-agent: * -Disallow: /secret.html - -Hey! What are you doing snooping around here! I sure hope you don't visit that secret site... \ No newline at end of file +Disallow: /secret.html \ No newline at end of file diff --git a/cyber/templates/training/robots/robots-1.html b/cyber/templates/training/robots/robots-1.html index 36534b8..3b834c7 100644 --- a/cyber/templates/training/robots/robots-1.html +++ b/cyber/templates/training/robots/robots-1.html @@ -9,7 +9,7 @@
- + {% call training_header("Web Hacking", training.display_name, training.points, training.training_name, "sky-blue") %} {% endcall %} @@ -17,40 +17,34 @@
-

This training is all about editing the HTML source code of a website. If you haven't already completed the "Inspecting Source" training, we recommend you do that first.

- - -

How?

-

Here's a quick refresher- there are a few ways you can view the source code of a website:

-
    -
  • Pressing the F12 key on your keyboard
  • -
  • Right clicking the part of the page (element) you want to inspect, then clicking "Inspect"
  • -
  • Right clicking the page, then clicking "View Page Source"
  • -
-

For this training, the second way is what we will be using. It should look a little something like this.

- - - -

When inspecting an element of source code, we can edit it's values to change how it behaves. This allows us to do all sorts of hacky things like allowing us to change text, use disabled fields, and find hidden buttons.

- -

Try editing this paragraph to say anything you want! Right click, inspect element, click the dropdown arrows, then double click the text inside the <p> </p> tags and type your message.

- - - -

The changes you make this way are only temporary so will not save if you refresh the page. But it can be fun to edit your favourite sites this way and it’s a cool way to prank your friends. Here’s an example of editing the headline and image code on a new article…

- +

Robots.txt

+

Have you ever heard of robots.txt? This is a file that can be found on almost all website. To get there, you just add /robots.txt the the URL of a website.

+

Have a look at YouTube's robot.txt file, or visit your own favourite website and see if it has a robots.txt file.

+ +

Which of these URLs would be the right way to get to the robots.txt of the BBC website?

+
+ + + + + + + + + +
+
+ + +

Next we're going to talk about what robots.txt is used for, and delve into how search engines do their job.

- - {% call mini_challenge("Edit this line to say only 'cat' and then push the button below.", "Right click the above text, select inspect element, then double click the p element and type the word 'cat'. Watch the demonstration clip above to show you how.") %} - {% endcall %} - - {% call pagination(current_page, training.training_name, 4) %} + {% call pagination(current_page, training.training_name, 3) %} {% endcall %} @@ -59,17 +53,12 @@

How?