Skip to content

a class that uses scraped proxies to make an http GET/POST request (Python requests)

License

Notifications You must be signed in to change notification settings

Vichet97/proxy_requests

 
 

Repository files navigation

Python Proxy Requests | make an http GET/POST with a proxy scraped from https://www.sslproxies.org/

pypi.org: https://pypi.org/project/proxy-requests/

The ProxyRequests class first scrapes proxies from the web. Then it recursively attempts to make a request if the initial request with a proxy is unsuccessful. System Requirements: Python 3 and the requests module.
Youtube Demo: https://youtu.be/isxJeqo_sBA

Runs on Linux and Windows (and Mac probably)-It may take a moment to run depending on current proxy.

Either copy the code and put where you want it, or download via pip:

pip3 install proxy-requests
from proxy_requests.proxy_requests import ProxyRequests

or if you need the Basic Auth subclass as well:
from proxy_requests.proxy_requests import ProxyRequests, ProxyRequestsBasicAuth

If the above import statement is used, method calls will be identical to the ones shown below. Pass a fully qualified URL when initializing an instance.

The ProxyRequestBasicAuth subclass has get, post, post_with_headers, and post_file methods that will override the Parent methods.

example GET:
r = ProxyRequests("https://api.ipify.org","KH") "KH": Cambodia or "Any": Any Country or "": Non-proxy
r.get()
example POST:
r = ProxyRequests("url here")
r.post({"key1": "value1", "key2": "value2"})
example POST with headers: r = ProxyRequests("url here")
r.set_headers({"name": "rootVIII", "secret_message": "7Yufs9KIfj33d"})
r.post_with_headers({"key1": "value1", "key2": "value2"})
example POST FILE:
r = ProxyRequests("url here")
r.set_file({'file': open('test.txt', 'rb')})
r.post_file()
example GET with Basic Authentication:
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.get()
example post with Basic Authentication
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.post({"key1": "value1", "key2": "value2"})
example post with headers & Basic Authentication
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.set_headers({"header_key": "header_value"})
r.post_with_headers({"key1": "value1", "key2": "value2"})
example POST FILE with Basic Authentication:
r = ProxyRequestsBasicAuth("url here", "username", "password")
r.set_file({'file': open('test.txt', 'rb')})
r.post_file()

Response Methods:
print(r)
print(r.get_headers())
print(r.get_status_code())
print(r.to_json())
print(r.get_proxy_used())


The to_json() method is not intended to be used for a string of HTML

This was developed on Ubuntu 16.04.4 LTS.


Author: James Loye Colley 04AUG2018

Example 1:

example1


Example 2:

example2

About

a class that uses scraped proxies to make an http GET/POST request (Python requests)

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%