Johann Broudin
a56767fbf5
change a function call to avoid useless None
2014-03-13 20:20:02 +01:00
Johann Broudin
cafd6c8f05
Add proxy support to browser2
2014-03-13 20:20:02 +01:00
Johann Broudin
0fe6358f59
CMB now uses browser2 instead of hellhttp
2014-03-13 20:20:02 +01:00
Laurent Bachelier
1e5f5940c5
Split _open() to allow request customization
2014-03-13 19:01:56 +01:00
Laurent Bachelier
b07da18081
More updates and cleanups for new requests
2014-03-13 18:07:17 +01:00
Laurent Bachelier
5711158f80
Require python-requests version
2014-03-13 17:53:01 +01:00
Laurent Bachelier
eb54528b95
Update Firefox to latest ESR
2014-03-13 17:36:44 +01:00
Laurent Bachelier
62e5d23f23
Another python-requests bug fixed in newer versions!
2014-03-13 17:32:45 +01:00
Laurent Bachelier
82c61f3668
Cleanups due to the usage of python-requests>=2.0
2014-03-13 17:18:26 +01:00
Romain Bignon
ecd3a9c5ab
handle Refresh HTTP header
2014-03-12 23:41:08 +01:00
Romain Bignon
04b7a9d572
force referer when submitting a form
2014-03-12 23:41:06 +01:00
Romain Bignon
7edf5e488a
add result
2014-03-12 21:15:30 +01:00
Romain Bignon
a4167194f0
add Regexp filter
2014-03-12 21:10:40 +01:00
Romain Bignon
434931a3ca
remove redondant attribute
2014-03-12 20:38:07 +01:00
Romain Bignon
a4b7f5cdf1
user-friendly error message when python-requests is not installed
2014-03-12 10:17:20 +01:00
Romain Bignon
9893a2da0b
use Transaction.TransactionsElement
2014-03-12 08:43:48 +01:00
Romain Bignon
75f17333a2
add TransactionsElement and TransactionElement
2014-03-12 08:43:48 +01:00
Romain Bignon
80d3f693e8
change API of TableElement to use col_ attributes instead of dict
2014-03-12 08:43:48 +01:00
Romain Bignon
a9afcb685d
fix when there are several cards
2014-03-12 08:43:48 +01:00
Florent
e207d754a4
Update AUTHORS
2014-03-11 17:15:50 +01:00
Romain Bignon
fd8136ebfe
keep order in obj_* attributes, and changes in API
2014-03-10 22:52:59 +01:00
Florent
36cc82d34a
Traling whitespace and pep8 cleaning
2014-03-10 20:18:22 +01:00
Yann Rouillard
9010ffb025
add support for videos available at kids.dailymotion.com
2014-03-10 20:18:22 +01:00
Romain Bignon
158e8c5fdc
add dependencie for requests
2014-03-10 14:28:53 +01:00
Romain Bignon
af9197fba7
upgrade to browser2
2014-03-10 13:11:08 +01:00
Romain Bignon
1b2d3cfe48
upgrade to browser2
2014-03-10 13:11:07 +01:00
Romain Bignon
8b9073de12
add specific filters for browser2
2014-03-10 13:11:07 +01:00
Romain Bignon
0a0865542a
temp hack to support new browser
2014-03-10 13:11:07 +01:00
Romain Bignon
8d7f613f59
do not require an id, because of ItemElement which constructs objects without arguments
2014-03-10 13:11:07 +01:00
Romain Bignon
dd3b8277d0
import regex_helper from django
2014-03-10 13:11:07 +01:00
Romain Bignon
8ea92461dc
add PagesBrowser, ListElement, ItemElement, TableElement, and filters
2014-03-10 13:11:07 +01:00
Romain Bignon
5e199bdfa9
fix browser2 to be compliant with python-requests >= 2.0
2014-03-10 13:11:07 +01:00
Laurent Bachelier
61e7b93779
Some PEP8 fixes
2014-03-10 13:11:07 +01:00
Laurent Bachelier
1ff07273b3
Add base URL restriction
...
For security reasons (SSL only, no leakage, etc.)
2014-03-10 13:11:07 +01:00
Laurent Bachelier
b701d9519a
browser2: Updates for latest python-requests developments
2014-03-10 13:11:07 +01:00
Laurent Bachelier
53c298b069
browser2: Update cookies.py
2014-03-10 13:11:07 +01:00
Laurent Bachelier
d50784faae
browser2: Minor rewrites
2014-03-10 13:11:07 +01:00
Laurent Bachelier
f7fabfeb7d
browser2: More tests for absolute URLs
2014-03-10 13:11:07 +01:00
Laurent Bachelier
1c404639c1
browser2: Separate CookieJar from CookiePolicy
...
And avoid methods starting by _!
2014-03-10 13:11:07 +01:00
Laurent Bachelier
083caf15e5
browser2: Fix call to wrong method name
2014-03-10 13:11:07 +01:00
Laurent Bachelier
e793fd14da
browser2: Use cookie testing services
...
Both are aimed at real browsers.
This also adds a "real-life" cookie deletion/expiration test.
2014-03-10 13:11:07 +01:00
Laurent Bachelier
26025d725d
browser2: Document why all this for handling cookies
2014-03-10 13:11:07 +01:00
Laurent Bachelier
ef379f830e
browser2: Fix cookie security in redirections
...
With tests (another reason why it's good to write them).
2014-03-10 13:11:07 +01:00
Laurent Bachelier
83e08c103d
browser2: Add easy cookie building
2014-03-10 13:11:07 +01:00
Laurent Bachelier
ec64a52643
browser2: Misc doc/refactor
2014-03-10 13:11:06 +01:00
Laurent Bachelier
baef03c198
browser2: Test cookie override
2014-03-10 13:11:06 +01:00
Laurent Bachelier
2d70d11822
browser2: Handle cookies in the request/response cycle
...
Unlike the one by python-requests, it is secure, and generally behaves
like a real browser.
Basic test added.
2014-03-10 13:11:06 +01:00
Laurent Bachelier
57e16e9fe4
browser2: Handle redirects internally
...
python-requests isn't secure enough, and some behavior depends on the
latest version.
Tested on 0.10.6.
So instead of the previous hack, we have some copy-paste.
But we gain secure cookies handling (not there yet),
referrer handling, "proper" redirect on POST behavior.
2014-03-10 13:11:06 +01:00
Laurent Bachelier
4b802f32dd
browser2: Evolve _fix_redirect for latest python-requests
...
See commits:
e831947be43bc97b39d6e6e573cb0842b67fea80
dacc1d8aafedf80f8736d794005b6c8e8b1d4ad1
b20d171c1c11ecee83b7e4a0beead1e54902d37b
The entire redirect thingy will have to be overriden anyway, as it is
still broken. Cookies are given domain to domain without any checks.
2014-03-10 13:11:06 +01:00
Laurent Bachelier
db304b955c
browser2: Handle cookie expiration, session cookies
...
Every related method accepts a "now" parameter. If provided, it will be
used instead of the system time.
2014-03-10 13:11:06 +01:00
