Romain Bignon
7891ce6118
fix crash if dump_state() occurs without a current page
2015-03-25 01:21:28 +01:00
Romain Bignon
6709974d35
shutdown the session async executor to cleanup useless threads
2015-03-24 23:59:39 +01:00
Romain Bignon
195b61fb57
give max_retries to FuturesSession in case it may build HTTPAdaptors
2015-03-24 23:59:05 +01:00
Romain Bignon
a9b86d60a5
if AsyncLoad parameter is None, do not try to open it, and Async returns None
...
This fixes a bug with LCL for transactions without details
2015-03-24 23:57:21 +01:00
Florent
47fe42135c
Browser: move load/dump_state to LoginBrowser
...
It does not make sens to store a cookie for a non-logged browser.
2015-03-20 22:23:09 +01:00
Bezleputh
bc1746214c
[browser] catch HTTPErrors during load_state
2015-03-13 17:45:53 +01:00
Bezleputh
11a63c33ce
[filter] improve Join filter
...
The filter will now act a little bit more like the join command
I also added some parameters that will help formatting (newLine, addBedore, addAfter)
2015-03-13 00:05:36 +01:00
Bezleputh
a39dff77a5
[Element] create new element : DictElement
...
use new DictElement in modules
2015-03-13 00:05:35 +01:00
Romain Bignon
be122f0fa6
add 'replace' xpath function
2015-03-12 15:22:42 +01:00
Laurent Bachelier
dd1173e2f2
filters: JSON Dict improvements
...
- Allow the selector to already be a list
- Allow having None as a valid value (JSON "null")
- Handle lists in addition to dicts
- Try to guess whether the selector element is intented to be an int or a str
based on the structure available (list means int)
2015-03-02 15:48:38 +01:00
Laurent Bachelier
7d5835d84f
browser: Fix crash when using HEAD on a page-matching URL
...
HEAD responses have no content, so it doesn't make sense to build
Pages out of them.
2015-03-02 15:48:38 +01:00
Laurent Bachelier
677cc18524
browser: Add an absurl method to Page
2015-03-02 15:48:37 +01:00
Romain Bignon
6a108221db
add HTMLPage.REFRESH_MAX parameter (disabled by default) to configure handle of refreshes
2015-02-25 11:35:45 +01:00
smurail
fa7910cff4
add an Eval filter to eg. use arithmetic expressions
2015-02-24 18:58:36 +01:00
Romain Bignon
0445c92a77
handle "Refresh"" meta tag
2015-02-21 17:49:21 +01:00
Romain Bignon
cedfb5670e
save and load state of browser into storage
2015-02-21 17:49:20 +01:00
Alexandre Morignot
7fc06dd16c
[filter] correct '_regexp' attribut name in Duration
2015-02-06 08:53:29 +01:00
Romain Bignon
e2ad595413
add LoginBrowser.do_logout() method (which, by default, removes cookies)
2015-02-04 15:04:23 +01:00
Romain Bignon
e442342bf9
do not tell user about disabling of urllib3 warnings
2015-01-24 12:03:43 +01:00
Romain Bignon
130cec8c5a
add Slugify filter
2015-01-21 14:16:58 +01:00
Vincent Paredes
920583eae7
try to disable warnigns in urllib3, to support urllib3 version in backport
2015-01-13 10:37:50 +01:00
Romain Bignon
fa3424667f
add an APIBrowser
2015-01-03 12:48:50 +01:00
Romain Bignon
0ce0a7e9b5
DomainBrowser: ability to give the baseurl in constructor
2015-01-03 12:48:50 +01:00
Romain Bignon
e5cf80aec8
add method Browser.set_profile
2015-01-03 12:48:50 +01:00
Romain Bignon
48ca3e5127
add an IPhone profile
2015-01-03 12:48:50 +01:00
Laurent Bachelier
2c53edd5ac
Do not crash with bundled urllib3
2015-01-01 12:21:19 +01:00
Bezleputh
aca28a3d5a
[filter] handle TypeError exception raised by parse_date in DateTime Filter
2015-01-01 12:16:01 +01:00
Bezleputh
ded5a06ac3
Do not display urllib3 warning if there is no certificate verification
2014-12-30 14:58:31 +01:00
Romain Bignon
a8455d4376
fix pyflakes issues
2014-12-07 16:27:27 +01:00
Bezleputh
c3e824c403
catch AttributeError while counting columns
2014-12-05 14:12:40 +01:00
Romain Bignon
321f6f8633
correctly count columns when there is an attribute "colspan"
2014-12-03 23:23:04 +01:00
Laurent Bachelier
88df613a53
Fix English: "childs" into "children"
...
refs #1675
2014-11-22 16:36:03 +01:00
Laurent Bachelier
38359dc8c9
filters: Fix Attr error message
...
Not always a Link, incorrect English.
2014-11-22 16:35:59 +01:00
Florent
656440b5ee
Add argument for compatibility with python 2.6
...
Closes : #1651
2014-11-18 22:43:43 +01:00
smurail
8688e266b5
Browser.VERIFY can now be a module local file
2014-10-27 15:41:39 +01:00
smurail
2a6fa3fb36
add an asset method to get absolute path of module local files
2014-10-27 15:41:33 +01:00
smurail
a3b51902b9
enable passing the path to a CA file to Browser.VERIFY
2014-10-27 15:29:33 +01:00
Bezleputh
dec5789e37
detect xml encoding
2014-10-22 11:46:15 +02:00
smurail
137590e819
fix wrong encoding detection logic
2014-10-22 11:38:28 +02:00
smurail
81c30b0d9f
add a JSValue filter to look for literals
2014-10-21 10:27:59 +02:00
smurail
586ed197bf
Regexp: nth param can now be '*' to find all
2014-10-21 10:27:53 +02:00
smurail
977f5a9f02
cleaner way to get rid of BOM for CsvPage
2014-10-20 17:13:01 +02:00
smurail
a6a7130b31
add ChecksumPage mixin
2014-10-20 17:13:01 +02:00
smurail
237036ce3e
new api for content, encoding, and document building
2014-10-20 17:13:01 +02:00
Laurent Bachelier
92fd11e4cf
browser tests: More Pythonic names
2014-10-19 00:28:44 +02:00
Laurent Bachelier
0a3300c891
browser tests: Fixes
...
pyflakes/pep8, test name in setup.cfg, remove useless comments
2014-10-19 00:28:43 +02:00
juliaL03
8a6c657194
Tests method Groupe Julia Lille1
...
Signed-off-by: juliaL03 <julia.leven@etudiant.univ-lille1.fr>
2014-10-19 00:28:43 +02:00
Laurent Bachelier
3fcfc9a980
form: Add comments
2014-10-19 00:28:43 +02:00
Laurent Bachelier
fd3484e063
filters: Add Unicode normalization to CleanText
...
With a default to 'NFC'.
This is inspired by python-ftfy, which has a nice explanation of the modes:
https://github.com/LuminosoInsight/python-ftfy
I think K is too strong to be a default, however C has zero visual differences
and should be the most common way to represent Unicode characters.
2014-10-19 00:28:43 +02:00
Florent
ac1e85d505
Update android user agent
2014-10-17 11:36:18 +02:00
