Bezleputh
5dcfb7738d
[filters] Add a Decode filter taht aims to decode urlencoded strings
2015-09-22 15:07:35 +02:00
Bezleputh
1e3568891b
[filter] handle new format in Time filter
2015-09-15 10:44:37 +02:00
Romain Bignon
55fa318cfc
URL.go: ability to force method
2015-09-12 19:07:01 +02:00
Laurent Bachelier
f7115f5f69
Fix PEP8 E713
2015-09-10 15:36:49 +02:00
Laurent Bachelier
c4f221fba0
Change pool size after session init
...
FuturesSession does this, but it is lost since the HTTPAdapters are
later replaced.
2015-09-10 15:36:49 +02:00
Bezleputh
98a8b1509b
[filters] handle TypeError in json parsing filter
2015-08-31 15:05:27 +02:00
Romain Bignon
a823cb8eef
fix error message
2015-08-11 17:16:02 +02:00
Vincent Paredes
b01a6d8915
CleanDecimal can convert int float and long
2015-08-07 13:30:34 +02:00
Romain Bignon
7654ded661
create the StatesMixin
2015-08-03 12:18:21 +02:00
Pierre-Louis Bonicoli
ead90ebf92
code example: use HTMLPage instead of Page
...
Signed-off-by: Pierre-Louis Bonicoli <pierre-louis.bonicoli@gmx.fr>
2015-07-22 13:47:01 +02:00
Laurent Bachelier
927ac8876d
Bump Firefox version to next ESR (38)
2015-06-30 11:28:12 +02:00
Laurent Bachelier
f591dba678
Browser: callback in the same place, async or not
2015-05-14 18:43:03 +02:00
Laurent Bachelier
25da89642a
browser: Allow changing the Session class
...
In a separate method, so arguments can be removed or added.
2015-05-14 18:42:55 +02:00
Laurent Bachelier
b4a428a2c8
browser: Allow more control of the referrer
2015-05-14 18:42:52 +02:00
Laurent Bachelier
7263145869
browser: Add Googlebot profile
2015-05-14 18:41:12 +02:00
Vincent Paredes
bf389d7045
striping data on csv
2015-05-07 17:23:57 +02:00
smurail
511daa73a1
add a context argument
2015-05-07 14:32:59 +02:00
smurail
62adf86daa
add JSON helpers
2015-05-07 14:32:55 +02:00
Romain Bignon
7891ce6118
fix crash if dump_state() occurs without a current page
2015-03-25 01:21:28 +01:00
Romain Bignon
6709974d35
shutdown the session async executor to cleanup useless threads
2015-03-24 23:59:39 +01:00
Romain Bignon
195b61fb57
give max_retries to FuturesSession in case it may build HTTPAdaptors
2015-03-24 23:59:05 +01:00
Romain Bignon
a9b86d60a5
if AsyncLoad parameter is None, do not try to open it, and Async returns None
...
This fixes a bug with LCL for transactions without details
2015-03-24 23:57:21 +01:00
Florent
47fe42135c
Browser: move load/dump_state to LoginBrowser
...
It does not make sens to store a cookie for a non-logged browser.
2015-03-20 22:23:09 +01:00
Bezleputh
bc1746214c
[browser] catch HTTPErrors during load_state
2015-03-13 17:45:53 +01:00
Bezleputh
11a63c33ce
[filter] improve Join filter
...
The filter will now act a little bit more like the join command
I also added some parameters that will help formatting (newLine, addBedore, addAfter)
2015-03-13 00:05:36 +01:00
Bezleputh
a39dff77a5
[Element] create new element : DictElement
...
use new DictElement in modules
2015-03-13 00:05:35 +01:00
Romain Bignon
be122f0fa6
add 'replace' xpath function
2015-03-12 15:22:42 +01:00
Laurent Bachelier
dd1173e2f2
filters: JSON Dict improvements
...
- Allow the selector to already be a list
- Allow having None as a valid value (JSON "null")
- Handle lists in addition to dicts
- Try to guess whether the selector element is intented to be an int or a str
based on the structure available (list means int)
2015-03-02 15:48:38 +01:00
Laurent Bachelier
7d5835d84f
browser: Fix crash when using HEAD on a page-matching URL
...
HEAD responses have no content, so it doesn't make sense to build
Pages out of them.
2015-03-02 15:48:38 +01:00
Laurent Bachelier
677cc18524
browser: Add an absurl method to Page
2015-03-02 15:48:37 +01:00
Romain Bignon
6a108221db
add HTMLPage.REFRESH_MAX parameter (disabled by default) to configure handle of refreshes
2015-02-25 11:35:45 +01:00
smurail
fa7910cff4
add an Eval filter to eg. use arithmetic expressions
2015-02-24 18:58:36 +01:00
Romain Bignon
0445c92a77
handle "Refresh"" meta tag
2015-02-21 17:49:21 +01:00
Romain Bignon
cedfb5670e
save and load state of browser into storage
2015-02-21 17:49:20 +01:00
Alexandre Morignot
7fc06dd16c
[filter] correct '_regexp' attribut name in Duration
2015-02-06 08:53:29 +01:00
Romain Bignon
e2ad595413
add LoginBrowser.do_logout() method (which, by default, removes cookies)
2015-02-04 15:04:23 +01:00
Romain Bignon
e442342bf9
do not tell user about disabling of urllib3 warnings
2015-01-24 12:03:43 +01:00
Romain Bignon
130cec8c5a
add Slugify filter
2015-01-21 14:16:58 +01:00
Vincent Paredes
920583eae7
try to disable warnigns in urllib3, to support urllib3 version in backport
2015-01-13 10:37:50 +01:00
Romain Bignon
fa3424667f
add an APIBrowser
2015-01-03 12:48:50 +01:00
Romain Bignon
0ce0a7e9b5
DomainBrowser: ability to give the baseurl in constructor
2015-01-03 12:48:50 +01:00
Romain Bignon
e5cf80aec8
add method Browser.set_profile
2015-01-03 12:48:50 +01:00
Romain Bignon
48ca3e5127
add an IPhone profile
2015-01-03 12:48:50 +01:00
Laurent Bachelier
2c53edd5ac
Do not crash with bundled urllib3
2015-01-01 12:21:19 +01:00
Bezleputh
aca28a3d5a
[filter] handle TypeError exception raised by parse_date in DateTime Filter
2015-01-01 12:16:01 +01:00
Bezleputh
ded5a06ac3
Do not display urllib3 warning if there is no certificate verification
2014-12-30 14:58:31 +01:00
Romain Bignon
a8455d4376
fix pyflakes issues
2014-12-07 16:27:27 +01:00
Bezleputh
c3e824c403
catch AttributeError while counting columns
2014-12-05 14:12:40 +01:00
Romain Bignon
321f6f8633
correctly count columns when there is an attribute "colspan"
2014-12-03 23:23:04 +01:00
Laurent Bachelier
88df613a53
Fix English: "childs" into "children"
...
refs #1675
2014-11-22 16:36:03 +01:00