nojhan/weboob-devel
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
6,853 commits 2 branches 0 tags 13 MiB
Commit graph

79 commits

Author SHA1 Message Date
Laurent Bachelier
c4f221fba0 Change pool size after session init 
FuturesSession does this, but it is lost since the HTTPAdapters are
later replaced.
 2015-09-10 15:36:49 +02:00
Bezleputh
98a8b1509b [filters] handle TypeError in json parsing filter 2015-08-31 15:05:27 +02:00
Romain Bignon
a823cb8eef fix error message 2015-08-11 17:16:02 +02:00
Vincent Paredes
b01a6d8915 CleanDecimal can convert int float and long 2015-08-07 13:30:34 +02:00
Romain Bignon
7654ded661 create the StatesMixin 2015-08-03 12:18:21 +02:00
Pierre-Louis Bonicoli
ead90ebf92 code example: use HTMLPage instead of Page 
Signed-off-by: Pierre-Louis Bonicoli <pierre-louis.bonicoli@gmx.fr>
 2015-07-22 13:47:01 +02:00
Laurent Bachelier
927ac8876d Bump Firefox version to next ESR (38) 2015-06-30 11:28:12 +02:00
Laurent Bachelier
f591dba678 Browser: callback in the same place, async or not 2015-05-14 18:43:03 +02:00
Laurent Bachelier
25da89642a browser: Allow changing the Session class 
In a separate method, so arguments can be removed or added.
 2015-05-14 18:42:55 +02:00
Laurent Bachelier
b4a428a2c8 browser: Allow more control of the referrer 2015-05-14 18:42:52 +02:00
Laurent Bachelier
7263145869 browser: Add Googlebot profile 2015-05-14 18:41:12 +02:00
Vincent Paredes
bf389d7045 striping data on csv 2015-05-07 17:23:57 +02:00
smurail
511daa73a1 add a context argument 2015-05-07 14:32:59 +02:00
smurail
62adf86daa add JSON helpers 2015-05-07 14:32:55 +02:00
Romain Bignon
7891ce6118 fix crash if dump_state() occurs without a current page 2015-03-25 01:21:28 +01:00
Romain Bignon
6709974d35 shutdown the session async executor to cleanup useless threads 2015-03-24 23:59:39 +01:00
Romain Bignon
195b61fb57 give max_retries to FuturesSession in case it may build HTTPAdaptors 2015-03-24 23:59:05 +01:00
Romain Bignon
a9b86d60a5 if AsyncLoad parameter is None, do not try to open it, and Async returns None 
This fixes a bug with LCL for transactions without details
 2015-03-24 23:57:21 +01:00
Florent
47fe42135c Browser: move load/dump_state to LoginBrowser 
It does not make sens to store a cookie for a non-logged browser.
 2015-03-20 22:23:09 +01:00
Bezleputh
bc1746214c [browser] catch HTTPErrors during load_state 2015-03-13 17:45:53 +01:00
Bezleputh
11a63c33ce [filter] improve Join filter 
The filter will now act a little bit more like the join command
I also added some parameters that will help formatting (newLine, addBedore, addAfter)
 2015-03-13 00:05:36 +01:00
Bezleputh
a39dff77a5 [Element] create new element : DictElement 
use new DictElement in modules
 2015-03-13 00:05:35 +01:00
Romain Bignon
be122f0fa6 add 'replace' xpath function 2015-03-12 15:22:42 +01:00
Laurent Bachelier
dd1173e2f2 filters: JSON Dict improvements 
- Allow the selector to already be a list
- Allow having None as a valid value (JSON "null")
- Handle lists in addition to dicts
- Try to guess whether the selector element is intented to be an int or a str
  based on the structure available (list means int)
 2015-03-02 15:48:38 +01:00
Laurent Bachelier
7d5835d84f browser: Fix crash when using HEAD on a page-matching URL 
HEAD responses have no content, so it doesn't make sense to build
Pages out of them.
 2015-03-02 15:48:38 +01:00
Laurent Bachelier
677cc18524 browser: Add an absurl method to Page 2015-03-02 15:48:37 +01:00
Romain Bignon
6a108221db add HTMLPage.REFRESH_MAX parameter (disabled by default) to configure handle of refreshes 2015-02-25 11:35:45 +01:00
smurail
fa7910cff4 add an Eval filter to eg. use arithmetic expressions 2015-02-24 18:58:36 +01:00
Romain Bignon
0445c92a77 handle "Refresh"" meta tag 2015-02-21 17:49:21 +01:00
Romain Bignon
cedfb5670e save and load state of browser into storage 2015-02-21 17:49:20 +01:00
Alexandre Morignot
7fc06dd16c [filter] correct '_regexp' attribut name in Duration 2015-02-06 08:53:29 +01:00
Romain Bignon
e2ad595413 add LoginBrowser.do_logout() method (which, by default, removes cookies) 2015-02-04 15:04:23 +01:00
Romain Bignon
e442342bf9 do not tell user about disabling of urllib3 warnings 2015-01-24 12:03:43 +01:00
Romain Bignon
130cec8c5a add Slugify filter 2015-01-21 14:16:58 +01:00
Vincent Paredes
920583eae7 try to disable warnigns in urllib3, to support urllib3 version in backport 2015-01-13 10:37:50 +01:00
Romain Bignon
fa3424667f add an APIBrowser 2015-01-03 12:48:50 +01:00
Romain Bignon
0ce0a7e9b5 DomainBrowser: ability to give the baseurl in constructor 2015-01-03 12:48:50 +01:00
Romain Bignon
e5cf80aec8 add method Browser.set_profile 2015-01-03 12:48:50 +01:00
Romain Bignon
48ca3e5127 add an IPhone profile 2015-01-03 12:48:50 +01:00
Laurent Bachelier
2c53edd5ac Do not crash with bundled urllib3 2015-01-01 12:21:19 +01:00
Bezleputh
aca28a3d5a [filter] handle TypeError exception raised by parse_date in DateTime Filter 2015-01-01 12:16:01 +01:00
Bezleputh
ded5a06ac3 Do not display urllib3 warning if there is no certificate verification 2014-12-30 14:58:31 +01:00
Romain Bignon
a8455d4376 fix pyflakes issues 2014-12-07 16:27:27 +01:00
Bezleputh
c3e824c403 catch AttributeError while counting columns 2014-12-05 14:12:40 +01:00
Romain Bignon
321f6f8633 correctly count columns when there is an attribute "colspan" 2014-12-03 23:23:04 +01:00
Laurent Bachelier
88df613a53 Fix English: "childs" into "children" 
refs #1675
 2014-11-22 16:36:03 +01:00
Laurent Bachelier
38359dc8c9 filters: Fix Attr error message 
Not always a Link, incorrect English.
 2014-11-22 16:35:59 +01:00
Florent
656440b5ee Add argument for compatibility with python 2.6 
Closes: #1651
 2014-11-18 22:43:43 +01:00
smurail
8688e266b5 Browser.VERIFY can now be a module local file 2014-10-27 15:41:39 +01:00
smurail
2a6fa3fb36 add an asset method to get absolute path of module local files 2014-10-27 15:41:33 +01:00