nojhan/weboob-devel
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
6,784 commits 2 branches 0 tags 13 MiB
Commit graph

74 commits

Author SHA1 Message Date
Pierre-Louis Bonicoli
ead90ebf92 code example: use HTMLPage instead of Page 
Signed-off-by: Pierre-Louis Bonicoli <pierre-louis.bonicoli@gmx.fr>
 2015-07-22 13:47:01 +02:00
Laurent Bachelier
927ac8876d Bump Firefox version to next ESR (38) 2015-06-30 11:28:12 +02:00
Laurent Bachelier
f591dba678 Browser: callback in the same place, async or not 2015-05-14 18:43:03 +02:00
Laurent Bachelier
25da89642a browser: Allow changing the Session class 
In a separate method, so arguments can be removed or added.
 2015-05-14 18:42:55 +02:00
Laurent Bachelier
b4a428a2c8 browser: Allow more control of the referrer 2015-05-14 18:42:52 +02:00
Laurent Bachelier
7263145869 browser: Add Googlebot profile 2015-05-14 18:41:12 +02:00
Vincent Paredes
bf389d7045 striping data on csv 2015-05-07 17:23:57 +02:00
smurail
511daa73a1 add a context argument 2015-05-07 14:32:59 +02:00
smurail
62adf86daa add JSON helpers 2015-05-07 14:32:55 +02:00
Romain Bignon
7891ce6118 fix crash if dump_state() occurs without a current page 2015-03-25 01:21:28 +01:00
Romain Bignon
6709974d35 shutdown the session async executor to cleanup useless threads 2015-03-24 23:59:39 +01:00
Romain Bignon
195b61fb57 give max_retries to FuturesSession in case it may build HTTPAdaptors 2015-03-24 23:59:05 +01:00
Romain Bignon
a9b86d60a5 if AsyncLoad parameter is None, do not try to open it, and Async returns None 
This fixes a bug with LCL for transactions without details
 2015-03-24 23:57:21 +01:00
Florent
47fe42135c Browser: move load/dump_state to LoginBrowser 
It does not make sens to store a cookie for a non-logged browser.
 2015-03-20 22:23:09 +01:00
Bezleputh
bc1746214c [browser] catch HTTPErrors during load_state 2015-03-13 17:45:53 +01:00
Bezleputh
11a63c33ce [filter] improve Join filter 
The filter will now act a little bit more like the join command
I also added some parameters that will help formatting (newLine, addBedore, addAfter)
 2015-03-13 00:05:36 +01:00
Bezleputh
a39dff77a5 [Element] create new element : DictElement 
use new DictElement in modules
 2015-03-13 00:05:35 +01:00
Romain Bignon
be122f0fa6 add 'replace' xpath function 2015-03-12 15:22:42 +01:00
Laurent Bachelier
dd1173e2f2 filters: JSON Dict improvements 
- Allow the selector to already be a list
- Allow having None as a valid value (JSON "null")
- Handle lists in addition to dicts
- Try to guess whether the selector element is intented to be an int or a str
  based on the structure available (list means int)
 2015-03-02 15:48:38 +01:00
Laurent Bachelier
7d5835d84f browser: Fix crash when using HEAD on a page-matching URL 
HEAD responses have no content, so it doesn't make sense to build
Pages out of them.
 2015-03-02 15:48:38 +01:00
Laurent Bachelier
677cc18524 browser: Add an absurl method to Page 2015-03-02 15:48:37 +01:00
Romain Bignon
6a108221db add HTMLPage.REFRESH_MAX parameter (disabled by default) to configure handle of refreshes 2015-02-25 11:35:45 +01:00
smurail
fa7910cff4 add an Eval filter to eg. use arithmetic expressions 2015-02-24 18:58:36 +01:00
Romain Bignon
0445c92a77 handle "Refresh"" meta tag 2015-02-21 17:49:21 +01:00
Romain Bignon
cedfb5670e save and load state of browser into storage 2015-02-21 17:49:20 +01:00
Alexandre Morignot
7fc06dd16c [filter] correct '_regexp' attribut name in Duration 2015-02-06 08:53:29 +01:00
Romain Bignon
e2ad595413 add LoginBrowser.do_logout() method (which, by default, removes cookies) 2015-02-04 15:04:23 +01:00
Romain Bignon
e442342bf9 do not tell user about disabling of urllib3 warnings 2015-01-24 12:03:43 +01:00
Romain Bignon
130cec8c5a add Slugify filter 2015-01-21 14:16:58 +01:00
Vincent Paredes
920583eae7 try to disable warnigns in urllib3, to support urllib3 version in backport 2015-01-13 10:37:50 +01:00
Romain Bignon
fa3424667f add an APIBrowser 2015-01-03 12:48:50 +01:00
Romain Bignon
0ce0a7e9b5 DomainBrowser: ability to give the baseurl in constructor 2015-01-03 12:48:50 +01:00
Romain Bignon
e5cf80aec8 add method Browser.set_profile 2015-01-03 12:48:50 +01:00
Romain Bignon
48ca3e5127 add an IPhone profile 2015-01-03 12:48:50 +01:00
Laurent Bachelier
2c53edd5ac Do not crash with bundled urllib3 2015-01-01 12:21:19 +01:00
Bezleputh
aca28a3d5a [filter] handle TypeError exception raised by parse_date in DateTime Filter 2015-01-01 12:16:01 +01:00
Bezleputh
ded5a06ac3 Do not display urllib3 warning if there is no certificate verification 2014-12-30 14:58:31 +01:00
Romain Bignon
a8455d4376 fix pyflakes issues 2014-12-07 16:27:27 +01:00
Bezleputh
c3e824c403 catch AttributeError while counting columns 2014-12-05 14:12:40 +01:00
Romain Bignon
321f6f8633 correctly count columns when there is an attribute "colspan" 2014-12-03 23:23:04 +01:00
Laurent Bachelier
88df613a53 Fix English: "childs" into "children" 
refs #1675
 2014-11-22 16:36:03 +01:00
Laurent Bachelier
38359dc8c9 filters: Fix Attr error message 
Not always a Link, incorrect English.
 2014-11-22 16:35:59 +01:00
Florent
656440b5ee Add argument for compatibility with python 2.6 
Closes: #1651
 2014-11-18 22:43:43 +01:00
smurail
8688e266b5 Browser.VERIFY can now be a module local file 2014-10-27 15:41:39 +01:00
smurail
2a6fa3fb36 add an asset method to get absolute path of module local files 2014-10-27 15:41:33 +01:00
smurail
a3b51902b9 enable passing the path to a CA file to Browser.VERIFY 2014-10-27 15:29:33 +01:00
Bezleputh
dec5789e37 detect xml encoding 2014-10-22 11:46:15 +02:00
smurail
137590e819 fix wrong encoding detection logic 2014-10-22 11:38:28 +02:00
smurail
81c30b0d9f add a JSValue filter to look for literals 2014-10-21 10:27:59 +02:00
smurail
586ed197bf Regexp: nth param can now be '*' to find all 2014-10-21 10:27:53 +02:00