nojhan/weboob-devel
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
6,365 commits 2 branches 0 tags 13 MiB
Commit graph

49 commits

Author SHA1 Message Date
Alexandre Morignot
7fc06dd16c [filter] correct '_regexp' attribut name in Duration 2015-02-06 08:53:29 +01:00
Romain Bignon
e2ad595413 add LoginBrowser.do_logout() method (which, by default, removes cookies) 2015-02-04 15:04:23 +01:00
Romain Bignon
e442342bf9 do not tell user about disabling of urllib3 warnings 2015-01-24 12:03:43 +01:00
Romain Bignon
130cec8c5a add Slugify filter 2015-01-21 14:16:58 +01:00
Vincent Paredes
920583eae7 try to disable warnigns in urllib3, to support urllib3 version in backport 2015-01-13 10:37:50 +01:00
Romain Bignon
fa3424667f add an APIBrowser 2015-01-03 12:48:50 +01:00
Romain Bignon
0ce0a7e9b5 DomainBrowser: ability to give the baseurl in constructor 2015-01-03 12:48:50 +01:00
Romain Bignon
e5cf80aec8 add method Browser.set_profile 2015-01-03 12:48:50 +01:00
Romain Bignon
48ca3e5127 add an IPhone profile 2015-01-03 12:48:50 +01:00
Laurent Bachelier
2c53edd5ac Do not crash with bundled urllib3 2015-01-01 12:21:19 +01:00
Bezleputh
aca28a3d5a [filter] handle TypeError exception raised by parse_date in DateTime Filter 2015-01-01 12:16:01 +01:00
Bezleputh
ded5a06ac3 Do not display urllib3 warning if there is no certificate verification 2014-12-30 14:58:31 +01:00
Romain Bignon
a8455d4376 fix pyflakes issues 2014-12-07 16:27:27 +01:00
Bezleputh
c3e824c403 catch AttributeError while counting columns 2014-12-05 14:12:40 +01:00
Romain Bignon
321f6f8633 correctly count columns when there is an attribute "colspan" 2014-12-03 23:23:04 +01:00
Laurent Bachelier
88df613a53 Fix English: "childs" into "children" 
refs #1675
 2014-11-22 16:36:03 +01:00
Laurent Bachelier
38359dc8c9 filters: Fix Attr error message 
Not always a Link, incorrect English.
 2014-11-22 16:35:59 +01:00
Florent
656440b5ee Add argument for compatibility with python 2.6 
Closes: #1651
 2014-11-18 22:43:43 +01:00
smurail
8688e266b5 Browser.VERIFY can now be a module local file 2014-10-27 15:41:39 +01:00
smurail
2a6fa3fb36 add an asset method to get absolute path of module local files 2014-10-27 15:41:33 +01:00
smurail
a3b51902b9 enable passing the path to a CA file to Browser.VERIFY 2014-10-27 15:29:33 +01:00
Bezleputh
dec5789e37 detect xml encoding 2014-10-22 11:46:15 +02:00
smurail
137590e819 fix wrong encoding detection logic 2014-10-22 11:38:28 +02:00
smurail
81c30b0d9f add a JSValue filter to look for literals 2014-10-21 10:27:59 +02:00
smurail
586ed197bf Regexp: nth param can now be '*' to find all 2014-10-21 10:27:53 +02:00
smurail
977f5a9f02 cleaner way to get rid of BOM for CsvPage 2014-10-20 17:13:01 +02:00
smurail
a6a7130b31 add ChecksumPage mixin 2014-10-20 17:13:01 +02:00
smurail
237036ce3e new api for content, encoding, and document building 2014-10-20 17:13:01 +02:00
Laurent Bachelier
92fd11e4cf browser tests: More Pythonic names 2014-10-19 00:28:44 +02:00
Laurent Bachelier
0a3300c891 browser tests: Fixes 
pyflakes/pep8, test name in setup.cfg, remove useless comments
 2014-10-19 00:28:43 +02:00
juliaL03
8a6c657194 Tests method Groupe Julia Lille1 
Signed-off-by: juliaL03 <julia.leven@etudiant.univ-lille1.fr>
 2014-10-19 00:28:43 +02:00
Laurent Bachelier
3fcfc9a980 form: Add comments 2014-10-19 00:28:43 +02:00
Laurent Bachelier
fd3484e063 filters: Add Unicode normalization to CleanText 
With a default to 'NFC'.
This is inspired by python-ftfy, which has a nice explanation of the modes:
https://github.com/LuminosoInsight/python-ftfy

I think K is too strong to be a default, however C has zero visual differences
and should be the most common way to represent Unicode characters.
 2014-10-19 00:28:43 +02:00
Florent
ac1e85d505 Update android user agent 2014-10-17 11:36:18 +02:00
Romain Bignon
94cea6458b ability to select an ItemElement 2014-10-11 16:55:59 +02:00
Laurent Bachelier
f4c17cdc9d pep8: Fix E303 too many blank lines 2014-10-11 02:15:28 +02:00
Laurent Bachelier
21e8f82fd7 pep8: Use "X not in Y" instead of "not X in Y" 
flake8 --select E713, semi-manual fixing
 2014-10-11 01:27:24 +02:00
Laurent Bachelier
448c06d125 pep8 blank lines fixes 
flake8 --select W391,E302,E301,E304

autopep8 can't fix W391 even though it claims it can.
Fixed using a simple custom script.
 2014-10-10 23:41:44 +02:00
Laurent Bachelier
6161a0aacd pep8 fixes, modernizations 
autopep8 -a -r -i --select E711,E712,W601,W602,W603,W604,W690,E304,E401,E502 .
Also includes some manual reindentations (many are left after the print()
changes).
Manually checked, some modernizations not commited here.
 2014-10-10 23:41:43 +02:00
Romain Bignon
b1f20b5489 fix bcall to to new behavior of do(), and fix QtDo too, and all Qt applications... 2014-10-10 17:34:48 +02:00
Laurent Bachelier
23b4cc909f Add has-class xpath function 
Taken from https://gist.github.com/shirk3y/458224083ce5464627bc
 2014-10-10 10:09:14 +02:00
Florent
c3cbebfeef Add a trivial Android profile 2014-10-10 10:07:47 +02:00
Romain Bignon
22c436bcb8 documentation 2014-10-08 17:10:13 +02:00
Romain Bignon
65ece349db HTMLPage checks the inner charset and parse again document if it is not the same than Content-Type HTTP header 2014-10-08 15:42:58 +02:00
Laurent Bachelier
7be9a6468b logging: Create a new level DEBUG_FILTERS 
This is a cleaner approach that requires less configuration
in other applications.
This also easily allows us to have another color.

Many checks were made on being exactly at the DEBUG level, they were
fixed to also check on being below DEBUG (i.e. DEBUG_FILTERS).
 2014-10-07 17:11:09 +02:00
Laurent Bachelier
822c1a3607 Proper English 2014-10-07 16:47:28 +02:00
Romain Bignon
8508f951f5 fix docstrings and add weboob.browser.* in nosetests 2014-10-07 09:31:10 +02:00
Romain Bignon
c281d7a255 fix doctests 2014-10-07 09:20:07 +02:00
Romain Bignon
d61e15cf84 rename things related to browsers 
weboob.tools.browser -> weboob.deprecated.browser
weboob.tools.parsers -> weboob.deprecated.browser.parsers
weboob.tools.mech -> weboob.deprecated.mech
weboob.browser2 -> weboob.browser
weboob.core.exceptions -> weboob.exceptions

Also, the new tree for browser2 is:

weboob.browser: import weboob.browser.browsers.* and weboob.browser.url.*
weboob.browser.browsers: all browsers (including PagesBrowser and LoginBrowser)
weboob.browser.url: the URL class
weboob.browser.profiles: all Profile classes
weboob.browser.sessions: WeboobSession and FuturesSession
weboob.browser.cookies: that's a cookies thing
weboob.browser.pages: all Page and derivated classes, and Form class
weboob.browser.exceptions: specific browser exceptions
weboob.browser.elements: AbstractElement classes, and 'method' decorator
weboob.browser.filters.*: all filters
 2014-10-07 00:30:07 +02:00