Commit graph

530 commits

Author SHA1 Message Date
Romain Bignon
d15e2ab65e fix recursive loop 2011-05-16 10:36:58 +02:00
Romain Bignon
908e32a713 fix command 'inspect' to don't crash if there isn't any browser 2011-05-12 15:02:40 +02:00
Romain Bignon
c6443b9725 fix when lefigaro's feed is wrong 2011-05-11 16:50:07 +02:00
Romain Bignon
5f3c429e83 oops, fix call to fill_thread 2011-05-11 16:21:07 +02:00
Romain Bignon
5f6744cfe7 support fill of threads 2011-05-11 11:57:26 +02:00
Romain Bignon
72850a0a79 move GenericBackend and GenericArticle modules into weboob.tools.capabilities.messages 2011-05-11 11:54:33 +02:00
Romain Bignon
c9ddbec134 fix for python2.5 2011-05-10 16:26:26 +02:00
Romain Bignon
1dafee2b47 move repl code from ConsoleApplication to ReplApplication 2011-05-08 18:13:05 +02:00
Romain Bignon
2825ff643b pylint fixes 2011-05-08 17:51:06 +02:00
Romain Bignon
daa524d75d 'ls' and 'cd' are now weboob commands 2011-05-08 17:25:32 +02:00
Romain Bignon
c587ce65b0 weboob-config can't be run in interactive mode anymore 2011-05-08 14:38:54 +02:00
Romain Bignon
cb1478f455 check exception attribute (closes #581) 2011-05-08 13:56:00 +02:00
Laurent Bachelier
05a6bb79e4 Also log redirects when saving responses and debugging (refs #398)
set_debug_responses is not needed as we already save the responses in a
better way.
2011-05-08 13:55:41 +02:00
Romain Bignon
dc15310118 don't crash if unit is not found 2011-05-08 11:37:48 +02:00
Romain Bignon
c159a5d43e command 'ls' always refetch objects 2011-05-07 14:23:47 +02:00
Laurent Bachelier
3154d7f79d Do not prompt to add backends if not in an interactive session 2011-05-06 00:57:03 +02:00
Laurent Bachelier
56fe4448d3 Switch back to running tests for one backend only
This seems to cause unpredictable failures with pastebin (at least).
Tests will have the backends attribute if they really want to tests all
backends at once. For now, one backend is chosen for each run (and since
tests are ran often, it will cover all backends eventually.) The backend
instance name is displayed to ease the debugging.
2011-05-04 23:18:29 +02:00
Laurent Bachelier
8075d538f0 Better messages and return codes in applications
Use stderr and return codes >0 when it makes sense.
Loose return code conventions:
* 1 for generic errors
* 2 for user input errors
* 3 for remote errors (not found, etc.)
* 4 for not implemented
2011-05-04 00:44:43 +02:00
Romain Bignon
f603c44d6c fix iter_caps() to not return only immediate base cap classes 2011-05-03 16:11:14 +02:00
Romain Bignon
cb53bb6514 thanks pyflakes 2011-05-03 13:45:12 +02:00
Roger Philibert
432db07599 fix rate limiting 2011-05-03 02:52:54 +02:00
Noe Rubinstein
afe5db74b4 Put Thumbnail in a tools.capabilities 2011-05-03 02:52:38 +02:00
Roger Philibert
c74362edb7 Improve EHentai backend 2011-05-03 02:22:49 +02:00
Laurent Bachelier
aa939ca2bd Support testing with multiple backend instances
This is useful for testing backends with different configurations
(different sites, being anonymous or not, etc.)
The previous behavior was to chose a random backend instance.
2011-05-02 02:05:14 +02:00
Laurent Bachelier
740e7f12d2 pastebin backend: Support login
Also add an option to Browser to avoid making useless requests.
2011-04-30 22:28:03 +02:00
Laurent Bachelier
a9220c96af Add tools.capabilities.paste tools for building Paste Backends
It will provide useful functions but as it imposes on the structure of
the backends, it will not be put straight into the Paste capability.
2011-04-29 23:27:10 +02:00
Romain Bignon
fa37ef38e3 fix to remove fucking hack from feedparser >= 5.0 (closes #649) 2011-04-24 16:58:20 +02:00
Laurent Bachelier
5ac2de43d7 Try to import Python's OrderedDict
There is an OrderedDict in Python 2.7+.
The try order is now as follows:
* OrderedDict from Python's collections module
* OrderedDict from the jsonencode module (dependency)
* OrderedDict from the ordereddict module (pypi package)
* our own OrderedDict
2011-04-23 23:55:12 +02:00
Romain Bignon
923c2ffc84 remove dead code 2011-04-23 09:04:41 +02:00
Laurent Bachelier
2c6d5d4e70 Fix previous commit on domain checking of id2url
* the condition on empty self.DOMAIN didn't work
* it introduced a regression as subdomains were accepted by the old code
2011-04-22 10:37:30 +02:00
Laurent Bachelier
7bf794b7e5 Add missing fillobj() call on get_object
fillobj was only called when getting previously fetched objects in
interactive mode.
This probably wasn't detected because most get_* backend functions
usually fill a lot of fields by themselves.
2011-04-21 22:59:30 +02:00
Laurent Bachelier
4d8030b8dd Add check_url decorator, remove check_domain
check_domain was not used anywhere and was bugged (the domain argument
was ignored in favor of self.DOMAIN).
The check_url decorator checks if the URL can be handled, if not it will
return None. The idea is to avoid making unnecessary requests.
2011-04-21 22:18:17 +02:00
Laurent Bachelier
619b97669d Enhance domain checking of url2id
* Do not check for the domain if it is empty in the Browser class
* Better check of the domain (actually parse the URL domain)
* Add docstring
2011-04-21 20:15:18 +02:00
Romain Bignon
7098e44d9b use CapResources for radios 2011-04-21 12:07:37 +02:00
Laurent Bachelier
31b4892c48 Add support for https in the id2url decorator 2011-04-21 11:03:01 +02:00
Romain Bignon
c28d5a99c1 factorize ls and cd in ReplApplication 2011-04-21 11:01:50 +02:00
Nicolas Duhamel
0f53a02947 Introduce tostring function 2011-04-20 09:26:33 +02:00
Nicolas Duhamel
82afb34f7a Use Path object 2011-04-20 09:26:33 +02:00
Nicolas Duhamel
6b3ac71621 mediaplayer fix license 2011-04-20 09:26:32 +02:00
Nicolas Duhamel
8671361ede fix mediaplayer 2011-04-20 09:26:32 +02:00
Christophe Benz
a329bd3d1e Remove fragment from URLs (closes #636). 2011-04-14 16:19:51 +02:00
Laurent Bachelier
e5597424fc Add an option to change the default factory
Changing the factory is the recommended method in the FAQ for handling
invalid HTML.
2011-04-14 16:19:50 +02:00
Laurent Bachelier
92fc86a033 Add support for xpath in LxmlHtmlParser.select
The returned results are similar to those of the cssselect method
so there wasn't much to do except calling it.
2011-04-12 01:00:28 +02:00
Laurent Bachelier
39bfdade27 Use the lowercase http_proxy environment variable
The 'correct' way is to have it lowercase, though there is a lot of
confusion around it.
2011-04-09 15:40:23 +02:00
Romain Bignon
9afb301ebe move select() in parser 2011-04-09 11:25:13 +02:00
Romain Bignon
7e2bb91b3b change license to AGPLv3+ 2011-04-08 12:48:07 +02:00
Romain Bignon
3aa286fb94 factorize code to check loaded backends 2011-04-05 08:45:15 +02:00
Juke
4515541639 new backend ecrans (closes #591) 2011-03-25 23:31:43 +01:00
Juke
18281b2013 change user agent (closes #580) 2011-03-22 21:48:39 +01:00
Romain Bignon
9e6153a16c new function 'limit' to limit the number of iterations 2011-03-21 13:34:32 +01:00