Commit graph

44 commits

Author SHA1 Message Date
Florent
feb1405813 bump to 1.1 2014-10-17 14:10:38 +02:00
Laurent Bachelier
f4c17cdc9d pep8: Fix E303 too many blank lines 2014-10-11 02:15:28 +02:00
Laurent Bachelier
21e8f82fd7 pep8: Use "X not in Y" instead of "not X in Y"
flake8 --select E713, semi-manual fixing
2014-10-11 01:27:24 +02:00
Laurent Bachelier
448c06d125 pep8 blank lines fixes
flake8 --select W391,E302,E301,E304

autopep8 can't fix W391 even though it claims it can.
Fixed using a simple custom script.
2014-10-10 23:41:44 +02:00
Romain Bignon
d61e15cf84 rename things related to browsers
weboob.tools.browser -> weboob.deprecated.browser
weboob.tools.parsers -> weboob.deprecated.browser.parsers
weboob.tools.mech -> weboob.deprecated.mech
weboob.browser2 -> weboob.browser
weboob.core.exceptions -> weboob.exceptions

Also, the new tree for browser2 is:

weboob.browser: import weboob.browser.browsers.* and weboob.browser.url.*
weboob.browser.browsers: all browsers (including PagesBrowser and LoginBrowser)
weboob.browser.url: the URL class
weboob.browser.profiles: all Profile classes
weboob.browser.sessions: WeboobSession and FuturesSession
weboob.browser.cookies: that's a cookies thing
weboob.browser.pages: all Page and derivated classes, and Form class
weboob.browser.exceptions: specific browser exceptions
weboob.browser.elements: AbstractElement classes, and 'method' decorator
weboob.browser.filters.*: all filters
2014-10-07 00:30:07 +02:00
Romain Bignon
be7d49312d add check to prevent prints in weboob modules 2014-10-06 17:22:37 +02:00
Laurent Bachelier
74a4ef6723 Use the print function everywhere
python modernize.py --no-six -f libmodernize.fixes.fix_print -w

With manual fixes as the import was put always on top.
2014-10-06 17:00:17 +02:00
Florent
0088013ae1 Rename BaseBrowser to Browser 2014-09-26 10:18:12 +02:00
Florent
444d36eee8 Rename BasePage to Page 2014-09-26 10:18:12 +02:00
Florent
5a1d83b567 Rename BaseModule to Module and Module to LoadedModule 2014-09-26 10:18:12 +02:00
Florent
f3aeddffbc Rename backend.py to module.py 2014-09-26 10:18:12 +02:00
Florent
9370b2fae7 s/Backend/Module 2014-09-26 10:18:11 +02:00
Florent
3ecb491c1c s/BACKEND/MODULE/ 2014-09-26 10:18:11 +02:00
Florent
8559af3d6a s/BaseBackend/BaseModule 2014-09-26 10:18:11 +02:00
Laurent Bachelier
3da02fde24 Remove useless __all__ in modules
They bring nothing of value (we never use import * anyway) and introduce
a maintenance burden.

The __all__ that I left might not be very useful either but at least
they are not a pain to maintain; they are also used by pyflakes in some
cases.
2014-09-09 19:00:02 +02:00
Florent
432f97e95c bump to 1.0 2014-09-03 17:14:10 +02:00
Romain Bignon
f3ee34dab4 remove unused import of ControlNotFoundError 2014-08-30 18:01:49 +02:00
Romain Bignon
e025fb0b20 rename ICap to Cap (closes #1424) 2014-07-05 17:33:44 +02:00
Florent
9ca0bbae6a bump to 0.j 2014-05-19 22:45:35 +02:00
Florent
a82f57512c bump to 0.i 2014-01-08 23:40:16 +01:00
Romain Bignon
baeac9a9cb modify gdcvault module to use the new BaseVideo/ICapVideo classes 2013-12-22 22:37:35 +01:00
Pierre Mazière
dae97bd278 modify gdcvault module to use the new BaseVideo/ICapVideo classes 2013-12-22 20:04:53 +01:00
Florent
9b022b2ebe bump to 0.h 2013-08-03 14:31:13 +02:00
Romain Bignon
b99d599aa9 remove parameter max_results from all capabilities 2013-07-27 23:40:24 +02:00
Laurent Bachelier
a6ad7e83ff Use newer form of catching exceptions
autopep8 -i --select=W602
Also some other minor deprecated syntax changes, like "while 1".
I did not commit the less obvious changes.
2013-07-27 15:16:16 +02:00
Romain Bignon
c0740e695d remove useless import of with_statement (we do not support anymore python2.5)
refs #806
2013-07-27 14:38:18 +02:00
François Revol
69505f312a gdcvault: only log out when actually logged in 2013-05-29 13:47:11 +02:00
Laurent Bachelier
13026702bd Whitespace 2013-04-03 19:04:55 +02:00
Florent
9484099a1d bump to 0.g 2013-03-26 18:31:12 +01:00
François Revol
26e2fc986e gdcvault: cleanup 2013-03-25 17:07:27 +01:00
François Revol
4b8e65c7e3 gdcvault: Fix flakes warnings 2013-03-25 17:07:26 +01:00
François Revol
b55812c5a2 gdcvault: Fix various weird cases
* comment out or remove some debug prints
* try to cope with non-UTF-8 title passed (1013483).
Couldn't get it to be recoded yet.
* handle boggus url to xml config file (http:/...) (1015020)
* handle iframes with page name different than 'player.html' (1013798)
* handle xml config filenames with spaces (1441)
* catch xml config names with 'smil' as hostname, which means speakervideo
points to a smil file describing the streams, and take the file with the
highest bitrate
* account for xml config with only valid slidesvideo (1016627) and use it
as fallback
* handle configs with 'Invalid Date' as date text (1016634)

We can now dump the entire gdcvault video files urls with a few exceptions
(403 HTTP errors), and many /mediaProxy.php urls failing to redirect, which
are still to be investigated.
2013-03-25 17:07:26 +01:00
François Revol
6f089c795e gdcvault: Do not set a default extension
Due to the redirecting pages we cannot be sure of the extension,
so better not lie.
2013-03-25 17:07:26 +01:00
François Revol
5f87aa2444 gdcvault: Handle pages with redirects to files
For some entry the /play/ page is a redirect to the file.
This is quite hackish but seems to work.
2013-03-25 17:07:26 +01:00
François Revol
38b80491f1 gdcvault: Implement searching; partial download fix
* Implement search functionality, using POST to get JSON data
* Fix download for most items even for non-free ones.
For now only missing are non-free mp3 files it seems (like 769),
/mediaProxy.php returns 2bytes html crap.
2013-03-22 16:45:45 +01:00
François Revol
c8685b8e3b gdcvault: implement all 4 media types
* We now retrieve correctly all 4 media types:

** Video (plain flv file)
ex: http://gdcvault.com/play/29

** Audio (mp3)
ex: http://gdcvault.com/play/22/From-One-off-to-Franchise

** Slides (pdf, not really a video but they download fine)
ex: http://gdcvault.com/play/1015486

** DS Video (dual screen, two flv files) (by default the speaker file,
but id#slides gets the other video (however default filenames conflict)
ex: http://gdcvault.com/play/1015841
2013-03-22 16:45:43 +01:00
Florent
6a7bc0924d Add BrowserBanned in import 2013-03-18 11:15:19 +01:00
François Revol
667879518a gdcvault: use is_on_page() call
Signed-off-by: François Revol <revol@free.fr>
2013-03-18 11:14:01 +01:00
François Revol
8a07b7a9ce gdcvault: implement login
* since there is a limited number of usable concurrent sessions
we force a logout on exit.

Signed-off-by: François Revol <revol@free.fr>
2013-03-18 11:13:36 +01:00
Laurent Bachelier
7094931c92 Easy spacing fixes, trailing stuff
Remove useless trailing \
Remove trailing spaces
Add missing empty lines

autopep8 -ir -j2 --select=E301,E302,E502,W291,W293,W391 .

Diff quickly checked.
2013-03-16 00:54:55 +01:00
Laurent Bachelier
c21d1f7925 Code clarity fixes
autopep8 -ir -j2 --select=E303,E125
Diff checked manually.
2013-03-16 00:52:43 +01:00
Florent
bf3132e8c0 bump to 0.f 2013-01-25 17:23:49 +01:00
Romain Bignon
4a1e4b5afa bump to 0.e 2012-10-28 20:39:49 +01:00
François Revol
d24ca46ef6 Add a video module for gdcvault.com
For now it only fetches the speaker video, but each page can have
both a speaker and slides video feed.
TODO: search

Signed-off-by: François Revol <revol@free.fr>
Signed-off-by: Romain Bignon <romain@symlink.me>
2012-09-01 09:29:39 +02:00