Commit graph

85 commits

Author SHA1 Message Date
Florent
4e6333fbcd Do not crash if an input does not have any type 2014-03-20 11:51:03 +01:00
Romain Bignon
0a53824104 URL.open and URL.go can take 'params' argument 2014-03-20 07:48:23 +01:00
Romain Bignon
5e4337a0cb fix crash 2014-03-20 07:48:16 +01:00
Bezleputh
06cee506f9 [browser2] Add JsonPage 2014-03-20 00:45:19 +01:00
Bezleputh
1114dbd516 [browser2] Add an "open" method in order to open an url without changing the current URL 2014-03-20 00:40:55 +01:00
Bezleputh
4f4d08ec33 [browser2] Allow to import Profile 2014-03-20 00:40:55 +01:00
Romain Bignon
e217b24427 add a default value for Time/Duration 2014-03-19 20:45:39 +01:00
Romain Bignon
e3cbda5dc8 Link inherits Attr 2014-03-19 20:45:24 +01:00
Romain Bignon
06d1907d3d add filter Duration 2014-03-19 20:27:22 +01:00
Romain Bignon
16615dd337 correctly save file content with -a 2014-03-19 20:27:09 +01:00
Romain Bignon
5fb0aad01e fix crash in multithread environment 2014-03-19 18:56:39 +01:00
Florent
0362821fb6 Introduce the new Attr filter 2014-03-19 16:46:46 +01:00
Florent
ae3471fdf7 Rename Attr filter to Field 2014-03-19 16:20:24 +01:00
Florent
a34f8ec997 Return NotAvailable if NotAvailable was given 2014-03-19 16:15:49 +01:00
Romain Bignon
3013ddbda5 add Map, Date and Time filters 2014-03-19 13:50:54 +01:00
Romain Bignon
fe4dbf8698 consider select and textarea fields in forms 2014-03-19 12:19:00 +01:00
Florent
c4dfb49033 CleanChars is now an option of CleanText 2014-03-18 17:08:30 +01:00
Florent
207c5d9b41 Display the text if the regexp does not match 2014-03-18 16:24:10 +01:00
Florent
081d4f32f0 Introduce CleanChars filter 2014-03-18 16:23:51 +01:00
Romain Bignon
ec3af7bfab remove dependencie to weboob.tools.parsers 2014-03-17 21:43:57 +01:00
Johann Broudin
7621da74e6 change max_retries to 2 2014-03-14 12:30:55 +01:00
Johann Broudin
7f82f45e70 correct the usage of proxy, timeout and ssl verification in browser2 2014-03-14 12:30:55 +01:00
Laurent Bachelier
9146f2f312 Save request/response metadata with as much info as possible 2014-03-14 01:53:49 +01:00
Laurent Bachelier
3a9bc80f8a Saving cookies for debug isn't very interesting
We have them in headers in a clearer way, at least for the purpose of
debugging.
Showing new cookies as they appear could be done, though.
2014-03-14 01:53:49 +01:00
Laurent Bachelier
058cafe69e Save headers of response and request 2014-03-14 01:53:49 +01:00
Laurent Bachelier
6acfd75780 Save cookies on save_responses and pave the way for more good stuff
We apparently can't override the class in the Response, even if it is
changed in the Session. Still, it will be useful to have our own class.
2014-03-14 01:53:49 +01:00
Laurent Bachelier
95e71e329b Better filenames for save responses 2014-03-14 01:53:49 +01:00
Romain Bignon
a74b31df33 several of little fixes 2014-03-14 00:19:08 +01:00
Romain Bignon
16742dc9aa able to set None as default value on filters 2014-03-14 00:19:05 +01:00
Bezleputh
2673b3a340 fix rename error 2014-03-14 00:19:15 +01:00
Romain Bignon
266300ab65 add UrlNotResolvable exception when URL.build can't resolve url with keywords 2014-03-13 22:06:47 +01:00
Laurent Bachelier
fca0ab8733 Quick and dirty -a and -I support for Browser2 2014-03-13 22:04:20 +01:00
Romain Bignon
d472fd6eec fix crash 2014-03-13 21:45:34 +01:00
Romain Bignon
4cffb3038b raise errors on responses 2014-03-13 21:34:18 +01:00
Romain Bignon
9724dcf461 add URL.id2url decorator 2014-03-13 21:27:59 +01:00
Romain Bignon
bf8675c88b PagesBrowser.open and PagesBrowser.location always return a Response object 2014-03-13 21:27:59 +01:00
Bezleputh
eefe784352 [browser2] put ListElement call parameters in self.param 2014-03-13 20:20:03 +01:00
Bezleputh
7d59640712 [browser2] add a validate method in order to check objet before returning him 2014-03-13 20:20:03 +01:00
Johann Broudin
0f1726d01c add ssl proxy support to browser and browser2 and add the option _proxy_ssl 2014-03-13 20:20:02 +01:00
Johann Broudin
cafd6c8f05 Add proxy support to browser2 2014-03-13 20:20:02 +01:00
Laurent Bachelier
1e5f5940c5 Split _open() to allow request customization 2014-03-13 19:01:56 +01:00
Laurent Bachelier
b07da18081 More updates and cleanups for new requests 2014-03-13 18:07:17 +01:00
Laurent Bachelier
5711158f80 Require python-requests version 2014-03-13 17:53:01 +01:00
Laurent Bachelier
eb54528b95 Update Firefox to latest ESR 2014-03-13 17:36:44 +01:00
Laurent Bachelier
62e5d23f23 Another python-requests bug fixed in newer versions! 2014-03-13 17:32:45 +01:00
Laurent Bachelier
82c61f3668 Cleanups due to the usage of python-requests>=2.0 2014-03-13 17:18:26 +01:00
Romain Bignon
ecd3a9c5ab handle Refresh HTTP header 2014-03-12 23:41:08 +01:00
Romain Bignon
04b7a9d572 force referer when submitting a form 2014-03-12 23:41:06 +01:00
Romain Bignon
7edf5e488a add result 2014-03-12 21:15:30 +01:00
Romain Bignon
a4167194f0 add Regexp filter 2014-03-12 21:10:40 +01:00