Jip J. Dekker
|
a3e973ecad
|
Added INFO message when no compatible source on response
|
2014-06-19 22:08:45 +02:00 |
|
Jip J. Dekker
|
74e7152d5f
|
A lot of PEP-8 fixes
|
2014-06-15 20:45:35 +02:00 |
|
Jip J. Dekker
|
66f2384747
|
Default arguments can't be mutable
|
2014-06-15 20:41:19 +02:00 |
|
Jip J. Dekker
|
cbab2ac7a4
|
The difference between class and object variables
|
2014-06-07 12:21:00 +02:00 |
|
Jip J. Dekker
|
321295a395
|
Fixed the synonym requests function for the start requests
|
2014-06-06 22:22:29 +02:00 |
|
Jip J. Dekker
|
eb727bd6c4
|
No two requests shall be the same!
|
2014-06-04 19:12:08 +02:00 |
|
Jip J. Dekker
|
0c9862d836
|
Damn you semicolon!
|
2014-06-04 18:54:29 +02:00 |
|
Jip J. Dekker
|
f128c54312
|
Sources don't need to be mangled
|
2014-06-04 18:34:31 +02:00 |
|
Jip J. Dekker
|
c27a875d68
|
Parser/Source consistency
|
2014-06-01 20:18:03 +02:00 |
|
Jip J. Dekker
|
3499946e97
|
Fixed a typo
|
2014-06-01 20:15:15 +02:00 |
|
Jip J. Dekker
|
c4876f029b
|
Added documentation to the FourmiSpider
|
2014-06-01 20:14:47 +02:00 |
|
Jip J. Dekker
|
2fcec009bb
|
Added an Pipeline to deal with attribute selection
|
2014-05-08 15:20:48 +02:00 |
|
Jip J. Dekker
|
90f03734a6
|
Refractored classname
|
2014-04-23 15:57:10 +02:00 |
|
Jip J. Dekker
|
ffb3861034
|
Search for single compound, filename should be lowercase
|
2014-04-15 18:49:30 +02:00 |
|
Jip J. Dekker
|
da17a149c0
|
Spider is now able to handle none-request from parsers while handling new
compounds
|
2014-04-08 11:42:43 +02:00 |
|
Jip J. Dekker
|
f6981057df
|
Changed everything to spaces
|
2014-04-02 14:20:05 +02:00 |
|
Jip J. Dekker
|
7bc160f676
|
The spider is now able to start using the synonym generator
|
2014-04-01 21:38:11 +02:00 |
|
Jip J. Dekker
|
683f8c09d4
|
Quick fix, python errors
|
2014-04-01 21:12:54 +02:00 |
|
Jip J. Dekker
|
f93dc2d160
|
Added an structure to get requests for all websites for a new synonym
|
2014-04-01 21:07:36 +02:00 |
|
Jip J. Dekker
|
e39ed3b681
|
Added a way for parsers to access the spider.
|
2014-04-01 20:56:32 +02:00 |
|
Jip J. Dekker
|
4d9e5307bf
|
Written an loader for all parsers in the parser directory.
|
2014-03-31 00:48:45 +02:00 |
|
Jip J. Dekker
|
0cc1b23353
|
Added the functionality to add parsers and automatically use them.
|
2014-03-30 23:37:42 +02:00 |
|
Jip J. Dekker
|
14c27458fc
|
Fixed an import error
|
2014-03-30 23:07:28 +02:00 |
|
Jip J. Dekker
|
32cedecf2e
|
Added an basic parser class to extend, next step implementing the global function
|
2014-03-28 14:44:17 +01:00 |
|
Jip J. Dekker
|
87d1041517
|
Made all Python files PEP-8 Compatible
|
2014-03-28 14:11:36 +01:00 |
|
Jip J. Dekker
|
8e9314e753
|
One spider should have it's own folder
|
2014-03-27 13:18:55 +01:00 |
|