Jip J. Dekker
|
55dbfa7a5b
|
This method can't be static, we need the cfg file
|
2014-06-21 01:05:34 +02:00 |
|
Jip J. Dekker
|
f0e8ea1dc2
|
Merge branch 'develop' of github.com:Recondor/Fourmi into develop
|
2014-06-20 11:23:50 +02:00 |
|
Jip J. Dekker
|
22ca4afa33
|
Code inspection
|
2014-06-20 11:21:26 +02:00 |
|
RTB
|
98f63a212a
|
modified pubchem.py to use reliability from sources.cfg
|
2014-06-19 22:57:17 +02:00 |
|
RTB
|
2290915209
|
fixed forgotten self.website usage
|
2014-06-19 22:45:01 +02:00 |
|
RTB
|
d7d2a659b1
|
changed https to http in PubChem.py
|
2014-06-19 22:34:53 +02:00 |
|
Jip J. Dekker
|
093eba8b04
|
Other occurences of website REGEX
|
2014-06-19 22:26:16 +02:00 |
|
Jip J. Dekker
|
a3e973ecad
|
Added INFO message when no compatible source on response
|
2014-06-19 22:08:45 +02:00 |
|
Jip J. Dekker
|
27529c414f
|
Fourmi as our USER_AGENT
|
2014-06-19 22:06:55 +02:00 |
|
Jip J. Dekker
|
ef1c319396
|
Escape escape characters
|
2014-06-19 22:05:21 +02:00 |
|
Jip J. Dekker
|
576683dcd0
|
These regular expressions where all wrong
|
2014-06-19 22:01:35 +02:00 |
|
RTB
|
2cefcfdb13
|
made parse_searchrequest function to parse search page and modified new_compound_request accordingly
|
2014-06-19 12:46:09 +02:00 |
|
Jip J. Dekker
|
ad640c5cb3
|
Merge branch 'feature/NIST-cleanup' into develop
Conflicts:
FourmiCrawler/sources/NIST.py
|
2014-06-17 23:49:30 +02:00 |
|
Jip J. Dekker
|
2801ff2d21
|
Merge branch 'feature/ChemSpider-cleanup' into develop
Conflicts:
FourmiCrawler/sources/ChemSpider.py
|
2014-06-17 23:43:56 +02:00 |
|
Jip J. Dekker
|
30f4d09cf9
|
Merge branch 'feature/PubChem' into develop
|
2014-06-17 00:34:04 +02:00 |
|
Jip J. Dekker
|
6e16e9f23e
|
TODO on sppofing user agent
|
2014-06-17 00:33:08 +02:00 |
|
Nout van Deijck
|
4dc557d9e8
|
Finish plugin (comments, log messages, etc)
|
2014-06-17 00:09:17 +02:00 |
|
Jip J. Dekker
|
79cf15b95c
|
Refractoring double code
|
2014-06-15 20:50:00 +02:00 |
|
Jip J. Dekker
|
74e7152d5f
|
A lot of PEP-8 fixes
|
2014-06-15 20:45:35 +02:00 |
|
Jip J. Dekker
|
66f2384747
|
Default arguments can't be mutable
|
2014-06-15 20:41:19 +02:00 |
|
RTB
|
8836cdf16b
|
fixed config errors due to merge with develop
|
2014-06-11 18:39:01 +02:00 |
|
Nout van Deijck
|
830b785b0a
|
trying to merge pubchem with develop cause fourmi on my current branch was broken
|
2014-06-11 17:36:17 +02:00 |
|
Nout van Deijck
|
f104740566
|
cleaned up useless code
|
2014-06-11 16:39:00 +02:00 |
|
Bas Vb
|
a1859f2ec2
|
final documentation
|
2014-06-10 22:46:50 +02:00 |
|
Bas Vb
|
de474fea31
|
small fixes
|
2014-06-10 22:42:45 +02:00 |
|
Bas Vb
|
e9a5fc08e5
|
Splitting up parse function
|
2014-06-10 22:41:32 +02:00 |
|
Bas Vb
|
6621b3028c
|
small typography
|
2014-06-10 22:32:03 +02:00 |
|
Bas Vb
|
bfa78f4697
|
Clean up documentation in Wikipedia parsers
|
2014-06-10 22:30:59 +02:00 |
|
RTB
|
0fab626a55
|
moved import and removed TODO
|
2014-06-10 14:07:02 +02:00 |
|
RTB
|
b4a724392b
|
moved scraping of experimental data tab to its own function
|
2014-06-10 14:04:39 +02:00 |
|
RTB
|
41bbe5b1de
|
moved scraping of Predicted - ACD/Labs tab to its own function
|
2014-06-10 13:57:10 +02:00 |
|
RTB
|
5e13af5b1b
|
added function comments to ChemSpider
|
2014-06-10 13:42:49 +02:00 |
|
RTB
|
a15a66cc77
|
made get_unit function
|
2014-06-10 13:13:24 +02:00 |
|
RTB
|
7879d523ec
|
removed unneeded class variable cfg
|
2014-06-10 13:02:39 +02:00 |
|
RTB
|
1b7c0b44a9
|
moved identifying and distribution of parsing of tables to a new function parse_tables
|
2014-06-10 13:01:47 +02:00 |
|
RTB
|
9c34267fb1
|
added function comments to NIST
|
2014-06-10 12:49:00 +02:00 |
|
RTB
|
806b816c30
|
removed test for existence of reliability in config from WikipediaParser init
|
2014-06-08 19:31:34 +02:00 |
|
RTB
|
bbc9abadb8
|
removed test for existence of reliability in config from NIST init
|
2014-06-08 19:30:59 +02:00 |
|
RTB
|
f01ff62d99
|
removed test for existence of reliability in config from chemspider init
|
2014-06-08 19:30:05 +02:00 |
|
RTB
|
a6fb27f8a7
|
the difference between class and object variables...
|
2014-06-08 19:29:29 +02:00 |
|
Jip J. Dekker
|
cbab2ac7a4
|
The difference between class and object variables
|
2014-06-07 12:21:00 +02:00 |
|
RTB
|
012267c31c
|
fixed result in parse_aggregate_data
|
2014-06-06 23:32:03 +02:00 |
|
RTB
|
a12add5e4c
|
removed @staticmethod from parse_extendedinfo
|
2014-06-06 23:29:32 +02:00 |
|
RTB
|
4eeabd7aba
|
removed erronous @staticmethod for parse_properties
|
2014-06-06 23:16:22 +02:00 |
|
RTB
|
5b871de987
|
Merge branch 'feature/sources-configuration' of github.com:Recondor/Fourmi into feature/sources-configuration
|
2014-06-06 23:11:53 +02:00 |
|
Jip J. Dekker
|
c9f902993c
|
Merge branch 'develop' into feature/sources-configuration
|
2014-06-06 22:31:49 +02:00 |
|
Jip J. Dekker
|
321295a395
|
Fixed the synonym requests function for the start requests
|
2014-06-06 22:22:29 +02:00 |
|
RTB
|
30f00b676d
|
updated parse to use newresult function
|
2014-06-06 20:16:25 +02:00 |
|
RTB
|
69664d3ac0
|
added newrresult function to WikipediaParser.py
|
2014-06-06 19:30:31 +02:00 |
|
RTB
|
68139b4839
|
added config to wikipedia along with reliability check
|
2014-06-06 19:27:27 +02:00 |
|