Dekker1/Fourmi
Archived
1
0
Fork 0
Code

Commit Graph

  • df4ba2f784 changed __init__ of all sources to have an empty dictionary as default config value RTB 2014-06-06 12:48:30 +02:00
  • eb3eee77a0 updated function description for __init__ RTB 2014-06-05 16:50:13 +02:00
  • ff3b81b813 each source now receives a configuration dictionary RTB 2014-06-05 16:30:48 +02:00
  • fb3c760249 sourceloader now reads sources.cfg for source initialization RTB 2014-06-05 16:22:52 +02:00
  • 828928f1dd added sources.cfg to git ignore RTB 2014-06-05 15:55:01 +02:00
  • b5ada123ec Merge branch 'master' of github.com:Recondor/Fourmi Jip J. Dekker 2014-06-05 15:48:39 +02:00
  • 82db78ecbb Merge branch 'release/0.4.2' into develop Jip J. Dekker 2014-06-05 15:46:55 +02:00
  • 34428dd4d8 Merge branch 'release/0.4.2' 0.4.2 Jip J. Dekker 2014-06-05 15:46:49 +02:00
  • b68a4e474b 0.4.2 Jip J. Dekker 2014-06-05 15:46:29 +02:00
  • 31790cc10c Broken script parameter by the code inspector Jip J. Dekker 2014-06-05 15:45:10 +02:00
  • 21d6fbfb2b And again it was a typo Jip J. Dekker 2014-06-04 20:59:13 +02:00
  • 56624e4647 Not yet uploading stats Jip J. Dekker 2014-06-04 20:54:41 +02:00
  • 90b8ac3285 A little typo Jip J. Dekker 2014-06-04 20:35:36 +02:00
  • 7a2ba29e77 Added coverage Jip J. Dekker 2014-06-04 20:17:30 +02:00
  • 75a6b5e345 Merge branch 'develop' into feature/GUI Jip J. Dekker 2014-06-04 19:55:42 +02:00
  • bf1822059f Merge branch 'develop' into feature/PubChem Jip J. Dekker 2014-06-04 19:54:56 +02:00
  • 1e5dbd4fa6 Merge branch 'develop' into feature/executable feature/executable Jip J. Dekker 2014-06-04 19:54:27 +02:00
  • c111e81dc2 Merge branch 'release/0.4.1' into develop Jip J. Dekker 2014-06-04 19:53:20 +02:00
  • 7fdec4bba7 Merge branch 'release/0.4.1' 0.4.1 Jip J. Dekker 2014-06-04 19:53:11 +02:00
  • 9ea8dfbe41 Bumped the version number Jip J. Dekker 2014-06-04 19:52:54 +02:00
  • 3585f7bde7 Merge branch 'develop' into feature/executable Jip J. Dekker 2014-06-04 19:49:12 +02:00
  • 475d7fc865 Merge branch 'feature/testing' into develop Jip J. Dekker 2014-06-04 19:44:50 +02:00
  • 242e0bf628 Code inspection Jip J. Dekker 2014-06-04 19:43:33 +02:00
  • 046fbed3cd Code reformat Jip J. Dekker 2014-06-04 19:34:23 +02:00
  • b3c230e835 Import optimazation Jip J. Dekker 2014-06-04 19:32:41 +02:00
  • e1c01c7af6 Added some documentation for the synonyms request Jip J. Dekker 2014-06-04 19:24:55 +02:00
  • 918d6729b6 Added tests for the Spider Jip J. Dekker 2014-06-04 19:21:44 +02:00
  • eb727bd6c4 No two requests shall be the same! Jip J. Dekker 2014-06-04 19:12:08 +02:00
  • 0c9862d836 Damn you semicolon! Jip J. Dekker 2014-06-04 18:54:29 +02:00
  • f128c54312 Sources don't need to be mangled Jip J. Dekker 2014-06-04 18:34:31 +02:00
  • 1557d17877 Added documentation to the test cases Jip J. Dekker 2014-06-04 18:22:28 +02:00
  • d8fcd70d72 Merge branch 'develop' into feature/executable Jip J. Dekker 2014-06-04 18:05:20 +02:00
  • 86a00b1572 Merge branch 'develop' into feature/PubChem Jip J. Dekker 2014-06-04 18:00:27 +02:00
  • b9a8c65d24 For testing, Fourmi should not be a package Jip J. Dekker 2014-06-04 17:46:33 +02:00
  • 743989edb8 Second badge on a new line Jip J. Dekker 2014-06-04 17:46:03 +02:00
  • 75c0be1fea Added tests for the pipline Jip J. Dekker 2014-06-04 16:50:14 +02:00
  • c48c4ec697 None pipeline doesn't need a set Jip J. Dekker 2014-06-04 16:09:55 +02:00
  • 26702666b6 Added travis notification to the slack channel Jip J. Dekker 2014-06-04 16:06:41 +02:00
  • 291547a5ad now returns good results, with property values and corresponding sources Nout van Deijck 2014-06-04 15:44:53 +02:00
  • 93940c99e7 if/else together, newest version setup.py Jip J. Dekker 2014-06-04 15:29:44 +02:00
  • b6afb3b2b5 Made Fourmi a python package Jip J. Dekker 2014-06-04 15:22:18 +02:00
  • b9252cc3fd Removed name from __init__ file Jip J. Dekker 2014-06-04 15:18:27 +02:00
  • 55130ea388 Added Travis badges to the README Jip J. Dekker 2014-06-04 12:59:22 +02:00
  • 704c5c25de Travis CI (hopefully working settings) Jip J. Dekker 2014-06-04 12:51:15 +02:00
  • c3d2bf92e5 Added tests for the source loader Jip J. Dekker 2014-06-04 12:43:33 +02:00
  • 7a8c0fe6ad Added a basic testing structure Jip J. Dekker 2014-06-04 12:18:15 +02:00
  • d4a0ffdff3 Optimized imports Jip J. Dekker 2014-06-04 12:01:05 +02:00
  • ba8f845178 now also (finally) scrapes property values and names, but not yet coupled together and not yet returned. Nout van Deijck 2014-06-02 09:26:36 +02:00
  • ecee4a5f45 Merge branch 'develop' of github.com:Recondor/Fourmi into develop Jip J. Dekker 2014-06-01 20:30:50 +02:00
  • 3c6412cc05 Merge branch 'feature/code-cleanup' into develop Jip J. Dekker 2014-06-01 20:30:41 +02:00
  • aac0a7c79c References to the main Scrapy documentation Jip J. Dekker 2014-06-01 20:29:51 +02:00
  • f81b1c9500 Fixed a typo Jip J. Dekker 2014-06-01 20:25:46 +02:00
  • f7d0fb4a45 Added documentation to the basic Source Jip J. Dekker 2014-06-01 20:24:54 +02:00
  • c27a875d68 Parser/Source consistency Jip J. Dekker 2014-06-01 20:18:03 +02:00
  • 3499946e97 Fixed a typo Jip J. Dekker 2014-06-01 20:15:15 +02:00
  • c4876f029b Added documentation to the FourmiSpider Jip J. Dekker 2014-06-01 20:14:47 +02:00
  • a040bc7a02 Added documentation for the sourceloader Jip J. Dekker 2014-06-01 20:01:19 +02:00
  • e272c9f342 Changed a parameter name for clarification Jip J. Dekker 2014-06-01 19:55:10 +02:00
  • ca90796904 Added documentation to the Executable Python file Jip J. Dekker 2014-06-01 19:53:37 +02:00
  • 34ca31fc09 Cleaned up code Harmen Prins 2014-05-30 22:26:56 +02:00
  • 6878fadf97 Implemented configuration options Harmen Prins 2014-05-30 17:14:34 +02:00
  • f365e4f09d Added configuration options to GUI Harmen Prins 2014-05-30 17:13:25 +02:00
  • a99acfd008 Merge remote-tracking branch 'origin/develop' into feature/GUI Harmen Prins 2014-05-30 14:58:31 +02:00
  • 91860651e1 Merge branch 'release/0.4.0' into develop Jip J. Dekker 2014-05-23 13:05:25 +02:00
  • 2b21176375 Merge branch 'release/0.4.0' 0.4.0 Jip J. Dekker 2014-05-23 13:05:18 +02:00
  • 7a4696aed4 Tested and pushed version number Jip J. Dekker 2014-05-23 13:05:01 +02:00
  • ace4393a8f Merge branch 'feature/NIST-source' into develop Jip J. Dekker 2014-05-23 13:01:06 +02:00
  • f055ec7548 Merge branch 'release/0.3.1' into develop Jip J. Dekker 2014-05-22 12:20:18 +02:00
  • e7c17ea269 Merge branch 'release/0.3.1' 0.3.1 Jip J. Dekker 2014-05-22 12:20:09 +02:00
  • f80a32a0dc Pushed the version number Jip J. Dekker 2014-05-22 12:19:41 +02:00
  • 0e7e4cbe61 Merge branch 'develop' of github.com:Recondor/Fourmi into develop Jip J. Dekker 2014-05-22 12:17:56 +02:00
  • 98f91a1aa9 Added a pipeline to replace None values with empty strings Jip J. Dekker 2014-05-22 12:15:43 +02:00
  • 8083d0c7bc PubChem scrapes synonyms, gets custom url to get data on properties from Nout van Deijck 2014-05-21 16:11:48 +02:00
  • fb41d772f2 Added custom user-agent because otherwise it would block, because not amused by scraper Nout van Deijck 2014-05-21 16:11:02 +02:00
  • 4b377bb9a9 PubChem now scrapes its synonyms Nout van Deijck 2014-05-21 15:25:55 +02:00
  • 84f2e3dbea Testing search function PubChem Nout van Deijck 2014-05-21 14:53:51 +02:00
  • 6ce5ff2335 replaced name variable with summary variable Rob tB 2014-05-21 10:40:44 +02:00
  • 6cd8edaf22 included summary variable in call to transition_table, antoine table and generic table Rob tB 2014-05-21 10:36:42 +02:00
  • c0af24644b added summary variable in parse() Rob tB 2014-05-21 10:31:19 +02:00
  • 429ffd7422 renamed tables to table in parse() Rob tB 2014-05-21 10:28:54 +02:00
  • 95565042ca removed unused variable symbol_table from parse_transition_table Rob tB 2014-05-21 10:22:03 +02:00
  • 81719a38fb Added comments for the class and functions RTB 2014-05-20 19:32:06 +02:00
  • ae06855f35 changes in sourceloader such that it is possible to create an executable in Windows, also the setup.py file to create the executable Bas Vb 2014-05-20 16:41:06 +02:00
  • 472aae86be synonyms are now scraped RTB 2014-05-17 19:32:20 +02:00
  • b46c7a309d if synonym name matched in search instead of primary name, emit primary name as synonym RTB 2014-05-17 14:21:11 +02:00
  • afc1106838 NIST now logs an error if chemical name is not found RTB 2014-05-17 14:11:03 +02:00
  • 56ee6b1ad3 added ignore list RTB 2014-05-17 14:09:10 +02:00
  • 98f58ea4e2 added scraping for generic info except for synonyms Rob tB 2014-05-15 14:29:28 +02:00
  • 50c79e3b1f conditions in name (split by ' at ') are now moved to condition field for individual value page and aggregate data table Rob tB 2014-05-14 13:44:43 +02:00
  • f728dff6b0 Developing PubChem parser, first draft, not tested nor finished completely Nout van Deijck 2014-05-14 12:01:05 +02:00
  • 719da351b1 Merge branch 'develop' of https://github.com/Recondor/Fourmi into develop Bas Vb 2014-05-14 10:44:22 +02:00
  • af4c2ec7b2 Merge branch 'hotfix/assignees' into develop Jip J. Dekker 2014-05-13 23:44:25 +02:00
  • 5bf7bd824a Merge branch 'hotfix/assignees' assignees Jip J. Dekker 2014-05-13 23:44:08 +02:00
  • ee92e25ab4 Fixed the right assignees Jip J. Dekker 2014-05-13 23:43:37 +02:00
  • d104fc22d7 Merge branch 'release/v0.3.0' into develop Jip J. Dekker 2014-05-13 23:35:46 +02:00
  • 708ce44f67 Merge branch 'release/v0.3.0' v0.3.0 Jip J. Dekker 2014-05-13 23:35:34 +02:00
  • 284d24c783 Bumped the version number Jip J. Dekker 2014-05-13 23:35:12 +02:00
  • 3c32349ab4 Merge branch 'feature/readme-docs' into develop Jip J. Dekker 2014-05-13 23:33:27 +02:00
  • c380b74046 Making things bold, removing breaklines Jip J. Dekker 2014-05-13 23:28:56 +02:00
  • b6ae4977d9 Complete rewrite of the README Jip J. Dekker 2014-05-13 23:26:31 +02:00