Skip to content

Version 1.3.0
Compare
Choose a tag to compare
@juzraai juzraai released this 09 Dec 18:09
· 72 commits to master since this release
v1.3.0
3f53ad7
  • two download mode: download all, or download one by RCN
  • can download project data page and publication list JSON string
  • detects CORDIS internal error messages
  • retries downloads with increasing sleeps
  • download files into output directory
  • can skip already existing files
  • filename templates can be configured
  • can read RCNs from already downloaded files' names instead of crawling CORDIS list
  • CLI for set up and run crawler
  • file logging
  • can parse all info from project page (IMPROVED)
  • can parse publication list JSON strings (IMPROVED)
  • can export projects' data to CSV file
  • can export all data to MySQL database (NEW)
Assets 4
Loading