Skip to content

virink/ArticleCrawler

Repository files navigation

ArticleCrawler

A crawler for lots of articles

Usage

Init

MariaDB

mysql -uroot -p -e 'create database article_crawler;'

Set your config.js

module.exports = {
    database: {
        host: '127.0.0.1',
        port: 3306,
        user: 'root',
        pass: '123456',
        name: 'article_crawler'
    }
}

Crawl

It's not finish Task Manager Module, so just run plugin!

Crawl xz.aliyun.com: node plugins/xz.aliyun.com.js

Preview

yarn run web
// or
node preview.js

Plugins

  • 先知 xz.aliyun.com

LICENSE

MIT

About

A crawler for lots of articles

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published