- cherrio Fast, flexible & lean implementation of core jQuery designed specifically for the server.
- inquirer A collection of common interactive command line user interfaces.
Clone the repo using Git:
git clone https://github.com/Liar0320/spider.git
Alternatively you can download this repository and then:
npm i npm run start
Timeout for each request.
default value: 15000
The maximum number of threads that exist at one time, that is, the number of asynchronous downloads that are started at the same time.
default value: 20
The number of times the request was re initiated if there was a request failure.
default value: 4
Root of download directory
default value: join(__dirname, ‘./download’)