Experimental Microservices for Data Adquisition using Web Scrapping

Features 🛠️

• React Hooks

• Server Side Rendering with Nextjs

• WebScrapping based on Cheerio library

• Universal/Isomorphic Javascript

• Microservices accesible as REST endpoints

• Typescript

Demo

• https://webscrapping-microservices.vercel.app/

Run and build

# install dependencies
$ npm install

# list available scripts
$ npm run

# serve with hot reload at localhost:3000
$ npm run dev

# build for production
$ npm run build

# Run production build
$ npm run start

# Compile API docs in doc directory
$ npm run gen:doc

Endpoints

• https://webscrapping-microservices.vercel.app/api/extract-text?url=

• https://webscrapping-microservices.vercel.app/api/github-trending-repos

API Docs

• Documentation

Audit

• Link