KnowHax CollabNext Challenge

Prerequisites

Python

This code base is compatible with python 3.11 and above. To install python on your system a tool like pyenv is convenient. Once pyenv is installed you can install the python version for this project by running:

pyenv install 3.11.4

Node

This code base is compatible with node 18 and above. Please use these instructions to install node for your operating system if needed.

Git

Please follow the instructions on GitHub to install git on your system.

Poetry

Please follow the instructions on the Poetry website to install poetry on your system.

Getting Started

After cloning this repo for the first time you need to create a virtual environment:

python -m venv .venv

And activate it or choose it as the python environment for the project in your IDE.

source .venv/bin/activate

You can then install project dependencies as follows:

poetry install

You need a .env file to store secrets and other environment variables as follows:

[email protected]
INSTITUTIONS_FETCH_FILTER=hbcus
INSTITUTIONS_FETCH_COUNT=5

The OPENALEX_EMAIL secret is used to speed up calls to the OpenAlex REST API.

INSTITUTIONS_FETCH_FILTER (allowed values = hbcus or howardu) is used to configure which institutions will be fetched from the OpenAlex API and saved to observable/docs/data/institutions.json.

INSTITUTIONS_FETCH_COUNT determines how many institutions will be loaded in the application.

NOTE: INSTITUTIONS_FETCH_FILTER and INSTITUTIONS_FETCH_COUNT are only used when running fetch_custom_institutions.py as a script. When using invoke fetch the default values of hbcus and 5 are used respectively.

Running

This project uses Observable Framework. You can run the site locally in development mode as follows

invoke install
invoke dev

The homepage will be launched in your browser at http://127.0.0.1:3000

Deploying

Deployments to this project on the Observable Cloud take place through the Deploy GitHub Action whenever new commits are added to the main branch or manually through the GitHub UI.

Invoke Commands

You can run various other commands using invoke as follows.

Fetch first 5 HBCUs institutions data from the OpenAlex API and save it to observable/docs/data/institutions.json:

invoke fetch

Deploy the site to Observable Cloud:

invoke deploy

Build the static web site locally:

invoke build

Manually case a graph.json refresh. This is needed because currently observable framework doesn't notice if a dependent python module has been changed when developing. It only monitors changes to the particular page that is being displayed.:

invoke touch

Delete local git branches that have already been merged:

invoke clean-branches