knotgrass / attention Star 29 Code Issues Pull requests several types of attention modules written in PyTorch transformers pytorch transformer attention attention-mechanism softmax-layer multi-head-attention multi-query-attention grouped-query-attention scale-dot-product-attention Updated May 13, 2024 Python
reshalfahsi / image-captioning-mobilenet-llama3 Star 2 Code Issues Pull requests Image Captioning With MobileNet-LLaMA 3 nlp cnn pytorch transformer image-captioning image-text flickr8k-dataset mobilenetv3 pytorch-lightning kv-cache rotary-position-embedding grouped-query-attention rms-norm llama3 Updated May 5, 2024 Jupyter Notebook