Skip to content

AI to empower doctors with real-time insights from your fitness wearable data. Demo - https://devpost.com/software/mosaichealth-ai ๐Ÿ† - Intel Award for Best Use of AI

Notifications You must be signed in to change notification settings

sohampatil17/MosaicHealth-AI

Repository files navigation

Mosiac Health AI

๐Ÿ’ก Inspiration

In a healthcare landscape awash with data, doctors often find themselves submerged under vast oceans of patient information. The critical insights that could transform patient care frequently remain buried. MosaicHealth AI emerges as a beacon of clarity, deftly sifting through this data deluge to highlight the information that truly matters. ๐Ÿš‘๐Ÿ’ก

๐Ÿง™โ€โ™‚๏ธ What it Does

Imagine a world where your fitness wearable isn't just a passive observer but an active participant in your health journey. MosaicHealth AI is that vision brought to life. As doctors and patients engage in conversation, our system listens in, displays key health insights from the patient's wearable data in real-time. This isn't just data collection; it's data revelation, assisting doctors in crafting medical reports with unparalleled precision and insight. ๐Ÿ“Š๐Ÿฉบ

###Intel ODC - Prediction Guard APIs - Secure, compliant LLM
Intel Distribution of Modin - improved inference speed for data analysis on wearable data using Modin
Phi-2 finetuning using IDC and medical dataset - finetuned Phi-2 using one of HF's biggest medical datasets
Submitted to HF leaderboard - submitted Intel optimized model on HF leaderboard
Int8 Quantization of Diaalo-GPT-large using IPEX - (experimentation) faster inference speed after int8 quantization

HuggingFace submission - https://huggingface.co/sohampatil/msphi2-medical

๐Ÿ—๏ธ How We Built It

Understanding the hesitancy doctors have towards AI, we embraced Prediction Guard's HIPAA-compliant LLMs, combining compliance with cutting-edge technology. Though we stuck with PG due to its security, we also finetuned MS Phi-2 using the openlifesciences' medmcqa dataset (MedMCQA is a large-scale, Multiple-Choice Question Answering (MCQA) dataset designed to address real-world medical entrance exam questions) for our medical context๐Ÿ›ก๏ธ๐Ÿง 
Through on-device WebAPIs, we listen patient-doctor dialogues, extracting salient points and meshing them with raw data from Apple Watches, all refined by Intel's Modin library and LLM APIs. ๐ŸโŒš
Then, using PredictionGuard, we combine narrative and numerical health data to generate a detailed medical report. ๐Ÿงฌ๐Ÿ’ป

๐Ÿง—โ€โ™‚๏ธ Challenges We Ran Into

Navigating the labyrinth of medical privacy and data security, we chose Prediction Guard to shield our AI from the pitfalls of non-compliance and the specter of hallucinations, and to make doctors feel safer. ๐Ÿ›ก๏ธ๐Ÿ”’
Bridging the gap between spoken words and LLMs was a formidable challenge + the process of learning model fine-tuning. ๐Ÿค–๐ŸŽญ

๐Ÿคฏ What We Learned

Our journey with MosaicHealth AI has been a profound learning experience, diving deep into the realms of Intel's Developer console, mastering the nuances of JavaScript, and unraveling the complexities of AI fine-tuning. We've harnessed the power of Large Language Models (LLMs) through advanced APIs, gaining invaluable insights and skills along the way.

๐Ÿ† Accomplishments That We're Proud Of

From a spark of an idea to a functioning MVP in a single day!!! ๐ŸŒŸ๐Ÿ› ๏ธ
The fine-tuning of Microsoft Phi-2, leveraging a trove of medical data, stands as a milestone in our journey, marking a leap forward in AI-powered healthcare. ๐Ÿ†๐Ÿงฌ

๐Ÿ”ฎ Next Steps

๐Ÿ›ณ๏ธ๐Ÿ›ณ๏ธ๐Ÿ›ณ๏ธ๐Ÿ›ณ๏ธ ship....

About

AI to empower doctors with real-time insights from your fitness wearable data. Demo - https://devpost.com/software/mosaichealth-ai ๐Ÿ† - Intel Award for Best Use of AI

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •