We build a proof of concept for your problem for 5,000–8,000€. You get a tangible demo instead of slides with promises.
NYU Langone Health, a leading academic medical center, faced significant hurdles in leveraging the vast amounts of unstructured clinical notes generated daily across its network. Traditional clinical predictive models relied heavily on structured data like lab results and vitals, but these required complex ETL processes that were time-consuming and limited in scope.[1] Unstructured notes, rich with nuanced physician insights, were underutilized due to challenges in natural language processing, hindering accurate predictions of critical outcomes such as in-hospital mortality, length of stay (LOS), readmissions, and operational events like insurance denials.[6]
Clinicians needed real-time, scalable tools to identify at-risk patients early, but existing models struggled with the volume and variability of EHR data—over 4 million notes spanning a decade. This gap led to reactive care, increased costs, and suboptimal patient outcomes, prompting the need for an innovative approach to transform raw text into actionable foresight.[2]
To address these challenges, NYU Langone's Division of Applied AI Technologies at the Center for Healthcare Innovation and Delivery Science developed NYUTron, a proprietary large language model (LLM) specifically trained on internal clinical notes. Unlike off-the-shelf models, NYUTron was fine-tuned on unstructured EHR text from millions of encounters, enabling it to serve as an all-purpose prediction engine for diverse tasks.[6]
The solution involved pre-training a 13-billion-parameter LLM on over 10 years of de-identified notes (approximately 4.8 million inpatient notes), followed by task-specific fine-tuning. This allowed seamless integration into clinical workflows, automating risk flagging directly from physician documentation without manual data structuring.[3] Collaborative efforts, including AI 'Prompt-a-Thons,' accelerated adoption by engaging clinicians in model refinement.[4]
We build a proof of concept for your problem for 5,000–8,000€. You get a tangible demo instead of slides with promises.
Implementation began with curating a massive dataset of de-identified clinical notes from NYU Langone's EHR system, encompassing over 10 years of data and nearly 4.8 million inpatient notes. This dataset, totaling billions of tokens, was processed to train the foundational NYUTron LLM, a 13-billion-parameter model adapted from advanced architectures like GPT-J. Rigorous preprocessing ensured compliance with HIPAA and removed PII, enabling safe domain-specific pre-training on medical language.[6]
The pre-training phase focused on next-token prediction, allowing the model to internalize clinical narratives, jargon, and patterns unique to NYU Langone's workflows. This step was computationally intensive, leveraging high-performance GPUs at the health system's data center.[1]
Post pre-training, NYUTron was fine-tuned on 24 benchmarked clinical prediction tasks, including in-hospital mortality, prolonged LOS, 30-day readmission, and even operational metrics like payer-specific denial rates. Supervised fine-tuning used labeled outcomes from historical data, achieving AUROC scores 3-15% higher than traditional ML baselines and clinician judgments in blinded tests. For instance, 48-hour mortality prediction reached 0.961 AUROC.[6][2]
Challenges like data imbalance were overcome via techniques such as synthetic data augmentation and ensemble methods, ensuring robustness across patient demographics.[3]
NYUTron was deployed at health system scale via APIs integrated into Epic EHR, providing real-time risk scores embedded in clinician dashboards. A low-resistance rollout included pilot testing on high-volume units, followed by full production in 2023. The model's interpretability was enhanced with attention visualizations, aiding clinician trust.[5]
Ethical safeguards, including bias audits and human oversight loops, were implemented. Ongoing monitoring via the Division of Applied AI tracks performance drift, with retraining cycles planned quarterly.[1]
Key hurdles like computational costs and regulatory approval were addressed through internal cloud infrastructure and IRB approvals. Clinician buy-in was boosted via Prompt-a-Thons, where staff co-developed prompts for tasks like note summarization, expanding NYUTron's utility beyond predictions to documentation automation.[4] This phased approach—from research prototype to live deployment—took under 18 months, setting a benchmark for academic health systems.
We build a proof of concept for your problem for 5,000–8,000€. You get a tangible demo instead of slides with promises.
Founder & Partner
Reruption GmbH
Falkertstraße 2
70176 Stuttgart
Phone