Good Machine Learning Practices (GMLP) Statement for Vetology’s AI X-ray Screening Tool

Good Machine Learning Practices (GMLP) Statement for Vetology’s AI X-ray Screening Tool

Good Machine Learning Practices (GMLP) Statement

Vetology is committed to advancing veterinary medicine through innovative technologies. Our AI-powered tool for screening canine and feline X-rays exemplifies our dedication to enhancing diagnostic accuracy and efficiency. This statement outlines our adherence to Good Machine Learning Practices (GMLP) across the development, deployment, and maintenance of our AI model.  

graphic suggesting how the system is trained.

A. Explanation of AI Model Development

Our AI model is developed using a rigorous and systematic process to ensure reliability and clinical relevance.

  • Data Collection and Preprocessing: We aggregate a diverse dataset of anonymized canine and feline X-rays from various sources to capture a wide range of anatomical variations and pathological conditions. Data is de-identified in compliance with privacy regulations.
  • Annotation and Labeling: Experienced veterinary radiologists annotate the images, providing high-quality labels that serve as ground truth for training. This ensures that the model learns from expert interpretations.
  • Model Architecture: We employ state-of-the-art deep learning architectures optimized for image analysis, such as convolutional neural networks (CNNs), to effectively process and interpret radiographic images.
  • Training Process: The model is trained using supervised learning techniques with hyperparameter tuning to optimize performance metrics like accuracy, sensitivity, and specificity.
  • Bias Mitigation: We actively identify and mitigate potential biases by ensuring balanced representation across species, breeds, ages, and pathological conditions in the training dataset.

B. Explanation of AI Model Pre-release Assurance of Safety and Effectiveness

Before releasing the AI tool, we conduct comprehensive evaluations to ensure it meets safety and efficacy standards.

  • Validation Studies: The model undergoes rigorous validation using separate datasets not seen during training to assess its generalizability and robustness.
  • Performance Metrics: We evaluate key performance indicators, including accuracy, sensitivity, specificity, and area under the ROC curve (AUC), to quantify the model’s diagnostic capabilities.
  • Clinical Testing: Pilot studies are conducted in clinical settings where veterinary professionals use the tool in real-world scenarios to provide feedback on usability and effectiveness.
  • Regulatory Compliance: We ensure that our AI tool complies with FDA guidelines for Good Machine Learning Practices.
  • Risk Assessment: A thorough risk analysis is performed to identify potential failure modes, and appropriate safeguards are implemented to mitigate any identified risks.

C. Explanation of AI Production Model Deployment and Ongoing Monitoring

Upon deployment, we maintain vigilant oversight of the AI tool’s performance and impact.

  • Integration with Existing Systems: The AI tool is seamlessly integrated into veterinary workflows, ensuring minimal disruption and maximal utility.
  • User Training and Support: We provide comprehensive training materials and support services to help veterinary professionals effectively utilize the tool.
  • Performance Monitoring: Continuous monitoring systems are in place to track the model’s performance in real-time, detecting any deviations from expected outcomes.
  • Feedback Mechanisms: We encourage and facilitate user feedback to identify any issues or areas for improvement, fostering a collaborative environment for refinement.
  • Data Security: Robust security protocols protect sensitive data during transmission and storage, complying with industry standards for data protection.

D. Explanation of AI Device Ongoing Re-training, Modifications, and Versioning

We recognize the importance of keeping the AI model current with evolving medical knowledge and practices.

  • Periodic Re-training: The model is periodically retrained with new data to incorporate the latest findings and address any drift in performance.
  • Change Management: Any modifications to the model undergo a structured change management process, including re-validation and documentation.
  • Version Control: We maintain strict version control, documenting changes between versions and ensuring traceability of updates.
  • Regulatory Updates: Updates to the model are evaluated for regulatory impact, and we ensure continued compliance with applicable regulations.
  • Transparency: Users are informed of significant updates or changes to the AI tool, including improvements in performance or functionality.

Conclusion

Vetology is dedicated to providing safe, effective, and reliable AI solutions for veterinary radiology. Through adherence to Good Machine Learning Practices, we strive to enhance diagnostic capabilities while maintaining the highest standards of quality and ethics.

New Release: Features of our AI-Radiology Reports for the Feline Abdomen

New Release: Features of our AI-Radiology Reports for the Feline Abdomen

We’re excited to introduce our newest addition to the Vetology suite:

This new release takes our AI Radiology Reports to the next level by automating the analysis of feline abdominal radiographs.

Introducing Enhanced AI-driven Conclusions

This enhancement enables our AI to deliver richer, more detailed conclusions in the familiar style of a boarded radiologist’s report, offering actionable insights on screening results. As part of our feline abdomen release, AI report conclusions will include suggested next steps and differential diagnoses when appropriate, providing additional context to the report’s findings.

At Vetology, our AI is continuously evolving. Your feedback — both in-app and in-person — plays a vital role in shaping regular updates and improvements.

In the coming months, you can expect to see matching updates and richer conclusions in our canine abdomen reports.

Summary of the conditions and disease processes (classifiers) included in our Feline Abdomen Automated AI Radiology Reports:

illustration of cat featuring a call out on the feline abdomen

Liver: Hepatomegaly, Hepatic Masses

Spleen: Splenomegaly

Kidneys: Renomegaly (L + R), Nephroliths (L + R)

Urogenital: Urocystoliths, Urethroliths, Mineralized Fetal Skeletons (signs of pregnancy)

Gastrointestinal Tract: Mineral/metal Gastric Material, Gastric Rugal Folds, Megacolon

Peritoneum: Decreased Serosal Detail

Move through the diagnostic pathway more swiftly, and Free up valuable time to spend with patients and owners

By offering more contextual observations and fast screening results, our AI acts as a second set of eyes to confirm your own findings and boost your confidence in diagnostic and treatment planning for your patients.

Graphic showing the word easy

Imagine This:

You’ve just uploaded a well-exposed, well-positioned feline abdominal radiograph. Before you even move on to your next task, the AI screening report is ready—delivered to you within minutes.

The Best Part?

You didn’t need to change a thing. No extra steps, no software updates. The report appears seamlessly in the platform, linked to your case radiographs, just like all your other Vetology reports.

This Isn’t Science Fiction!

Feline Abdomen AI Radiology Reports are available to all Vetology AI subscribers now! Share the good news (and this email) with your medical team. Log in to Vetology.net below, and see it in action with your first feline abdomen radiograph!

Questions, Training, Demos + More

PODCAST – AI-Driven Teleradiology

PODCAST – AI-Driven Teleradiology

Join the clever minds behind the Veterinary Innovation Podcast – Shawn Wilkie, CEO of Talkatoo, and Dr. Ivan Zak, CEO of Veterinary Integration Solutions – as they sit down with our own Dr. Seth Wallack, DACVR, founder and CEO of Vetology to explore the integration of artificial intelligence and teleconsulting in radiology.

In this episode, they discuss AI-driven teleradiology, which helps veterinarians receive faster preliminary reports, streamlines decision-making, and boosts radiologists’ efficiency. 

Dr. Wallack highlights that Vetology’s AI assists by providing initial insights and supporting veterinarians without replacing their clinical judgment or changing existing workflows. Veterinarians can use these AI-generated reports to make informed treatment decisions or request further consultation from a radiologist.

Topics Covered in the Conversation

  • AI-Enhanced Teleradiology
  • Quality Control and Workflow Integration
  • Upcoming Innovations
$

Read the Full Article on Today's Veterinary Business

This article was originally published on October 1, 2022

Artificial Intelligence in Veterinary Practices: Workflows and More

Artificial Intelligence in Veterinary Practices: Workflows and More

Q&A: Artificial Intelligence

How AI Can Help Practices of All Kinds

Written by Sarah McNeal

Artificial intelligence seems new, because of ChatGPT. And by now, many people have experimented with it either for generating images or illustrations, or to help with writing prompts. But AI has been used in radiology for a while. Patterson Teleradiology powered by Vetology AI is built on thousands of cases, with AI reports returned in under five minutes. It’s ideal for many types of practices to confirm suspicions, act as a second opinion or illustrate for clients what issue their pet is facing. Each case submitted comes with a full report that can be emailed or printed for transparency with clients.

Insight asked Staci Thorne, CVT about how artificial intelligence can help today’s busy practices. Thorne is a certified vet tech with more than 20 years of experience, including emergency clinics.

Can AI Be Trusted?

Short answer, yes!

Longer answer: In the same way that you would trust your CBC or urine sediment analyzer to aid you in your diagnostic process, AI in radiology can be trusted as a useful tool to help confirm your diagnosis. AI is all about data, and as we continue to feed it more and more information, its uses and capabilities become sharper and stronger. The software’s machine learning algorithms have been exposed to thousands and thousands of radiographs over many years and all those data points have helped build the neural networks that make those platforms so powerful.

Q: In which types of clinics does it work best and why?
Vetology has a use case in many clinical settings that I can think of:

  • Are you an ER that needs some diagnostic answers immediately?
    Use AI to confirm that your patient needs treatment within minutes.
  • Are you a general practice that wants to reduce the workload and simplify workflow?
    AI can review every radiograph and determine which ones need to be sent for further evaluation, freeing up your time to focus on other things.
  • Are you a low-cost practice with high standard of care?
    Use AI to evaluate all your radiographs and receive a shareable report back that enhances your diagnostic value and reserves teleradiology costs for those cases that truly need it.
  • Are you a new grad looking for that extra bit of reassurance for difficult-to-read cases?
    Confirm your suspicions with AI.

Originally published in:
Insight Companion Animal Edition, July 2024, Patterson Veterinary

PODCAST – AI-Driven Teleradiology

Artificial Intelligence in Clinical Radiology

Join the clever minds behind the Veterinary Innovation Podcast – Shawn Wilkie, CEO of Talkatoo and Dr. Ivan Zak, CEO of Veterinary Integration Solutions – as we discuss veterinary radiology with our own Dr. Seth Wallack, DACVR.

One of the largest issues in veterinary radiology today is an incredibly high caseload. Radiologists in North America consult on 2.5 million cases per year, and that number is projected to more than double within the next three years. With fewer educational opportunities available in radiology, how can this vital specialization keep up with the demand?

This week on the Veterinary Innovation Podcast, Shawn and Ivan speak with Dr. Seth Wallack, the founder and CEO of Vetology, about how artificial intelligence can improve the workflow of clinical radiologists, whether we’re too late in adopting it, and how the best veterinarians are those who are most eager to learn.

Topics Covered in the Conversation

  • The shrinking number of Radiologists and how AI can fill those gaps.
  • The adoption of new technologies in clinical radiology.
  • Higher amounts of specialization in veterinary medicine.
$

Read the Full Article on Today's Veterinary Business

This article was originally published on October 1, 2022

Pin It on Pinterest