README.md

metadata

title: Arabic Sign Language Medical Interpreter
emoji: 🏥👋
colorFrom: blue
colorTo: green
sdk: gradio
app_file: app.py
pinned: false
license: mit

🏥 Arabic Sign Language Medical Interpreter

An AI-powered system that helps deaf patients communicate with doctors using Arabic sign language detection, translation, and intelligent medical conversation.

🎯 Features

• YOLO-based Sign Detection: Real-time Arabic sign language letter recognition
• Bidirectional Translation: Arabic ↔ English translation for seamless communication
• Medical AI Assistant: Intelligent follow-up questions for comprehensive diagnosis
• Speech Recognition: Voice input from doctors
• Text-to-Speech: Audio output for enhanced accessibility
• ZeroGPU Optimization: Efficient GPU usage on Hugging Face Spaces

🚀 How It Works

1. Patient shows Arabic sign language to the camera
2. System detects signs and translates to English
3. Medical AI generates relevant follow-up questions
4. Doctor receives translated information and can respond via voice
5. System converts responses back to Arabic for the patient

🔧 Technical Stack

• YOLOv8: Sign language detection
• Helsinki-NLP: Arabic-English translation
• Whisper: Speech recognition
• gTTS: Text-to-speech conversion
• Gradio: Web interface
• ZeroGPU: Optimized GPU acceleration

📊 Model Details

• Custom-trained YOLO model for Arabic sign language letters
• Lightweight medical conversation agent (rule-based)
• Optimized for deployment on Hugging Face Spaces with ZeroGPU

🎮 Usage

Simply visit the Hugging Face Space and:

1. Use the webcam to show Arabic sign language
2. Click "Detect Signs" to process
3. View translations and medical AI responses
4. Doctors can use voice input for questions

💡 Use Cases

• Hospital emergency rooms
• Medical clinics serving deaf patients
• Telemedicine consultations
• Healthcare accessibility improvement

---

Built with ❤️ for accessible healthcare communication