durganihantri commited on
Commit
77efb88
Β·
unverified Β·
1 Parent(s): 66451b3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +84 -34
README.md CHANGED
@@ -1,34 +1,84 @@
1
- # AI-Child-Behavior-Assessment
2
-
3
- This project is a web-based AI tool designed to analyze children's facial expressions and language development for early mental health assessment.
4
-
5
- ## Features
6
- - AI-powered **Facial Emotion Detection** using DeepFace
7
- - **Speech-to-Text Analysis** for child language development
8
- - Flask API for backend processing
9
- - Streamlit-based web interface
10
-
11
- ## Setup Instructions
12
- ### 1. Install Required Libraries
13
- ```bash
14
- pip install flask streamlit tensorflow torch torchvision opencv-python numpy pandas speechrecognition deepface transformers
15
- ```
16
-
17
- ### 2. Run the Backend (Flask API)
18
- ```bash
19
- cd backend
20
- python app.py
21
- ```
22
-
23
- ### 3. Run the Frontend (Streamlit App)
24
- ```bash
25
- cd frontend
26
- streamlit run app_ui.py
27
- ```
28
-
29
- ## Deployment Guide
30
- - Backend can be deployed on **Hugging Face Spaces**.
31
- - Frontend can be hosted on **Streamlit Cloud** or **Netlify**.
32
-
33
- ## License
34
- MIT License
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: AI Child Behavior Assessment
3
+ emoji: πŸ§’
4
+ colorFrom: blue
5
+ colorTo: green
6
+ sdk: streamlit
7
+ app_file: app.py
8
+ pinned: false
9
+ sdk_version: 1.42.0
10
+ ---
11
+
12
+ AI Child Behavior Assessment
13
+
14
+ Multimodal AI-powered tool for analyzing child emotions and speech patterns
15
+
16
+ πŸš€ Live Demo: Hugging Face Spaces
17
+
18
+ πŸ“Œ Overview
19
+
20
+ The AI Child Behavior Assessment app is designed to analyze children’s emotional and speech patterns using multimodal AI models. It integrates:
21
+ β€’ Facial Emotion Recognition (DeepFace) πŸ§‘β€πŸŽ¨
22
+ β€’ Speech Analysis & Transcription (Wav2Vec2) πŸŽ™οΈ
23
+ β€’ Multimodal Analysis (Video + Audio combined) πŸŽ₯ + πŸ”Š
24
+
25
+ This tool helps in early mental health screening and behavioral assessments for research, caregivers, and psychologists.
26
+
27
+ ✨ Features
28
+
29
+ βœ… 1. Video-Based Emotion Analysis
30
+ β€’ Uses DeepFace AI to detect facial expressions and emotions.
31
+ β€’ Processes video frames to determine dominant emotions.
32
+ β€’ Generates a visual summary of detected emotions.
33
+
34
+ βœ… 2. Audio-Based Speech & Tone Analysis
35
+ β€’ Uses Wav2Vec2 to transcribe spoken words.
36
+ β€’ Applies speech emotion recognition to assess tone and sentiment.
37
+ β€’ Includes noise reduction for clearer transcriptions.
38
+
39
+ βœ… 3. Multimodal Analysis (Video + Audio Combined)
40
+ β€’ Extracts both visual and speech cues to detect behavior patterns.
41
+ β€’ Compares facial emotions with speech tone to identify inconsistencies.
42
+ β€’ Provides comprehensive insights into child behavior.
43
+
44
+ βœ… 4. Data Visualization
45
+ β€’ Displays emotion distribution over time using bar charts πŸ“Š.
46
+ β€’ Generates speech vs. video emotion comparison charts πŸ†.
47
+
48
+ πŸ”§ How to Use
49
+
50
+ 1️⃣ Select an Analysis Mode:
51
+ β€’ Upload a video file for emotion recognition.
52
+ β€’ Upload an audio file for speech analysis.
53
+ β€’ Upload a video + audio file for multimodal analysis.
54
+
55
+ 2️⃣ Click β€œAnalyze” to process the uploaded file.
56
+ 3️⃣ View Results:
57
+ β€’ Detected emotions, speech transcription, and analysis insights will be displayed.
58
+
59
+ πŸ“‚ Supported File Formats
60
+
61
+ Analysis Type Supported Formats
62
+ Video πŸŽ₯ MP4, AVI, MOV
63
+ Audio πŸŽ™οΈ WAV, MP3
64
+ Multimodal (Video + Audio) MP4, MOV
65
+
66
+ πŸ” Future Improvements
67
+
68
+ πŸš€ Planned Enhancements:
69
+ βœ… Real-time emotion tracking for live video
70
+ βœ… AI-driven predictive analysis for behavioral trends
71
+ βœ… Integration with clinical psychology datasets for validation
72
+ βœ… More advanced multimodal deep learning models
73
+
74
+ πŸ“œ Citation & Acknowledgment
75
+
76
+ If you use this tool in research or projects, please cite:
77
+ Durganihantri Low – AI Child Behavior Assessment (2025)
78
+ 🌐 Hugging Face Spaces
79
+
80
+ πŸ‘¨β€πŸ’» Contact & Contributions
81
+
82
+ Have suggestions or want to contribute? Contact me:
83
+ πŸ“§ Email: [email protected]
84
+ πŸ”— LinkedIn: http://linkedin.com/in/durganihantri