Update app.py
Browse files
app.py
CHANGED
@@ -98,9 +98,11 @@ with gr.Blocks() as iface:
|
|
98 |
heatmap_video = gr.Video(label="Video with Anomaly Heatmap")
|
99 |
combined_mse_plot = gr.Plot(label="Combined MSE Plot")
|
100 |
correlation_heatmap_plot = gr.Plot(label="Correlation Heatmap")
|
|
|
101 |
with gr.Row():
|
102 |
with gr.Group(visible=True) as results_group2:
|
103 |
with gr.TabItem("Description"):
|
|
|
104 |
gr.Markdown("""
|
105 |
# Multimodal Behavioral Anomalies Detection
|
106 |
|
@@ -123,9 +125,7 @@ with gr.Blocks() as iface:
|
|
123 |
- **Voice Analysis**: Extracts and segment speaker embeddings from audio using PyAnnote.
|
124 |
- **Anomaly Detection**: Uses Variational Autoencoder (VAE) to detect anomalies in facial expressions, body postures, and voice features over time.
|
125 |
- **Visualization**: Represents changes in facial expressions, body postures, and vocal tone over time, marking anomaly key points.
|
126 |
-
|
127 |
-

|
128 |
-
|
129 |
## InceptionResnetV1
|
130 |
The InceptionResnetV1 model is a deep convolutional neural network used for facial recognition and facial attribute extraction.
|
131 |
|
|
|
98 |
heatmap_video = gr.Video(label="Video with Anomaly Heatmap")
|
99 |
combined_mse_plot = gr.Plot(label="Combined MSE Plot")
|
100 |
correlation_heatmap_plot = gr.Plot(label="Correlation Heatmap")
|
101 |
+
|
102 |
with gr.Row():
|
103 |
with gr.Group(visible=True) as results_group2:
|
104 |
with gr.TabItem("Description"):
|
105 |
+
gr.Image(value="appendix/Anomay Detection.png", label="Diagram")
|
106 |
gr.Markdown("""
|
107 |
# Multimodal Behavioral Anomalies Detection
|
108 |
|
|
|
125 |
- **Voice Analysis**: Extracts and segment speaker embeddings from audio using PyAnnote.
|
126 |
- **Anomaly Detection**: Uses Variational Autoencoder (VAE) to detect anomalies in facial expressions, body postures, and voice features over time.
|
127 |
- **Visualization**: Represents changes in facial expressions, body postures, and vocal tone over time, marking anomaly key points.
|
128 |
+
|
|
|
|
|
129 |
## InceptionResnetV1
|
130 |
The InceptionResnetV1 model is a deep convolutional neural network used for facial recognition and facial attribute extraction.
|
131 |
|