cybersec_classifier / README.md
selfconstruct3d's picture
Update README.md
c791818 verified
---
license: apache-2.0
language:
- en
- de
---
# 🛡️ MLP Cybersecurity Classifier
This repository hosts a lightweight `scikit-learn`-based MLP classifier trained to distinguish cybersecurity-related content from other text, using sentence-transformer embeddings. It supports English and German input texts.
## 📊 Training Data
The model was trained on a multilingual dataset of cybersecurity and non-cybersecurity news articles. The dataset is publicly available on Zenodo:
🔗 [https://zenodo.org/records/16417939](https://zenodo.org/records/16417939)
## 📦 Model Details
- **Architecture**: `MLPClassifier` with hidden layers `(128, 64)`
- **Embedding model**: [`intfloat/multilingual-e5-large`](https://huggingface.co/intfloat/multilingual-e5-large)
- **Input**: Cleaned article (removed stopwords) or report text
- **Output**: Binary label (e.g., `Cybersecurity`, `Not Cybersecurity`)
- **Languages**: English, German
## 🔧 Usage
```python
from sentence_transformers import SentenceTransformer
from huggingface_hub import hf_hub_download
import joblib
# 1. Load the embedding model
embedder = SentenceTransformer("intfloat/multilingual-e5-large")
# 2. Load the pretrained MLP classifier from Hugging Face Hub
model_path = hf_hub_download(repo_id="selfconstruct3d/cybersec_classifier", filename="cybersec_classifier.pkl")
model = joblib.load(model_path)
# 3. Example input texts (can be in English or German)
texts = [
"A new ransomware attack has affected critical infrastructure in Germany.",
"The local sports club hosted its annual summer festival this weekend."
]
# 4. Generate embeddings
embeddings = embedder.encode(texts, convert_to_numpy=True, show_progress_bar=False)
# 5. Predict cybersecurity relevance
predictions = model.predict(embeddings)
# 6. Output results
for text, label in zip(texts, predictions):
print(f"Text: {text}\nPrediction: {label}\n")