AccuKnox Model Report
Scanned Models
Model Comparison
| Dimension | |||
|---|---|---|---|
| Overall Score | 84 | 87 ▲ best | 78 |
| Provenance | 80 | 80 | 90 ▲ best |
| Adversarial | 87 | 90 ▲ best | 87 |
| Privacy | 77 | 77 | 87 ▲ best |
| File Security | 90 | 100 ▲ best | 50 |
| Critical | 0 ▲ best | 0 ▲ best | 0 ▲ best |
| High | 1 ▲ best | 1 ▲ best | 2 |
| Medium | 4 | 3 ▲ best | 4 |
| Low | 2 | 1 ▲ best | 2 |
| Total | 8 | 6 ▲ best | 10 |
Compliance Framework Comparison
| Framework | SER-Odyssey-Baseline-WavLM-Multi-Attributes | w2v-speech-emotion-recognition | wav2vec2-large-robust-12-ft-emotion-msp-dim |
|---|---|---|---|
| OWASP LLM Top 10 | |||
| MITRE ATLAS | |||
| MITRE ATT&CK | ✓ Clear | ✓ Clear | ✓ Clear |
| NIST AI RMF | |||
| EU AI Act | |||
| CWE | ✓ Clear | ||
| ISO/IEC 42001 |
- •Highest overall security score: 87/100 (vs 84, 78)
- •No critical findings; 1 high-severity finding
- •Strongest in File Sec. (100/100) — best across all models
- •5 of 7 compliance frameworks violated
- •1 high-severity finding should be addressed before production use
- •SER-Odyssey-Baseline-WavLM-Multi-Attributes: score 84/100; 1 high; 6 framework violations
- •wav2vec2-large-robust-12-ft-emotion-msp-dim: score 78/100; 2 high; 6 framework violations
Supply Chain & Provenance
1 finding(s): 0 critical, 1 high. Author: 3loi | Country: United States | License: mit
0 Critical1 High0 Medium0 Low
FAIL
PROV-010
HIGH
Low-Profile Individual Author (4 followers)
PROV-010
HIGH
Low-Profile Individual Author (4 followers)
The model is published by an individual HuggingFace user '3loi' with only 4 followers and 5 public model(s). Low-profile individuals have not been vetted by the community and present a higher supply-chain risk.
8 checks passed
Adversarial Robustness
2 finding(s). Available tools: art, torch, transformers. Pipeline: audio-classification.
0 Critical0 High1 Medium1 Low
WARN
ADV-MC-001
MEDIUM
No Adversarial Robustness Evaluation Disclosed
ADV-MC-001
MEDIUM
No Adversarial Robustness Evaluation Disclosed
The model card does not mention any adversarial robustness evaluation, testing against perturbations, or out-of-distribution behavior.
ADV-MC-002
LOW
No Bias or Fairness Evaluation Disclosed
ADV-MC-002
LOW
No Bias or Fairness Evaluation Disclosed
The model card does not discuss bias, fairness, or demographic performance gaps.
1 check passed
Data & Privacy Risks
3 finding(s): 0 critical, 0 high. Datasets: 0. Pipeline: audio-classification.
0 Critical0 High2 Medium1 Low
WARN
PRIV-016
MEDIUM
Elevated Membership Inference Attack Risk (score=2/6)
PRIV-016
MEDIUM
Elevated Membership Inference Attack Risk (score=2/6)
This model has an elevated risk of membership inference attacks. Risk factors: no differential privacy documented; no data deduplication documented. Membership inference attacks allow an adversary to determine whether a specific individual's data was included in the training set.
PRIV-020
MEDIUM
Training Data Not Disclosed
PRIV-020
MEDIUM
Training Data Not Disclosed
No training datasets are documented. Without knowing training data provenance, it is impossible to assess data privacy compliance, consent, or bias.
PRIV-015
LOW
No Privacy Disclosures in Model Card
PRIV-015
LOW
No Privacy Disclosures in Model Card
The model card does not address privacy considerations, data anonymization procedures, or regulatory compliance.
1 check passed
Model File Security
2 finding(s): 0 critical, 0 high. Scanners: modelaudit, pickle_scanner.
0 Critical0 High1 Medium0 Low
WARN
FSEC-001
MEDIUM
Pickle-Based Weight Files Present (1 file(s))
FSEC-001
MEDIUM
Pickle-Based Weight Files Present (1 file(s))
The repository contains 1 pickle-based weight file(s): pytorch_model.bin. Pickle deserialization can execute arbitrary code. Even without explicit malice, pickle files present an attack surface that safetensors files do not.
FSEC-MS-MISSING
INFO
modelscan Not Available
FSEC-MS-MISSING
INFO
modelscan Not Available
modelscan (ProtectAI) is not installed or not in PATH. Note: modelscan requires Python <3.13.
5 checks passed
| BOM Format | CycloneDX 1.5 |
| BOM Version | 1 |
| Serial No. | urn:uuid:d69bfec0-e7ec-4090-b858-9baf136f8733 |
| Generated | 2026-04-03 04:52:05 UTC |
| Tool | modelcheck v0.1.0 |
| Component | 3loi/SER-Odyssey-Baseline-WavLM-Multi-Attributes |
| Type | machine-learning-model |
| Author | 3loi |
| Author Kind | individual |
| License | mit |
| Pipeline | audio-classification |
| Model Type | Unknown |
| Architecture | Unknown |
| Country | United States |
| Created | 2024-03-05 |
| Modified | 2024-06-12 |
| Downloads | 694 |
| Gated | false |
| Source | HUGGINGFACE |
| Scanners | modelaudit, pickle_scanner |
Preview AIBOM JSON
This model has not been confirmed safe for unrestricted production use. Key risks include unvetted authorship, pickle-format weights, or live adversarial probes that were triggered. Use container isolation and network restrictions to contain the blast radius of any unexpected behaviour.
- 1Run inference inside a dedicated container with no outbound network access (--network=none)
- 2Mount model files read-only; restrict writes to a dedicated /tmp volume only
- 3Apply strict CPU and memory resource limits to the inference process
- 4Use a seccomp/AppArmor profile to block execve, socket, and fork syscalls
- 5Enable detailed audit logging for every inference request and response
- 6Enforce strong rate limiting and authentication on the inference endpoint
- 7Perform a manual review of all model weight files before any wider rollout
FSEC-001PROV-010The model's author cannot be independently verified, comes from an individual with low community presence, or lacks integrity checksums on weight files. This raises the risk of tampered or mislabelled models.
- 1Cross-reference the author's identity via GitHub, academic papers, or institutional pages
- 2Download the model from its original source and verify SHA256 checksums independently
- 3Check whether the model matches any published architecture description or paper
- 4Prefer models from known organisations or individuals with substantial track records (1000+ followers)
- 5Register the model in your internal catalogue with full provenance metadata before use
- 6Set up automated checksum verification in your model deployment pipeline
PROV-010The model uses pickle-based weight files (.bin, .pt, .pth, .ckpt). Pickle deserialisation can execute arbitrary Python on load, making it an inherent attack surface. SafeTensors eliminates this risk by design and adds header-based integrity checking.
- 1Convert weights using the safetensors library: safetensors.torch.save_file(state_dict, 'model.safetensors')
- 2Verify the converted SafeTensors file produces identical outputs to the original
- 3Compute and publish SHA256 checksums for all SafeTensors files
- 4Update model loading code to use safetensors.torch.load_file() instead of torch.load()
- 5If using HuggingFace Hub, upload the SafeTensors version and mark it as preferred
- 6Retire and delete pickle-format weights once SafeTensors is validated in production
FSEC-001The model was likely trained on web-scraped data without explicit consent disclosures. Deploying such a model in the EU or California may violate GDPR or CCPA without a lawful basis for processing the underlying personal data.
- 1Audit training datasets for inclusion of EU or California residents' personal data
- 2Assess whether a GDPR-compliant legal basis exists for each training dataset
- 3Implement a data subject rights process: right of access, rectification, and erasure
- 4Document training data provenance and consent mechanisms in a Data Processing Agreement (DPA)
- 5Evaluate differential privacy (DP-SGD) for any future fine-tuning runs on personal data
- 6For EU-facing deployments, conduct a Data Protection Impact Assessment (DPIA)
PRIV-015The model's training pipeline and task type create elevated susceptibility to membership inference attacks, allowing an adversary to determine whether a specific individual's data was used in training. Restricting output information reduces this leakage significantly.
- 1Do not expose raw logits or full probability distributions in your inference API
- 2Apply output discretisation: return top-1 or top-k (small k ≤ 5) predictions only
- 3Add calibrated noise to probability outputs (Laplace or Gaussian mechanism)
- 4Enforce strict per-user rate limits to slow systematic membership probing
- 5Evaluate differential privacy during any future fine-tuning run (DP-SGD via Opacus)
- 6Log and monitor abnormal inference patterns that may indicate membership probing
PRIV-016Even models that pass all static checks can exhibit unexpected behaviour in production. Ongoing monitoring of inference traffic, model outputs, and resource usage provides early warning of misuse, model drift, or active exploitation.
- 1Log every inference request (input hash, output hash, latency, user/session ID)
- 2Set up anomaly detection on output distributions to spot model drift or poisoning
- 3Alert on sudden changes in refusal rate, output length, or topic distribution
- 4Periodically re-run modelcheck scans after any model update or fine-tuning
- 5Monitor container/process resource usage for unexpected CPU or network spikes
- 6Establish an incident response playbook for AI-specific security events
Supply Chain & Provenance
1 finding(s): 0 critical, 1 high. Author: Khoa | Country: United States | License: mit
0 Critical1 High0 Medium0 Low
FAIL
PROV-010
HIGH
Low-Profile Individual Author (1 followers)
PROV-010
HIGH
Low-Profile Individual Author (1 followers)
The model is published by an individual HuggingFace user 'Khoa' with only 1 followers and 106 public model(s). Low-profile individuals have not been vetted by the community and present a higher supply-chain risk.
8 checks passed
Adversarial Robustness
1 finding(s). Available tools: art, torch, transformers. Pipeline: audio-classification.
0 Critical0 High1 Medium0 Low
WARN
ADV-MC-001
MEDIUM
No Adversarial Robustness Evaluation Disclosed
ADV-MC-001
MEDIUM
No Adversarial Robustness Evaluation Disclosed
The model card does not mention any adversarial robustness evaluation, testing against perturbations, or out-of-distribution behavior.
2 checks passed
Data & Privacy Risks
3 finding(s): 0 critical, 0 high. Datasets: 0. Pipeline: audio-classification.
0 Critical0 High2 Medium1 Low
WARN
PRIV-016
MEDIUM
Elevated Membership Inference Attack Risk (score=2/6)
PRIV-016
MEDIUM
Elevated Membership Inference Attack Risk (score=2/6)
This model has an elevated risk of membership inference attacks. Risk factors: no differential privacy documented; no data deduplication documented. Membership inference attacks allow an adversary to determine whether a specific individual's data was included in the training set.
PRIV-020
MEDIUM
Training Data Not Disclosed
PRIV-020
MEDIUM
Training Data Not Disclosed
No training datasets are documented. Without knowing training data provenance, it is impossible to assess data privacy compliance, consent, or bias.
PRIV-015
LOW
No Privacy Disclosures in Model Card
PRIV-015
LOW
No Privacy Disclosures in Model Card
The model card does not address privacy considerations, data anonymization procedures, or regulatory compliance.
1 check passed
Model File Security
1 finding(s): 0 critical, 0 high. Scanners: modelaudit, pickle_scanner.
0 Critical0 High0 Medium0 Low
WARN
FSEC-MS-MISSING
INFO
modelscan Not Available
FSEC-MS-MISSING
INFO
modelscan Not Available
modelscan (ProtectAI) is not installed or not in PATH. Note: modelscan requires Python <3.13.
6 checks passed
| BOM Format | CycloneDX 1.5 |
| BOM Version | 1 |
| Serial No. | urn:uuid:6a9235ba-3792-4468-9fde-8789bba0e9b3 |
| Generated | 2026-04-03 04:52:05 UTC |
| Tool | modelcheck v0.1.0 |
| Component | Khoa/w2v-speech-emotion-recognition |
| Type | machine-learning-model |
| Author | Khoa |
| Author Kind | individual |
| License | mit |
| Pipeline | audio-classification |
| Model Type | Unknown |
| Architecture | Unknown |
| Country | United States |
| Created | 2024-08-27 |
| Modified | 2024-08-27 |
| Downloads | 7,107 |
| Gated | false |
| Source | HUGGINGFACE |
| Scanners | modelaudit, pickle_scanner |
Preview AIBOM JSON
This model has not been confirmed safe for unrestricted production use. Key risks include unvetted authorship, pickle-format weights, or live adversarial probes that were triggered. Use container isolation and network restrictions to contain the blast radius of any unexpected behaviour.
- 1Run inference inside a dedicated container with no outbound network access (--network=none)
- 2Mount model files read-only; restrict writes to a dedicated /tmp volume only
- 3Apply strict CPU and memory resource limits to the inference process
- 4Use a seccomp/AppArmor profile to block execve, socket, and fork syscalls
- 5Enable detailed audit logging for every inference request and response
- 6Enforce strong rate limiting and authentication on the inference endpoint
- 7Perform a manual review of all model weight files before any wider rollout
PROV-010The model's author cannot be independently verified, comes from an individual with low community presence, or lacks integrity checksums on weight files. This raises the risk of tampered or mislabelled models.
- 1Cross-reference the author's identity via GitHub, academic papers, or institutional pages
- 2Download the model from its original source and verify SHA256 checksums independently
- 3Check whether the model matches any published architecture description or paper
- 4Prefer models from known organisations or individuals with substantial track records (1000+ followers)
- 5Register the model in your internal catalogue with full provenance metadata before use
- 6Set up automated checksum verification in your model deployment pipeline
PROV-010The model was likely trained on web-scraped data without explicit consent disclosures. Deploying such a model in the EU or California may violate GDPR or CCPA without a lawful basis for processing the underlying personal data.
- 1Audit training datasets for inclusion of EU or California residents' personal data
- 2Assess whether a GDPR-compliant legal basis exists for each training dataset
- 3Implement a data subject rights process: right of access, rectification, and erasure
- 4Document training data provenance and consent mechanisms in a Data Processing Agreement (DPA)
- 5Evaluate differential privacy (DP-SGD) for any future fine-tuning runs on personal data
- 6For EU-facing deployments, conduct a Data Protection Impact Assessment (DPIA)
PRIV-015The model's training pipeline and task type create elevated susceptibility to membership inference attacks, allowing an adversary to determine whether a specific individual's data was used in training. Restricting output information reduces this leakage significantly.
- 1Do not expose raw logits or full probability distributions in your inference API
- 2Apply output discretisation: return top-1 or top-k (small k ≤ 5) predictions only
- 3Add calibrated noise to probability outputs (Laplace or Gaussian mechanism)
- 4Enforce strict per-user rate limits to slow systematic membership probing
- 5Evaluate differential privacy during any future fine-tuning run (DP-SGD via Opacus)
- 6Log and monitor abnormal inference patterns that may indicate membership probing
PRIV-016
Supply Chain & Provenance
2 finding(s): 0 critical, 0 high. Author: audeering | Country: United States | License: cc-by-nc-sa-4.0
0 Critical0 High1 Medium0 Low
WARN
PROV-010
MEDIUM
Unvetted Organisation: 'audeering'
PROV-010
MEDIUM
Unvetted Organisation: 'audeering'
'audeering' is not among the curated set of well-known AI organisations. Smaller or newer organisations may not have undergone independent security audits and present a moderate supply-chain risk.
PROV-005
INFO
Restrictive License: cc-by-nc-sa-4.0
PROV-005
INFO
Restrictive License: cc-by-nc-sa-4.0
The model uses license 'cc-by-nc-sa-4.0' which may restrict commercial use.
6 checks passed
Adversarial Robustness
2 finding(s). Available tools: art, torch, transformers. Pipeline: audio-classification.
0 Critical0 High1 Medium1 Low
WARN
ADV-MC-001
MEDIUM
No Adversarial Robustness Evaluation Disclosed
ADV-MC-001
MEDIUM
No Adversarial Robustness Evaluation Disclosed
The model card does not mention any adversarial robustness evaluation, testing against perturbations, or out-of-distribution behavior.
ADV-MC-002
LOW
No Bias or Fairness Evaluation Disclosed
ADV-MC-002
LOW
No Bias or Fairness Evaluation Disclosed
The model card does not discuss bias, fairness, or demographic performance gaps.
1 check passed
Data & Privacy Risks
2 finding(s): 0 critical, 0 high. Datasets: 1. Pipeline: audio-classification.
0 Critical0 High1 Medium1 Low
WARN
PRIV-016
MEDIUM
Elevated Membership Inference Attack Risk (score=2/6)
PRIV-016
MEDIUM
Elevated Membership Inference Attack Risk (score=2/6)
This model has an elevated risk of membership inference attacks. Risk factors: no differential privacy documented; no data deduplication documented. Membership inference attacks allow an adversary to determine whether a specific individual's data was included in the training set.
PRIV-015
LOW
No Privacy Disclosures in Model Card
PRIV-015
LOW
No Privacy Disclosures in Model Card
The model card does not address privacy considerations, data anonymization procedures, or regulatory compliance.
5 checks passed
Model File Security
4 finding(s): 0 critical, 2 high. Scanners: modelaudit, pickle_scanner.
0 Critical2 High1 Medium0 Low
FAIL
FSEC-MA-LICENSE_WARNING
HIGH
[modelaudit] Non-commercial licensed components detected (1 files). These cannot be used commercially.
FSEC-MA-LICENSE_WARNING
HIGH
[modelaudit] Non-commercial licensed components detected (1 files). These cannot be used commercially.
Non-commercial licensed components detected (1 files). These cannot be used commercially. Details: {'files': ['/private/var/folders/9c/4cynkdqd6zgbbpgrp00vgqb00000gn/T/modelcheck_scan_akjukwhy/README.md'], 'total_count': 1, 'impact': 'Prohibited for commercial use'}
FSEC-MA-LICENSE_WARNING
HIGH
[modelaudit] Incompatible licenses detected (1 files).
FSEC-MA-LICENSE_WARNING
HIGH
[modelaudit] Incompatible licenses detected (1 files).
Incompatible licenses detected (1 files). Details: {'files': ['/private/var/folders/9c/4cynkdqd6zgbbpgrp00vgqb00000gn/T/modelcheck_scan_akjukwhy/README.md'], 'total_count': 1}
FSEC-001
MEDIUM
Pickle-Based Weight Files Present (1 file(s))
FSEC-001
MEDIUM
Pickle-Based Weight Files Present (1 file(s))
The repository contains 1 pickle-based weight file(s): pytorch_model.bin. Pickle deserialization can execute arbitrary code. Even without explicit malice, pickle files present an attack surface that safetensors files do not.
FSEC-MS-MISSING
INFO
modelscan Not Available
FSEC-MS-MISSING
INFO
modelscan Not Available
modelscan (ProtectAI) is not installed or not in PATH. Note: modelscan requires Python <3.13.
4 checks passed
| BOM Format | CycloneDX 1.5 |
| BOM Version | 1 |
| Serial No. | urn:uuid:85cb3194-42a2-499a-ab3f-0a9f51a65615 |
| Generated | 2026-04-03 04:52:05 UTC |
| Tool | modelcheck v0.1.0 |
| Component | audeering/wav2vec2-large-robust-12-ft-emotion-msp-dim |
| Type | machine-learning-model |
| Author | audeering |
| Author Kind | organization_unknown |
| License | cc-by-nc-sa-4.0 |
| Pipeline | audio-classification |
| Model Type | Unknown |
| Architecture | Unknown |
| Country | United States |
| Created | 2022-04-06 |
| Modified | 2024-09-19 |
| Downloads | 974,472 |
| Gated | false |
| Source | HUGGINGFACE |
| Scanners | modelaudit, pickle_scanner |
Preview AIBOM JSON
This model has not been confirmed safe for unrestricted production use. Key risks include unvetted authorship, pickle-format weights, or live adversarial probes that were triggered. Use container isolation and network restrictions to contain the blast radius of any unexpected behaviour.
- 1Run inference inside a dedicated container with no outbound network access (--network=none)
- 2Mount model files read-only; restrict writes to a dedicated /tmp volume only
- 3Apply strict CPU and memory resource limits to the inference process
- 4Use a seccomp/AppArmor profile to block execve, socket, and fork syscalls
- 5Enable detailed audit logging for every inference request and response
- 6Enforce strong rate limiting and authentication on the inference endpoint
- 7Perform a manual review of all model weight files before any wider rollout
FSEC-001The model has no declared license or uses a license that restricts commercial use, creating undefined legal exposure for any downstream deployment. Do not use commercially until licensing is resolved.
- 1Engage your legal team to assess the licensing situation before any production deployment
- 2Contact the model author directly to request written license clarification
- 3Check the HuggingFace model card and linked repositories for any license file
- 4Do not use the model in commercial products or services without explicit permission
- 5Document the license status (or lack thereof) in your internal model registry
- 6Consider switching to a model with a clear permissive license (Apache-2.0, MIT)
PROV-005The model's author cannot be independently verified, comes from an individual with low community presence, or lacks integrity checksums on weight files. This raises the risk of tampered or mislabelled models.
- 1Cross-reference the author's identity via GitHub, academic papers, or institutional pages
- 2Download the model from its original source and verify SHA256 checksums independently
- 3Check whether the model matches any published architecture description or paper
- 4Prefer models from known organisations or individuals with substantial track records (1000+ followers)
- 5Register the model in your internal catalogue with full provenance metadata before use
- 6Set up automated checksum verification in your model deployment pipeline
PROV-010The model uses pickle-based weight files (.bin, .pt, .pth, .ckpt). Pickle deserialisation can execute arbitrary Python on load, making it an inherent attack surface. SafeTensors eliminates this risk by design and adds header-based integrity checking.
- 1Convert weights using the safetensors library: safetensors.torch.save_file(state_dict, 'model.safetensors')
- 2Verify the converted SafeTensors file produces identical outputs to the original
- 3Compute and publish SHA256 checksums for all SafeTensors files
- 4Update model loading code to use safetensors.torch.load_file() instead of torch.load()
- 5If using HuggingFace Hub, upload the SafeTensors version and mark it as preferred
- 6Retire and delete pickle-format weights once SafeTensors is validated in production
FSEC-001The model was likely trained on web-scraped data without explicit consent disclosures. Deploying such a model in the EU or California may violate GDPR or CCPA without a lawful basis for processing the underlying personal data.
- 1Audit training datasets for inclusion of EU or California residents' personal data
- 2Assess whether a GDPR-compliant legal basis exists for each training dataset
- 3Implement a data subject rights process: right of access, rectification, and erasure
- 4Document training data provenance and consent mechanisms in a Data Processing Agreement (DPA)
- 5Evaluate differential privacy (DP-SGD) for any future fine-tuning runs on personal data
- 6For EU-facing deployments, conduct a Data Protection Impact Assessment (DPIA)
PRIV-015The model's training pipeline and task type create elevated susceptibility to membership inference attacks, allowing an adversary to determine whether a specific individual's data was used in training. Restricting output information reduces this leakage significantly.
- 1Do not expose raw logits or full probability distributions in your inference API
- 2Apply output discretisation: return top-1 or top-k (small k ≤ 5) predictions only
- 3Add calibrated noise to probability outputs (Laplace or Gaussian mechanism)
- 4Enforce strict per-user rate limits to slow systematic membership probing
- 5Evaluate differential privacy during any future fine-tuning run (DP-SGD via Opacus)
- 6Log and monitor abnormal inference patterns that may indicate membership probing
PRIV-016Even models that pass all static checks can exhibit unexpected behaviour in production. Ongoing monitoring of inference traffic, model outputs, and resource usage provides early warning of misuse, model drift, or active exploitation.
- 1Log every inference request (input hash, output hash, latency, user/session ID)
- 2Set up anomaly detection on output distributions to spot model drift or poisoning
- 3Alert on sudden changes in refusal rate, output length, or topic distribution
- 4Periodically re-run modelcheck scans after any model update or fine-tuning
- 5Monitor container/process resource usage for unexpected CPU or network spikes
- 6Establish an incident response playbook for AI-specific security events