<?xml version="1.0" encoding="utf-8" standalone="yes"?><rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom"><channel><title>Datasets and Benchmarks | Benjamin M. Ampel</title><link>https://bampel.com/tag/datasets-and-benchmarks/</link><atom:link href="https://bampel.com/tag/datasets-and-benchmarks/index.xml" rel="self" type="application/rss+xml"/><description>Datasets and Benchmarks</description><generator>Wowchemy (https://wowchemy.com)</generator><language>en-us</language><lastBuildDate>Sun, 06 Dec 2026 00:00:00 +0000</lastBuildDate><image><url>https://bampel.com/media/icon_hu_cc9cb5646de94589.png</url><title>Datasets and Benchmarks</title><link>https://bampel.com/tag/datasets-and-benchmarks/</link></image><item><title>HackerSignal: A Large-Scale Multi-Source Dataset Linking Hacker Community Discourse to the CVE Vulnerability Lifecycle</title><link>https://bampel.com/conference_publication/hackersignal-a-large-scale-multi-source-dataset-linking-hacker-communi/</link><pubDate>Sun, 06 Dec 2026 00:00:00 +0000</pubDate><guid>https://bampel.com/conference_publication/hackersignal-a-large-scale-multi-source-dataset-linking-hacker-communi/</guid><description>
&lt;div class="pub-extras">
&lt;div class="pub-plain" role="note" aria-label="Plain-language summary">
&lt;span class="pub-plain-tag">In Plain Terms&lt;/span>
&lt;p>This paper introduces HackerSignal, a very large public dataset that stitches together 7.45 million documents from hacker forums, exploit databases, vulnerability advisories, and software fix commits collected over 36 years. Everything is connected through shared CVE vulnerability identifiers, letting researchers trace a security flaw from early hacker chatter all the way to its official patch. The authors demonstrate three AI benchmark tasks the dataset enables and release diagnostics and documentation to support responsible reuse. Accepted as a poster at the NeurIPS 2026 Evaluations &amp;amp; Datasets Track.&lt;/p>
&lt;/div>
&lt;div class="pub-extras-grid">
&lt;div class="pub-extras-card">
&lt;h3>Key Contributions&lt;/h3>
&lt;p class="pub-muted">Key contributions will be added soon.&lt;/p>
&lt;/div>
&lt;div class="pub-extras-card">
&lt;h3>Artifacts&lt;/h3>
&lt;div class="pub-artifacts">
&lt;a class="pub-chip" href="https://arxiv.org/pdf/2605.03158" target="_blank" rel="noopener">PDF&lt;/a>
&lt;a class="pub-chip" href="https://github.com/BenAmpel/hackersignal" target="_blank" rel="noopener">Code&lt;/a>
&lt;a class="pub-chip" href="https://hf.co/datasets/BenAmpel/HackerSignal" target="_blank" rel="noopener">Data&lt;/a>
&lt;/div>
&lt;/div>
&lt;div class="pub-extras-card">
&lt;h3>Related Papers&lt;/h3>
&lt;ul class="pub-related">
&lt;li>
&lt;a href="https://bampel.com/conference_publication/dtlel-isi/">Labeling Hacker Exploits for Proactive Cyber Threat Intelligence: A Deep Transfer Learning Approach&lt;/a>
&lt;span>2020 · IEEE ISI&lt;/span>
&lt;/li>
&lt;li>
&lt;a href="https://bampel.com/conference_publication/vuln-ci-isi/">Smart Vulnerability Assessment for Scientific Cyberinfrastructure: An Unsupervised Graph Embedding Approach&lt;/a>
&lt;span>2020 · IEEE ISI&lt;/span>
&lt;/li>
&lt;li>
&lt;a href="https://bampel.com/conference_publication/hack2vec-isi-2021/">Distilling Contextual Embeddings Into A Static Word Embedding For Improving Hacker Forum Analytics&lt;/a>
&lt;span>2021 · IEEE ISI&lt;/span>
&lt;/li>
&lt;/ul>
&lt;/div>
&lt;div class="pub-extras-card">
&lt;h3>Citation&lt;/h3>
&lt;div class="pub-citation">
&lt;div class="pub-citation-text">Benjamin M. Ampel &amp;amp; Sagar Samtani (2026). HackerSignal: A Large-Scale Multi-Source Dataset Linking Hacker Community Discourse to the CVE Vulnerability Lifecycle. In *Proceedings of the Fortieth Annual Conference on Neural Information Processing Systems (NeurIPS 2026), Evaluations &amp;amp; Datasets Track* https://doi.org/10.48550/arXiv.2605.03158&lt;/div>
&lt;div class="pub-citation-actions">
&lt;button class="pub-copy" type="button" data-copy-text="Benjamin&amp;#43;M.&amp;#43;Ampel&amp;#43;%26&amp;#43;Sagar&amp;#43;Samtani&amp;#43;%282026%29.&amp;#43;HackerSignal%3A&amp;#43;A&amp;#43;Large-Scale&amp;#43;Multi-Source&amp;#43;Dataset&amp;#43;Linking&amp;#43;Hacker&amp;#43;Community&amp;#43;Discourse&amp;#43;to&amp;#43;the&amp;#43;CVE&amp;#43;Vulnerability&amp;#43;Lifecycle.&amp;#43;In&amp;#43;%2AProceedings&amp;#43;of&amp;#43;the&amp;#43;Fortieth&amp;#43;Annual&amp;#43;Conference&amp;#43;on&amp;#43;Neural&amp;#43;Information&amp;#43;Processing&amp;#43;Systems&amp;#43;%28NeurIPS&amp;#43;2026%29%2C&amp;#43;Evaluations&amp;#43;%26&amp;#43;Datasets&amp;#43;Track%2A&amp;#43;https%3A%2F%2Fdoi.org%2F10.48550%2FarXiv.2605.03158" data-copy-label="APA">Copy APA&lt;/button>
&lt;button class="pub-copy" type="button" data-copy-text="Benjamin&amp;#43;M.&amp;#43;Ampel&amp;#43;and&amp;#43;Sagar&amp;#43;Samtani.&amp;#43;2026.&amp;#43;%22HackerSignal%3A&amp;#43;A&amp;#43;Large-Scale&amp;#43;Multi-Source&amp;#43;Dataset&amp;#43;Linking&amp;#43;Hacker&amp;#43;Community&amp;#43;Discourse&amp;#43;to&amp;#43;the&amp;#43;CVE&amp;#43;Vulnerability&amp;#43;Lifecycle.%22&amp;#43;In&amp;#43;%2AProceedings&amp;#43;of&amp;#43;the&amp;#43;Fortieth&amp;#43;Annual&amp;#43;Conference&amp;#43;on&amp;#43;Neural&amp;#43;Information&amp;#43;Processing&amp;#43;Systems&amp;#43;%28NeurIPS&amp;#43;2026%29%2C&amp;#43;Evaluations&amp;#43;%26&amp;#43;Datasets&amp;#43;Track%2A&amp;#43;https%3A%2F%2Fdoi.org%2F10.48550%2FarXiv.2605.03158" data-copy-label="Chicago">Copy Chicago&lt;/button>
&lt;button class="pub-copy" type="button" data-copy-text="%40inproceedings%7Bmpel2026hackersignal%2C%0A&amp;#43;&amp;#43;title%3D%7BHackerSignal%3A&amp;#43;A&amp;#43;Large-Scale&amp;#43;Multi-Source&amp;#43;Dataset&amp;#43;Linking&amp;#43;Hacker&amp;#43;Community&amp;#43;Discourse&amp;#43;to&amp;#43;the&amp;#43;CVE&amp;#43;Vulnerability&amp;#43;Lifecycle%7D%2C%0A&amp;#43;&amp;#43;author%3D%7BBenjamin&amp;#43;M.&amp;#43;Ampel&amp;#43;and&amp;#43;Sagar&amp;#43;Samtani%7D%2C%0A&amp;#43;&amp;#43;booktitle%3D%7BIn&amp;#43;%2AProceedings&amp;#43;of&amp;#43;the&amp;#43;Fortieth&amp;#43;Annual&amp;#43;Conference&amp;#43;on&amp;#43;Neural&amp;#43;Information&amp;#43;Processing&amp;#43;Systems&amp;#43;%28NeurIPS&amp;#43;2026%29%2C&amp;#43;Evaluations&amp;#43;%26&amp;#43;Datasets&amp;#43;Track%2A%7D%2C%0A&amp;#43;&amp;#43;year%3D%7B2026%7D%2C%0A&amp;#43;&amp;#43;doi%3D%7B10.48550%2FarXiv.2605.03158%7D%0A%7D" data-copy-label="BibTeX">Copy BibTeX&lt;/button>
&lt;/div>
&lt;/div>
&lt;/div>
&lt;/div>
&lt;/div>
&lt;style>
.pub-extras { margin-top: 2rem; }
.pub-plain { position:relative; border:1px solid rgba(0,229,255,0.35); border-left:4px solid var(--clr-cyan, #00e5ff); border-radius:14px; padding:16px 18px 14px; margin-bottom:18px; background:linear-gradient(180deg, rgba(0,229,255,0.10), rgba(0,229,255,0.04)); }
.pub-plain-tag { display:inline-block; font-size:0.66rem; font-weight:700; text-transform:uppercase; letter-spacing:0.12em; color:var(--clr-cyan, #00e5ff); margin-bottom:6px; }
.pub-plain p { margin:0; font-size:0.95rem; line-height:1.55; color:var(--text, #c9d1d9); }
body:not(.dark) .pub-plain { background:rgba(0,150,180,0.06); border-color:rgba(0,120,150,0.35); }
body:not(.dark) .pub-plain-tag { color:#0b6b80; }
body:not(.dark) .pub-plain p { color:#1a2a33; }
.pub-extras-grid { display:grid; grid-template-columns: repeat(auto-fit, minmax(240px, 1fr)); gap:16px; }
.pub-extras-card { border:1px solid var(--card-border, #333); border-radius:14px; padding:16px; background:var(--card-bg, rgba(0,0,0,0.25)); box-shadow:0 8px 20px rgba(0,0,0,0.12); }
.pub-extras-card h3 { margin:0 0 10px; font-size:0.9rem; text-transform:uppercase; letter-spacing:0.08em; color:var(--clr-green); }
.pub-extras-card ul { margin:0; padding-left:18px; }
.pub-extras-card li { margin-bottom:6px; font-size:0.82rem; line-height:1.4; }
.pub-muted { font-size:0.8rem; opacity:0.7; }
.pub-artifacts { display:flex; flex-wrap:wrap; gap:8px; }
.pub-chip { font-size:0.7rem; text-transform:uppercase; letter-spacing:0.08em; padding:6px 10px; border-radius:999px; border:1px solid rgba(0,229,255,0.35); color:#bde8ff; background:rgba(0,229,255,0.1); text-decoration:none; }
.pub-related { list-style:none; padding:0; margin:0; display:flex; flex-direction:column; gap:8px; }
.pub-related li { display:flex; flex-direction:column; gap:2px; }
.pub-related a { color:var(--clr-cyan); text-decoration:none; font-size:0.82rem; }
.pub-related span { font-size:0.72rem; opacity:0.7; }
.pub-citation { display:flex; flex-direction:column; gap:10px; }
.pub-citation-text { font-size:0.8rem; line-height:1.4; background:rgba(0,0,0,0.35); border-radius:10px; padding:10px; border:1px solid rgba(0,255,65,0.2); }
.pub-citation-actions { display:flex; flex-wrap:wrap; gap:8px; }
.pub-copy { align-self:flex-start; border-radius:999px; border:1px solid rgba(0,255,65,0.4); color:var(--clr-green); background:rgba(0,255,65,0.12); padding:6px 12px; font-size:0.7rem; text-transform:uppercase; letter-spacing:0.08em; cursor:pointer; }
.pub-copy.copied { color:#111; background:var(--clr-green); }
body:not(.dark) .pub-extras-card { background:rgba(255,255,255,0.92); }
body:not(.dark) .pub-extras-card h3 { color:#0b7a2f; }
body:not(.dark) .pub-citation-text { background:rgba(255,255,255,0.9); }
&lt;/style></description></item></channel></rss>