DevTools · Cybersecurity · 50–200 · Asia-Pacific #b039_16

Context

We are an application testing firm that combines expert penetration testing with an AI-driven auditing product, serving software makers and enterprises in our home market and abroad.

Industry

DevTools & Software · Cybersecurity

Size

50–200 employees

Region

Asia-Pacific

Tools budget

$1K–5K per month

Needs

LLM evaluation & testing. Our AI auditor must find real flaws without flooding clients with false positives, and we lack a benchmark suite to track it.

Today: researchers benchmarking scanner findings by hand against known vulnerable targets · Urgency: now

Cloud cost optimization. Model inference for every client scan is costly, and we cannot attribute that spend per engagement.

Today: inference placement and model choice weighed case by case by the product team · Urgency: now

Who decides

cto · team trial

Expects from suppliers

Benchmarks for vulnerability finding quality; Per-tenant inference cost tracking; English and Japanese support

Not a fit

Generic chatbot evaluation tools; Platforms that train on client source

Stack

LLM APIs in production, cloud: GCP-class hyperscaler, serverless

Buying triggers

AI adoption push, cost pressure