Woowa Brothers details Baemin AI search testing at WooCon 2026
Baemin's automated evaluation tool matched human judgments only 44.6% of the time before being reworked, Woowa Brothers said at WooCon 2026.
Woowa Brothers laid out how it planned and validated Baemin's AI search at WooCon 2026, held at the Grand InterContinental Seoul Parnas in Gangnam, Seoul on October 28, roughly a week after the feature reached its first users.
The company said Baemin released the AI search to a limited group of users on October 20, 2026, and that it sorted AI search policies into three types: straight-line, funnel-shaped and guardrail-shaped. Baemin formed a task force for the project in August 2026.
QA testing of the AI search produced a pass rate of 74.1 percent, with no defined passing threshold. Evaluation criteria were split into safety, judged pass or fail, and quality, scored numerically. The safety side covers four axes — trust, safety, respectful communication and fairness — with eight evaluation elements beneath them.
The initial automated evaluation tool matched human judgments only 44.6 percent of the time. After the tool was reworked, agreement rose to about 90 percent for safety and about 96 percent for quality, according to byline.network.
The team now runs 122 test scenarios in parallel on test accounts and completes an evaluation within five minutes.
Quick answers
When did Baemin launch its AI search?
Baemin released the AI search to a limited group of users on October 20, 2026.
What pass rate did Baemin's AI search QA testing produce?
QA testing produced a pass rate of 74.1 percent, with no defined passing threshold.
Where was WooCon 2026 held?
The conference took place at the Grand InterContinental Seoul Parnas in Gangnam, Seoul on October 28.