Many Organizations Waste Money on Ineffective AI Tools Due to Lack of Proper Monitoring

A silent and costly failure in implementing artificial intelligence tools is occurring across many companies and organizations, leading to unnecessary financial losses. Managers often interpret the absence of complaints from staff as a sign of success, but in reality, they continue paying for AI subscriptions that no one actively uses or benefits from. Noam Cohen, founder of CritiqeIL, highlights that many organizations have AI tools and subscriptions, but lack clear metrics to measure their actual impact or improvements.

Cohen compares this to a smoke detector that never beeps, which doesn’t prove it works but rather that no one has checked it recently. He stresses that quietness is not data but an absence of data, especially in professions producing documents like accounting, law, or finance, where failure is hard to detect because outputs continue regardless of AI effectiveness.

To address this, Cohen recommends five key questions for managers: defining what success looks like beyond silence, measuring specific usage metrics such as task completion time and frequency of tool use, understanding how employees benefit from the tools, creating a detailed list of all AI subscriptions with assigned responsibilities, and scheduling regular reviews to prevent forgotten or unused tools from draining budgets. He warns that skipping these steps leads to ongoing waste and false confidence in AI’s value.

Cohen’s advice aims to help organizations avoid the common pitfall of "set and forget" AI tools, ensuring that investments in automation genuinely improve efficiency and do not become silent financial drains.