CCyber Blog

Analysis and practical guides on AI security, AI-enabled attacks, data leakage in generative AI tools, prompt injection, shadow AI, deepfakes, AI governance and emerging technology risks. We help companies use AI faster while keeping security and compliance risks under control.

Is Cybersecurity Slowing AI Adoption? How to Unlock AI Projects Without Increasing Risk

Cybersecurity often slows AI adoption not because it blocks innovation, but because companies lack clear rules, skills, data classification, tool approval processes, supplier controls and accountability models. The biggest risks include shadow AI, data leakage into public tools, lack of output validation, prompt injection, uncontrolled integrations, missing logs, no AI policy and a shortage of experts who combine AI, cybersecurity, legal and business understanding. A good AI security programme does not stop adoption. It accelerates it by giving teams safe rules, an approved tool list, approval paths, monitoring, training and measurable outcomes.

Prepared by: CCyber Editorial Team

Short answer

Cybersecurity can slow AI adoption, but it should not block it. The problem usually does not lie in artificial intelligence itself, but in the lack of rules: who may use AI, for what data, in which processes, with which tools, with what oversight and who is responsible for the output. Companies fear data leakage, wrong answers, prompt injection, shadow AI, GDPR violations, AI Act uncertainty and loss of control over suppliers. At the same time, many organizations lack experts who can combine AI, cybersecurity, legal, compliance and business process knowledge. The solution is not an AI ban, but AI governance: AI policy, data classification, approved tool list, use case approval process, monitoring, training, security testing and clear accountability.

Last updated

July 2026

Who this article is for

  • boards and business owners who want to adopt AI without chaos and data risk
  • CIOs, CTOs, CISOs, vCISOs, AI Leads, CDOs and digital transformation owners
  • SMEs using ChatGPT, Copilot, Gemini, Claude, AI-enabled SaaS or AI agents
  • companies pausing AI projects because of security, GDPR, compliance or expert shortages
  • HR, marketing, sales, finance, customer service and operations teams using AI in daily work
  • IT and security teams that need to enable AI while keeping data under control
  • compliance, legal, DPO, internal audit and risk management teams
  • companies preparing for AI Act, NIS2, national cybersecurity rules, ISO 27001, DORA or customer audits

Key takeaways

  1. Cybersecurity slows AI when a company lacks policy, approval process, data classification and accountability.
  2. The biggest risk is shadow AI, meaning use of AI tools outside organizational knowledge and control.
  3. Expert shortages do not have to stop AI adoption, but they require governance, training, vCISO, AI Lead or external support.
  4. Secure AI requires procedural and technical controls together, not only one document or one tool.
  5. The best AI security programme does not say “AI is forbidden”. It says: when it is allowed, how it is allowed, with which data and who oversees it.

Why does cybersecurity slow AI adoption?

In many companies, AI appeared faster than rules for its use. Employees started using public generative tools to write emails, analyze documents, summarize meetings, create code, compare offers, support customers and prepare reports. Some of these use cases are valuable. Some can be risky.

Security teams often react carefully because they see risks that users do not: personal data, customer data, business information, source code, trade secrets, financial documents, contracts, HR data, medical data, production data and information covered by NDAs.

Most common reasons for blocking AI

  • no AI usage policy
  • no data classification
  • no approved tool list
  • no AI supplier assessment process
  • fear of data leakage into public models
  • no logs and auditability
  • no accountability for AI output
  • lack of experts combining AI, cyber, legal and business
  • regulatory uncertainty, including AI Act and GDPR
  • risk of wrong decisions based on AI answers

The biggest problem: AI is adopted bottom-up

Many companies do not start with an AI strategy. They start with employees who find tools, test them at work and exchange tips. This creates shadow AI. It is natural because the tools are simple, available and often useful. The problem is that the organization loses visibility.

Shadow AI means the company does not know:

  • which AI tools employees use
  • which data is entered into them
  • whether the tool trains on user data
  • where data is stored
  • who has access to prompt history
  • whether AI answers are verified
  • whether AI output reaches customers without review
  • whether the tool meets GDPR, AI Act and customer contract requirements

A ban on AI often makes the situation worse. Employees keep using tools, but outside the official process. A better approach is to create safe paths of use.

AI security is not the same as AI governance

AI security focuses on protecting systems, data, models, integrations and users from threats. AI governance is broader. It includes rules, roles, accountability, risk, compliance, processes, auditability and management oversight.

AI security answers:

  • is data protected?
  • is access controlled?
  • is prompt injection limited?
  • are logs available?
  • are the model and integrations secure?
  • is the AI supplier assessed?

AI governance answers:

  • who may use AI?
  • for which processes?
  • with which data?
  • who approves a new tool?
  • who is responsible for the output?
  • when is legal or DPIA review needed?
  • how do we measure impact and risk?
  • how do we report AI use to the board?

Which AI risks must be controlled?

1. Data leakage

The simplest risk scenario: an employee pastes customer data, a contract, source code, personal data, financial results or internal document into a public AI tool. Even if done in good faith, the company may lose control over information.

2. Wrong answers and hallucinations

AI can generate answers that sound confident but are wrong. The risk increases when AI output is used in legal, financial, HR, medical, technical decisions or customer communication.

3. Prompt injection

Prompt injection means an attacker hides instructions in content that AI is asked to process. If an AI system has access to tools, documents, email, CRM or APIs, it may perform unwanted actions or disclose data.

4. Excessive autonomy of AI agents

AI agents can perform actions, not only generate text. They can send messages, make queries, modify data, launch processes, download files or connect to APIs. The more autonomy, the greater the need for control, logging and approval.

5. Unclear accountability

If AI prepares a wrong analysis, sends a bad recommendation or generates content that breaches confidentiality, the company must know who is accountable: employee, manager, process owner, supplier or AI owner.

6. Supplier risk

AI adoption often means entrusting data to a SaaS, cloud, model or integration provider. Data location, model training terms, retention, logs, subprocessors, incident history, encryption and exit plan must be checked.

7. Legal and contractual breach

AI may touch GDPR, trade secrets, intellectual property, customer contracts, AI Act, sector rules and internal policies. Lack of governance increases breach risk.

Why does lack of experts block AI so strongly?

AI is interdisciplinary. A prompt specialist is not enough. A lawyer is not enough. An IT administrator is not enough. The organization needs a combination of data, security, architecture, legal, process, change management and business skills.

Companies usually need roles such as:

  • AI owner or AI lead
  • CISO or vCISO
  • DPO or privacy expert
  • IT or cloud architect
  • business process owner
  • legal and compliance
  • security engineer
  • training and communication owner
  • board-side risk owner

When these roles are missing, AI becomes “everyone’s and nobody’s project”. That is the easiest path to chaos, shadow AI and AI projects blocked by security.

How to unlock AI without increasing risk?

The company should implement a model that works like a safe highway for AI. Employees know which vehicles they can use, how fast, which lanes are allowed and where emergency exits are. Without this, everyone drives their own route.

Minimum AI governance model

  • AI usage policy
  • data classification
  • approved, conditionally approved and prohibited tool list
  • new use case submission process
  • AI risk assessment
  • AI supplier assessment
  • human oversight rules
  • logging and audit rules
  • employee training
  • board reporting

AI policy: a document that should help, not scare

A good AI policy should be short, practical and understandable. It should not only list prohibitions. It should show how to use AI safely in everyday work.

An AI policy should answer:

  • which AI tools can be used?
  • which data must not be entered?
  • when must a company tool be used instead of a public tool?
  • when is IT, legal or DPO approval required?
  • can AI output be sent to customers?
  • when is human verification required?
  • how should an AI incident be reported?
  • how should AI-generated content be labelled where required?

Example simple rule

Do not enter personal data, customer data, trade secrets, source code, NDA-covered documents, financial data, medical data or any information we would not publish outside the company into public AI tools.

Data classification for AI

Without data classification, employees do not know what is safe and what is risky. Classification does not have to be complex. Four levels are enough to start.

Level 1: public data

Data that can be published on the company website. It may be used in AI tools if it does not contain personal data or secrets.

Level 2: internal data

Data used inside the company, but without high confidentiality. It may be used in approved company tools if the policy allows it.

Level 3: confidential data

Customer data, pricing, contracts, strategy, financial reports, projects, HR data and NDA-covered documents. Requires approved tools, access controls and often legal review.

Level 4: sensitive and critical data

Medical data, special category data, technology secrets, source code, security data, critical production data and regulated information. Requires a special approval path or prohibition unless a dedicated architecture is used.

AI tool list: green, yellow and red

The company should create a simple AI tool list. Employees must know which tools are approved, which require approval and which cannot be used.

Green tools

  • approved by IT and security
  • covered by a company agreement
  • have defined data rules
  • have logging and access control
  • have training on company data disabled where required

Yellow tools

  • can be used after assessment of a specific use case
  • require process owner approval
  • may require DPO, legal or security assessment
  • may have data restrictions

Red tools

  • do not have clear data processing terms
  • train on user data without control
  • do not provide logs or access controls
  • do not have acceptable legal terms
  • are not approved for company use

AI use case approval process

Not every AI project needs months of analysis. The process should be proportionate to risk. A simple chatbot for general marketing ideas is a different risk level than AI analyzing customer data or making HR decisions.

The process should include:

  • business objective description
  • input data description
  • tool or supplier description
  • risk classification
  • GDPR and confidentiality assessment
  • supplier security assessment
  • human oversight rules
  • test plan
  • success metrics
  • business owner

AI Act: what should a company know practically?

The AI Act uses a risk-based model. Most simple AI uses will have minimal or limited risk. Some use cases may fall into high-risk areas, especially when AI affects employment, evaluation of people, education, access to services, healthcare, safety or critical infrastructure.

Practical AI Act checklist

  • do we know where AI is used in the company?
  • do we classify AI systems by risk?
  • could any use case be high-risk?
  • do we have human oversight?
  • do we log system use?
  • do we inform users when required?
  • do we assess AI suppliers?
  • do we have documentation and evidence?
  • do we train employees on AI usage rules?

AI security in technical practice

1. Access control

AI tools should use company login, MFA, roles, groups, administrator controls and access removal after employee departure.

2. Data protection

The company must define which data may be processed, whether it is encrypted, whether it leaves the EEA, whether it may be used for training and how long it is stored.

3. Logging and audit

The organization should know who uses the tool, when, with which data and in which process. Without logs, audit and incident response are difficult.

4. DLP and paste control

DLP can help detect confidential data being entered into AI tools. It does not replace training and clear policy.

5. Isolation and least privilege for agents

AI agents should have minimum permissions, limited API access, action control, approval of critical operations and logging.

6. AI security testing

Internal AI applications should be tested for prompt injection, data disclosure, improper output handling, excessive autonomy and integration vulnerabilities.

Prompt injection: why is it different from classic vulnerabilities?

In classic applications, it is easier to separate instructions from data. In LLM systems, this boundary may be blurred because the model processes instructions and content in one context. A document, email, web page or CRM record may contain a hidden instruction that affects AI behaviour.

How to limit prompt injection?

  • do not trust input from external sources
  • limit model access to data and tools
  • apply least privilege
  • require human approval for high-risk actions
  • separate contexts and data sources
  • test AI applications with red team scenarios
  • log prompts, answers and tool actions
  • do not use LLMs for uncontrolled critical operations

How to train employees on AI security?

Training should be practical and role-based. Marketing, HR, finance, IT, sales and the board need different rules.

General training for everyone

  • what shadow AI is
  • which data is forbidden in public tools
  • how to verify AI answers
  • how to label AI content where needed
  • how to report an AI incident

Training for managers

  • how to assess an AI use case idea
  • how to measure business impact
  • how to recognize data risk
  • when to escalate to security, legal or DPO
  • how not to pressure teams into bypassing rules

Training for IT and security

  • AI supplier assessment
  • logging and integrations
  • DLP and access control
  • prompt injection testing
  • private AI or enterprise AI architecture
  • AI agent monitoring

How to measure whether AI is adopted safely?

Governance metrics

  • number of registered AI use cases
  • number of approved and prohibited tools
  • percentage of use cases with business owner
  • number of use cases after risk assessment
  • number of exceptions accepted by the board

Security metrics

  • number of detected shadow AI uses
  • number of AI-related incidents
  • number of attempts to enter confidential data into AI
  • number of AI tools with MFA and logging
  • number of AI applications after security testing

People metrics

  • percentage of employees trained in AI security
  • number of managers trained in AI governance
  • number of safe AI use questions reported
  • number of teams with an AI champion

Business impact metrics

  • number of processes improved by AI
  • time saved in pilot processes
  • number of production deployments after pilots
  • number of projects stopped because of risk
  • number of projects unlocked after controls were implemented

30, 60 and 90-day action plan

First 30 days

  • assign AI governance owner
  • identify AI tools used in the company
  • perform quick shadow AI review
  • prepare temporary AI policy
  • introduce simple data classification for AI
  • define approved and prohibited tools
  • launch AI questions and reporting channel
  • present first AI risk map to the board

Days 31 to 60

  • develop target AI policy
  • create approval process for new use cases
  • assess key AI tool suppliers
  • launch employee AI security training
  • define human oversight rules
  • define logging and audit requirements
  • prepare AI risk assessment template
  • select 2-3 safe AI pilots

Days 61 to 90

  • test AI pilots with real users
  • perform security testing of AI applications
  • implement monitoring of approved tools
  • prepare AI incident procedure
  • define AI KPIs and KRIs
  • prepare board report
  • approve 12-month AI security roadmap
  • define budget for tools, training and expert support

Common AI adoption mistakes

Mistake 1: ban without alternative

The company bans AI, but provides no safe tool or clear approval path. Employees move to shadow AI.

Mistake 2: AI policy written in legal language

The document is formally correct, but the employee still does not know whether they may paste an offer, customer email or code fragment into an AI tool.

Mistake 3: no owner

AI is simultaneously an IT, business, HR, legal and security matter. In practice, nobody makes decisions.

Mistake 4: no data classification

Without simple data levels, users guess what is confidential. This leads to mistakes.

Mistake 5: no AI supplier assessment

The company buys a tool, but does not check what happens to data, logs, subprocessors and prompt history.

Mistake 6: no output verification

AI generates an answer that reaches a customer, decision or report without human review.

Mistake 7: no security testing

The company builds an AI application with access to data and APIs, but does not test prompt injection, output handling and excessive autonomy.

Mistake 8: measuring number of tools instead of outcomes

The board hears that the company has AI, but does not know which processes improved, what risks appeared and how many projects are in production.

How not to kill innovation with rules?

AI governance should not be bureaucracy. Good rules unlock adoption because employees know what they can do. Security stops being the function that says “no” and becomes the partner that gives a safe path.

Good rules are:

  • simple
  • role-based
  • proportionate to risk
  • understandable for employees
  • supported by tools
  • measured
  • regularly updated

A bad rule says:

Do not use AI.

A good rule says:

You may use approved AI tools for public and internal data. Confidential data requires a company-approved tool and process owner approval. Sensitive data requires separate legal, DPO and security assessment.

Practical example

A services company has 220 employees. Marketing uses generative tools to create content. HR tests AI for CV analysis. Sales uses AI to prepare offers. IT launches Copilot. Legal learns that fragments of contracts were pasted into public tools. Security wants to block all AI tools.

The board chooses a middle path. The company creates an AI policy, data classification, approved tool list, use case approval process and employee training. HR pauses automated CV assessment until legal and risk review is completed. Marketing receives clear rules on what data it may use. Sales receives prompt templates without customer data. IT implements logging and access control for company tools.

After 90 days, the company has no chaos. It has 12 approved use cases, 3 high-risk projects paused, 80% of employees trained, tool list, risk register and board report. AI was not blocked. It was governed.

Related CCyber resources and services

This topic can be connected with further reading and CCyber services to move from fear of AI to a safe adoption programme.

  • CCyber Blog - related articles on AI security, shadow AI, prompt injection, AI governance, NIS2, national cybersecurity rules, training, MFA, backup and suppliers.
  • AI Security - AI risk assessment, AI policy, shadow AI control, AI application security testing and governance.
  • Secure IT deployments - AI, cloud, SaaS and e-service deployments with security, access and compliance in mind.
  • EU regulatory compliance - preparation for NIS2, DORA, CRA, AI Act, ISO 27001 and customer requirements.
  • vCISO - external CISO, strategy, governance, board reporting and oversight of AI and cyber risk.
  • Managed services MSS / MDR / vCISO - monitoring, alert handling, SOC, MDR and operational security support.
  • Cyber Academy and training - training for employees, boards, IT, security, AI owners and business teams.

How can ccyber.io help?

ccyber.io helps companies adopt AI without increasing data, compliance and cybersecurity risk. We do not start with prohibitions. We start with an AI usage map, data classification, risks, business processes and rules that let teams use new tools safely.

We can support your organization with:

  • AI security assessment
  • shadow AI discovery
  • AI usage policy
  • data classification for AI
  • AI use case approval process
  • AI and SaaS supplier assessment
  • mapping AI to AI Act, GDPR, NIS2, national cybersecurity rules and ISO 27001
  • prompt injection and AI application security testing
  • secure AI architecture design
  • AI usage monitoring and logging
  • AI security training for employees, managers and IT
  • AI incident tabletop
  • board report and 12-month AI security roadmap

The best first step is an AI Security and Governance Workshop. In a short workshop, the company can determine where AI is used, which data is most risky, which use cases should be unlocked, which should be paused and which rules should be implemented in the first 90 days.

FAQ

Does cybersecurity really slow AI adoption?

Yes, but often because the company lacks rules, data classification, approval process and accountability. Good cybersecurity does not block AI. It creates safe conditions for deployment.

What is shadow AI?

Shadow AI means using AI tools outside organizational knowledge and control. It most commonly involves public chatbots or AI plug-ins used with company data without approval from IT, security or legal.

Is writing an AI policy enough?

No. A policy is needed, but it must be supported by training, tool list, data classification, supplier assessment, monitoring and use case approval process.

Should the company ban public AI tools?

Not always. It is better to define which data and tasks they may be used for and which they cannot. Confidential data usually requires approved company tools or a dedicated architecture.

What is prompt injection?

It is an attack where external content contains hidden instructions affecting the AI model’s behaviour. The risk increases when AI has access to documents, email, APIs or can perform actions.

Does AI Act apply to every company?

The AI Act uses a risk-based model. Obligations depend on whether the company is a provider or deployer, which system it uses and whether the use case is minimal, limited, high-risk or prohibited.

Who should own AI governance?

It is usually shared by AI owner, IT, security, legal, DPO and business. However, there must be one person or committee that makes decisions and reports to the board.

Where should we start?

Start with AI usage mapping, data classification, temporary AI policy, approved tool list, employee training and a process for assessing new use cases.

Summary

Cybersecurity does not have to slow AI adoption. It can unlock it if the company builds clear usage rules, data classification, approval paths, supplier assessment, monitoring and training. The biggest problem is not the technology itself, but lack of governance.

Companies that ban AI without alternatives risk shadow AI. Companies that adopt AI without rules risk data leaks, wrong decisions, regulatory issues and loss of trust. The best organizations choose the third path: secure AI adoption with clear rules, human oversight and measurable outcomes.

The best rule is: do not ask only whether AI is secure by itself. Ask whether your company knows who uses AI, for what, with which data, who is accountable for the output and which controls work when something goes wrong.

Sources

Where Do AI Safeguards End and Board Accountability for AI Begin?

AI safeguards such as content filters, DLP, usage policies, human approval, monitoring, logging, sandboxing, AI gateways and access restrictions are necessary, but they do not replace board accountability. Their role ends where decisions are needed about the purpose of AI use, acceptable risk, data, suppliers, compliance, impact on customers, people, processes and reputation. The board does not need to know every prompt or model configuration. It must approve rules, roles, budget, risk appetite, oversight, metrics, incident escalation and evidence that AI is used responsibly.

Prepared by: CCyber Editorial Team

Short answer

An AI safeguard is a control designed to reduce risk: content filter, confidential data blocking, human approval, monitoring, logs, access restriction, sandbox, approved tool list, AI gateway or escalation procedure. Such a safeguard is necessary, but it does not own strategy, risk and business consequences. The role of a safeguard ends where someone must decide whether the company should use AI in a given process, which data may be processed, who approves outputs, which provider is allowed, what error level is acceptable, whether the system may affect customers or employees and who is responsible after an incident. These decisions belong to the board and process owners, not to the tool itself.

Last updated

July 2026

Who this article is for

  • boards and business owners deploying AI
  • CISOs, vCISOs, CTOs, CIOs, CDOs and technology owners
  • compliance, risk, legal, DPO and internal audit teams
  • HR, finance, sales, customer service, marketing and operations using AI tools
  • software houses, SaaS companies and AI solution providers
  • SMEs using ChatGPT, Copilot, Gemini, Claude, AI assistants or agentic tools
  • companies preparing for the AI Act, ISO/IEC 42001, NIS2, ISO 27001, customer audits or cyber insurance
  • organizations that want to distinguish technical control from board accountability

Key takeaways

  1. AI safeguards reduce risk, but they do not remove accountability from the board.
  2. AI governance is not only an IT topic. It concerns strategy, risk, data, suppliers, people, compliance, reputation and business continuity.
  3. The board does not need to know every model detail, but it must approve AI usage rules, risk appetite, roles, budget, oversight and escalation.
  4. The greatest risk appears when the company deploys AI faster than its rules, training, data control and monitoring.
  5. A mature organization has an AI use case register, risk classification, process owners, approved suppliers, data policy and oversight evidence.

What does “safeguard” mean in AI?

In company practice, a safeguard is a mechanism designed to prevent an unwanted effect or reduce its impact. It may be technical, organizational, legal or process-based.

Examples of AI safeguards

  • model content filter
  • DLP blocking confidential data from being sent to an AI tool
  • approved AI tool list
  • ban on using customer data in public AI tools
  • human approval before sending AI output to a customer
  • AI gateway controlling prompts and responses
  • prompt and output logging
  • AI sandbox
  • access restrictions
  • LLM application red teaming
  • prompt injection testing
  • AI incident reporting procedure
  • kill switch for an AI agent

The problem begins when a company assumes that because it has a filter, policy or human approval, accountability is closed. It is not. A safeguard is a control. Accountability means decision, oversight and consequences.

Where does the role of a safeguard end?

A safeguard reaches its limit where a technical control cannot answer a business, legal or ethical question.

A safeguard can:

  • block some confidential data
  • detect a suspicious prompt
  • limit access to a tool
  • force human approval
  • save logs
  • warn about risk
  • stop an AI agent after a limit is exceeded

A safeguard will not decide:

  • whether the company should use AI in a specific process
  • whether the error risk is acceptable
  • whether customer data may be used in this tool
  • whether the provider meets company requirements
  • whether AI output may reach the customer without review
  • whether the system affects employee or customer rights
  • whether an incident requires notification
  • whether deployment should be stopped
  • who is responsible for the business outcome

These are governance decisions. They may be prepared by IT, security, legal, DPO and process owners, but they need a clear business owner.

Where does board accountability begin?

Board accountability begins when AI stops being a single employee experiment and becomes part of a business process, decision, customer relationship, product, automation, data analysis or operational action.

The board is accountable for:

  • purpose of AI use in the company
  • AI risk appetite
  • allowed and prohibited use rules
  • roles and responsibilities
  • budget for security and compliance
  • oversight of AI suppliers
  • protection of data and trade secrets
  • impact of AI on customers and employees
  • AI incident response
  • evidence of due diligence

The board does not need to approve every prompt. It should approve the framework in which AI is used. Without such a framework, employees and suppliers make decisions on behalf of the company without a clear mandate.

AI as a governance risk, not only a technology risk

AI can create value, but also risk. Some risks resemble classic IT risks, such as data leakage, misconfiguration, supplier vulnerability or missing logs. Others are more specific to AI.

Typical AI risks for the board

  • disclosure of confidential data in a public AI tool
  • decision made based on an incorrect model answer
  • overreliance on AI output
  • prompt injection in an LLM application
  • AI agent performing unintended actions
  • copyright or trade secret violation
  • discrimination or unequal treatment
  • inability to explain a decision
  • non-compliance with the AI Act, GDPR, NIS2 or customer requirements
  • reputational loss after incorrect automation

This is why AI cannot be managed only through the instruction “use carefully”. A governance programme is needed, connecting people, processes, technology and evidence.

10 boundaries between safeguard and board accountability

1. AI use policy

A safeguard may block some tools, but it will not define what the company may use AI for. The board should approve an AI use policy.

Board decisions

  • which AI uses are allowed
  • which uses are prohibited
  • who approves new use cases
  • which data may be used
  • when human approval is required

Evidence

  • AI use policy
  • approved tool list
  • AI use case register
  • employee training confirmation

2. Data and privacy

DLP may detect an ID number, payment card or keyword. It will not answer whether an AI process may process customer, employee or medical data.

Board and data owner decisions

  • which data is prohibited in AI tools
  • which data may be processed after anonymization
  • whether the AI provider may train on company data
  • whether DPIA is required
  • who accepts exceptions

Evidence

  • data classification
  • rules for using data in AI
  • DPIA or privacy assessment where required
  • AI supplier contract
  • DLP or AI gateway report

3. AI suppliers

A safeguard may limit access to a tool, but it does not replace supplier assessment. The board and process owners must know who receives company data, processes and decisions.

Governance decisions

  • which AI suppliers are approved
  • which security requirements they must meet
  • whether data is processed outside the EEA
  • whether the supplier uses company data to train models
  • what the exit plan looks like

Evidence

  • AI supplier register
  • supplier risk assessment
  • contract and DPA
  • SLA and incident rules
  • exit plan

4. Human oversight

“Human in the loop” is often treated as a magical safeguard. In practice, it works only when the human has competence, time, authority and real ability to challenge the AI output.

Governance decisions

  • which processes require human approval
  • who can approve AI outputs
  • when the human must stop the process
  • how decisions are documented
  • how to avoid rubber-stamping AI outputs

Evidence

  • human oversight procedure
  • approval log
  • training for approvers
  • report of errors and reversed decisions

5. AI agent and autonomy

An AI agent that can use tools, perform actions, send messages, start processes or change data requires stronger oversight than a chatbot answering questions.

Governance decisions

  • whether the agent may act autonomously
  • which tools it may call
  • which action limits it has
  • when human approval is required
  • how the kill switch works

Evidence

  • AI agent register
  • map of agent tools and permissions
  • action limits
  • agent action log
  • kill switch test

6. Prompt injection and LLM application security

A prompt filter can help, but it is not enough. An LLM application that reads documents, emails, websites or customer data must be designed as a system exposed to hostile input.

Governance decisions

  • whether the LLM application may access production data
  • whether it may perform actions in company systems
  • whether security testing is required before deployment
  • who accepts residual risk after testing
  • how to respond to detected prompt injection

Evidence

  • LLM application threat model
  • prompt injection test
  • insecure output handling test
  • AI vulnerability register
  • remediation plan

7. AI in decisions about people

If AI affects recruitment, employee evaluation, customer scoring, benefit allocation, access to a service or risk decisions, a technical safeguard is not enough. Impact assessment and oversight are needed.

Governance decisions

  • whether AI may support a decision about a person
  • whether AI output is only a recommendation
  • how a human can challenge the output
  • whether the system may be high-risk
  • how bias and data quality are monitored

Evidence

  • use case risk assessment
  • impact assessment on people’s rights
  • bias and data quality test
  • appeal or correction procedure
  • decision log

8. Compliance and regulation

A technical system will not automatically tell the company whether a use case falls under the AI Act, GDPR, sector rules, NIS2, DORA or a customer contract. A qualification process is needed.

Governance decisions

  • who qualifies AI use cases
  • when legal review is required
  • when DPO review is required
  • when customers must be informed about AI use
  • which evidence must be retained

Evidence

  • AI compliance checklist
  • AI use case register
  • AI Act analysis
  • DPIA where required
  • evidence matrix

9. AI incidents

AI may generate an incorrect answer, disclose data, perform an unwanted action, violate procedure, be manipulated by prompt injection or behave differently after a model change. The company must know when this becomes an incident.

Governance decisions

  • what counts as an AI incident
  • who classifies the incident
  • when the AI system must be stopped
  • when to inform a customer
  • whether the incident requires regulatory notification

Evidence

  • AI incident response procedure
  • prompt injection playbook
  • AI data leakage playbook
  • AI incident register
  • post-incident report

10. Board reporting

A safeguard may generate alerts, but the board needs risk metrics. It is not enough to say that “AI works”. The board needs to know where it works, on which data, with which risks and with which incidents.

Governance decisions

  • how often the board receives an AI report
  • which metrics are critical
  • which gaps require budget
  • which risks are accepted
  • which deployments must be stopped

Evidence

  • AI risk report for the board
  • AI risk register
  • incident and near miss list
  • remediation action status
  • board decisions

AI accountability model in the company

Board

  • approves AI strategy
  • approves risk appetite
  • approves AI policy
  • provides budget
  • receives reports
  • accepts high-level risks

Business process owner

  • owns the business purpose of AI use
  • defines process data and output
  • accepts impact on customer or employee
  • ensures human oversight
  • owns process quality after AI deployment

IT and security

  • implement secure architecture
  • control access
  • monitor logs and incidents
  • test AI applications
  • implement AI gateway, DLP and other controls

Legal, compliance and DPO

  • assess legal and contractual compliance
  • check GDPR and AI Act
  • support DPIA and impact assessments
  • review AI supplier contracts
  • define information duties

HR and training

  • train employees
  • manage AI literacy
  • communicate AI usage rules
  • ensure role-based training

Internal audit

  • checks evidence
  • verifies policy implementation
  • assesses control effectiveness
  • reports gaps independently of the process owner

Questions the board should ask about AI

  • where do we use AI in the company?
  • which AI use cases are critical for the business?
  • do we have an AI tools and use cases register?
  • what data goes into AI tools?
  • do employees use Shadow AI?
  • does AI affect customers, employees or financial decisions?
  • do we have high-risk AI use cases?
  • do we have approved AI suppliers?
  • are AI outputs reviewed by humans?
  • do we have an AI incident procedure?
  • do we test prompt injection and LLM application security?
  • do we log AI use and decisions?
  • do we have budget for AI governance and security?
  • which AI risks do we accept and which do we reject?

Minimum AI governance pack for a company

1. AI use register

The company should know where AI is used: by employees, in processes, in products, by suppliers and in cloud tools.

2. Risk classification

Every AI use case should be assessed as low, medium, high, regulated, prohibited or requiring a board decision.

3. AI policy

The policy should clearly state what is allowed, what is prohibited, which data is banned, when approval is required and where to report issues.

4. Approved tools list

Employees should know which tools they may use and with which data.

5. AI supplier assessment

Suppliers should be assessed for data, security, processing location, model training, incidents and exit from the service.

6. Technical safeguards

Depending on risk: SSO, MFA, DLP, AI gateway, logs, monitoring, sandbox, access control, red teaming and security testing.

7. Human oversight

The company should know where AI output requires human review and how that review is documented.

8. AI incident procedure

An AI incident should have an escalation path, owner, system stop criteria and communication plan.

9. Training and AI literacy

Employees must understand how to use AI safely, what not to paste, how to verify outputs and when to report risk.

10. Board report

The board should periodically see the AI use map, risks, incidents, suppliers, gaps and remediation actions.

When must a decision go to the board?

Not every chatbot requires a board decision. But some AI use cases should be escalated.

Escalate to the board if AI:

  • affects decisions about customers or employees
  • processes special category data
  • has access to confidential data or trade secrets
  • can send messages to customers
  • can perform actions in company systems
  • is used in a product sold to customers
  • is used in a regulated sector
  • may affect safety or business continuity
  • may be a high-risk system
  • requires major cost or long-term supplier dependency

Documents and evidence for the board

Strategic documents

  • AI usage strategy
  • AI policy
  • AI risk appetite
  • AI accountability model
  • AI committee or AI forum charter

Operational documents

  • AI use case register
  • AI supplier register
  • rules for using data in AI
  • procedure for approving new use cases
  • AI incident response procedure

Technical documents

  • AI architecture
  • DLP or AI gateway report
  • usage logs
  • prompt injection tests
  • quality and security tests
  • model card or system card where used

Oversight evidence

  • AI risk report for the board
  • decision records
  • risk acceptances
  • incident and near miss reports
  • remediation action list
  • AI literacy training report

30, 60 and 90-day action plan

First 30 days

  • assign AI governance owner
  • collect the list of AI tools in use
  • identify Shadow AI
  • prepare a simple AI use policy
  • define which data is prohibited in AI
  • launch process for reporting new use cases
  • prepare the first AI use case register
  • present top risks to the board

Days 31 to 60

  • assess risk of the most important use cases
  • prepare approved AI tool list
  • assess AI suppliers
  • implement basic access control and logging
  • prepare human oversight rules
  • train employees on AI literacy
  • prepare AI incident response procedure
  • launch board reporting

Days 61 to 90

  • perform prompt injection testing for LLM applications
  • check DLP and data protection in AI tools
  • run an AI incident tabletop
  • update AI supplier contracts
  • prepare AI risk metrics
  • close the most important gaps
  • approve 12-month AI governance roadmap
  • define quarterly AI review cycle

Board metrics

Visibility metrics

  • number of AI use cases in the register
  • number of AI tools outside the approved list
  • number of AI suppliers after risk assessment
  • number of processes without AI owner

Risk metrics

  • number of high-risk AI use cases
  • number of use cases processing confidential data
  • number of AI agents able to perform actions
  • number of AI policy exceptions

Security metrics

  • number of blocked attempts to paste confidential data
  • number of prompt injection tests
  • number of AI incidents and near misses
  • AI incident response time

Governance metrics

  • number of trained employees
  • number of board decisions on AI
  • number of open remediation actions
  • number of overdue actions

Common company mistakes

Mistake 1: believing a content filter solves the problem

A filter may help, but it does not replace data classification, access control, policy, training and acceptable risk decisions.

Mistake 2: no AI register

The company does not know where AI is used. Without a register, risk, suppliers and compliance cannot be managed.

Mistake 3: “human in the loop” only on paper

If the human has no time, knowledge or authority to stop the process, human oversight does not work.

Mistake 4: AI deployed by departments without risk assessment

Marketing, sales, HR or finance may deploy an AI tool faster than IT and legal can assess data, contracts and impacts.

Mistake 5: no data rules

Employees do not know whether they may paste customer data, contracts, source code, employee data or financial documents.

Mistake 6: AI agent without limits

An agent with access to email, CRM, code repository or ticketing system can cause harm faster than a classic chatbot.

Mistake 7: no LLM application security testing

LLM applications need prompt injection testing, output handling controls, access control, logging and limits on excessive autonomy.

Mistake 8: board sees only benefits

AI may increase productivity, but the board should also see risks, incidents, data, suppliers, costs and accountability.

Business example

A services company deploys an AI assistant for customer inquiries. The tool has access to a knowledge base, proposal documents and selected CRM data. Sales treats the deployment as a productivity project. IT sets SSO and logging. Security adds a content filter. The board receives information that “AI has safeguards”.

A short review shows the problem is broader. The assistant may generate an answer based on outdated pricing policy. It may disclose part of a document intended only for selected customers. Nobody has defined who approves answers for strategic customers. The AI supplier contract does not clearly describe the use of company data for model training. There is no AI incident procedure.

The company does not shut the project down. It moves it into a controlled model. It creates an AI use register, limits data access, introduces human approval for high-risk answers, updates the supplier contract, tests prompt injection and prepares a board report. Safeguards remain necessary, but the board now has real risk oversight.

How can ccyber.io help?

ccyber.io helps companies distinguish technical AI safeguards from real governance accountability. We build a practical AI governance model that connects security, compliance, data, suppliers, training, incidents and board decisions.

We can support your organization with:

  • AI governance assessment
  • AI and Shadow AI use case register
  • company AI use policy
  • AI risk classification
  • AI supplier assessment
  • data use rules for AI
  • AI Act readiness
  • ISO/IEC 42001 readiness
  • prompt injection and LLM application security testing
  • AI incident response procedure
  • AI literacy training for board and employees
  • AI risk report for the board
  • 30, 60, 90-day and 12-month AI governance roadmap

The best first step is an AI Governance Workshop for the board. In a short workshop, the company can define where AI is used, which use cases are riskiest, which safeguards already exist and which decisions must be taken by the board.

FAQ

Are AI safeguards enough to make a company safe?

No. Safeguards are necessary, but they must operate within policy, oversight, accountability, supplier control, data protection, testing and incident procedures.

Does the board need to know technical model details?

The board does not need every detail. It must understand risks and approve rules, budget, roles, risk appetite and oversight metrics.

Who is responsible for AI in a company?

Responsibility is shared. The board owns the framework and oversight. The process owner owns business use. IT and security own technical controls. Legal, compliance and DPO own compliance. HR owns training.

Does human in the loop always solve the problem?

No. The human must have competence, time, information and authority to stop the process. Otherwise it is only a formal safeguard.

What is Shadow AI?

Shadow AI means using AI tools outside organizational awareness and control. It may include private accounts, public chatbots, unapproved plugins, meeting transcription and document analysis tools.

When does AI require a board decision?

When it affects customers, employees, financial decisions, confidential data, regulated processes, safety, the company’s product or can perform actions autonomously.

Which evidence is worth having?

AI register, AI policy, risk assessment, supplier list, data rules, security tests, incident report, training records and board decision minutes.

Where should we start?

Start with an AI use register and simple rules: what is allowed, what is prohibited, which data is banned, who approves new uses and where to report incidents.

Summary

AI safeguards are important, but they do not replace governance. Filters, DLP, human approval, logs and AI gateways reduce risk, but they do not decide whether the company should use AI in a specific process and what consequences it is ready to accept.

Board accountability begins where AI affects business, people, customers, data, reputation and compliance. The board should approve policy, risk appetite, roles, reporting, budget and incident procedures.

The best rule is: do not ask only what safeguards the AI tool has. Ask who is responsible for its use, which risk the company accepts, which data is processed, how oversight works and what evidence will be shown after an incident or audit.

Sources

AI Governance in an Organization: Minimum Security Checklist

AI governance in an organization starts with a simple minimum: AI tool inventory, process owner, risk-based classification of use cases, data rules, approved tool list, access control, supplier assessment, human oversight, logging, security testing, employee training and an AI incident procedure. A company does not need to build a mature AI governance programme immediately, but it must know who uses AI, for what purpose, on what data, with what risk and who is accountable for decisions.

Prepared by: CCyber Editorial Team

Short answer

AI governance in an organization should not start with a large strategy that nobody implements. It should start with minimum controls: AI tool inventory, clear data rules, process owner, risk assessment of use cases, access control, supplier assessment, employee training, logging, human oversight and an AI incident reporting procedure. The greatest risk is not AI use itself, but AI use without organizational awareness, data control, accountability, testing and evidence. The company should know who uses AI, for what purpose, on what data, with what impact on customers, employees, business decisions and security.

Last updated

July 2026

Who this article is for

  • boards and business owners
  • CISOs, vCISOs, CTOs, CIOs and IT directors
  • compliance, risk, legal, DPO and internal audit teams
  • HR, marketing, sales, customer service, finance and operations
  • product teams, software houses, SaaS companies and DevOps teams
  • SMEs starting to use generative tools
  • companies that want to reduce Shadow AI
  • organizations preparing for the EU AI Act, ISO 42001, ISO 27001, NIS2, customer audit or cyber insurance

Key takeaways

  1. Minimum AI governance starts with visibility. The company must know which AI tools are used, by whom, for what purpose and on what data.
  2. The key rule is: confidential data, customer data, personal data and company secrets must not be entered into unapproved AI tools.
  3. Every AI use case should have an owner, risk assessment, human oversight rules and a decision whether it is allowed, restricted or prohibited.
  4. AI requires technical and organizational safeguards: access, logs, testing, supplier controls, training and incident response.
  5. Companies should prepare evidence: AI tool register, AI use policy, use case classification, risk assessment, approved tool list, test reports and training records.

What is AI governance in an organization?

AI governance means how the company makes decisions about AI use, controls risks, protects data, assigns accountability and checks whether AI systems work safely. It is not only technology. It is people, processes, data, suppliers, law, security and business decisions.

In practice, AI governance answers these questions:

  • which AI tools are used in the company?
  • who approves new AI tools?
  • which data must not be entered into AI?
  • which AI use cases are low, medium or high risk?
  • who is responsible for AI-generated output?
  • does a human verify AI decisions and content?
  • does the AI supplier meet security requirements?
  • does the company have logs, evidence and incident procedures?

Good AI governance does not block innovation. It gives the company safe AI use rules so employees do not need to improvise.

Why are minimum AI safeguards needed?

AI often enters the company faster than formal rules. Employees use chatbots, writing assistants, coding tools, meeting transcription, document summarization, data analysis, image generation, customer service tools or process automation. Some uses are beneficial. Some create risk.

Common risks

  • pasting customer data into an unapproved tool
  • sending personal data to a supplier without assessment
  • using AI for decisions about an employee, candidate or customer without oversight
  • incorrect content sent to a customer
  • hallucinations and false information in reports
  • prompt injection, meaning manipulation of AI instructions through external content
  • AI generating insecure code
  • lack of logs and inability to reconstruct decisions
  • dependency on a supplier without a contingency plan
  • no clear accountability for AI output

A minimum checklist helps start with what matters most: data, accountability, risk, access and response.

Minimum AI security checklist

1. Assign an AI owner in the organization

Every AI programme needs an owner. This does not need to be one person doing every technical task. It means a person or committee responsible for rules, decisions, risk, documentation and reporting.

Minimum

  • assign AI governance owner
  • define roles of IT, security, legal, DPO, HR and business teams
  • define who approves new AI tools
  • define who accepts higher-risk uses
  • define who reports AI risk to the board

Evidence to prepare: AI responsibility card with owner, roles and decision scope.

2. Create an AI tool and use case register

You cannot secure AI the company cannot see. The register should include tools purchased by the company and tools used informally by employees.

Record in the register:

  • tool name
  • supplier
  • business owner
  • department using the tool
  • purpose of use
  • data type
  • whether the tool has access to company systems
  • whether AI output reaches customers
  • whether output affects decisions about people
  • status: approved, restricted, prohibited, under review

Evidence to prepare: AI register updated at least quarterly.

3. Define a data policy for AI

The most important risk in the first months of AI use is data. Employees often do not know which information may be entered into a tool and which must not.

Basic rule

Confidential data, customer data, personal data, financial data, source code, company secrets, passwords, API keys, contracts and NDA-protected documents must not be entered into unapproved AI tools.

Split data into three groups

  • allowed: public data, fictional examples, marketing content without confidential data
  • restricted: internal data after anonymization or approval
  • prohibited: personal data, customer data, company secrets, passwords, secrets, sensitive code, financial data without approval

Evidence to prepare: AI data rules table and short employee instruction.

4. Introduce an approved AI tool list

Employees will use AI if the tools help them work. A safer approach than a total ban is a list of approved tools with clear rules.

The list should include:

  • allowed tools
  • tools allowed only for selected departments
  • tools allowed only for public data
  • prohibited tools
  • process for submitting a new tool for assessment

Evidence to prepare: approved and prohibited AI tool list with last review date.

5. Classify use cases by risk

Not every AI use requires the same control. AI for text style improvement is different from AI supporting recruitment, customer assessment, financial decisions or diagnostics.

Low risk

  • editing text without confidential data
  • generating marketing ideas
  • summarizing a public article
  • creating a presentation draft without customer data

Medium risk

  • analysis of internal documents
  • customer service assistant with human oversight
  • summaries of internal meetings
  • developer support for code

High risk

  • decisions about employees or candidates
  • customer scoring, creditworthiness or risk assessment
  • medical, legal, financial or safety decisions
  • AI system with access to production, customer data or automatic actions

Evidence to prepare: AI use case risk matrix.

6. Require human oversight

AI may support work, but it should not independently make high-risk decisions without an accountable human. Human oversight should be real, not only written in a policy.

Minimum

  • a human approves content sent to customers
  • a human reviews decisions affecting people
  • a human is accountable for output used in business
  • employees cannot claim “AI wrote it” as an excuse
  • high-risk uses require additional approval

Evidence to prepare: human oversight rules and list of processes where AI cannot act alone.

7. Protect accounts and access to AI tools

AI tools may contain chat history, files, data, integrations and connections to company systems. Access to them should be treated like access to a business system.

Minimum

  • MFA for AI accounts
  • named accounts, no shared logins
  • role-based access
  • access removal when an employee leaves
  • quarterly user review
  • administrator access limitation
  • activity logging where the tool supports it

Evidence to prepare: AI account, MFA and access review report.

8. Assess AI suppliers

An AI supplier may process company data, store history, integrate with systems, train models or use subcontractors. The company must check whether the supplier’s terms are acceptable.

Supplier questions

  • what data is processed?
  • is data used to train models?
  • where is data stored?
  • who has access to data?
  • can chat history storage be disabled?
  • does the supplier have MFA and administrative logs?
  • does it have certifications or security reports?
  • how does it report incidents?
  • how does it delete data after contract end?
  • does it use subcontractors?

Evidence to prepare: AI supplier assessment card.

9. Check legal and regulatory requirements

Not every AI use has the same legal requirement level. In the European Union, the EU AI Act, GDPR, copyright, trade secrets, employment law and sector regulations are especially important.

Check whether the AI use case:

  • concerns people, employees, candidates or customers
  • affects a business decision about a person
  • uses personal data
  • generates public content
  • may create deepfakes or synthetic content
  • is part of a customer-facing product or service
  • may be a high-risk system

Evidence to prepare: AI legal checklist and decision whether deeper assessment is needed.

10. Protect processes against prompt injection

Prompt injection means manipulating an AI system through content that the AI reads or processes. Risk grows when AI analyzes emails, websites, customer files, external documents or uses tools.

Minimum

  • do not treat AI output as automatically trusted
  • separate system instructions from user content
  • do not allow AI to independently perform high-risk actions
  • validate inputs and outputs
  • require human confirmation before sending email, making payment, changing data or calling an API
  • test instruction manipulation scenarios

Evidence to prepare: prompt injection resilience tests for medium and high-risk use cases.

11. Verify AI output before use

AI may create incorrect answers, non-existent sources, false summaries and persuasive but inaccurate conclusions. AI output must therefore be checked before being used in decisions, customer communication or reports.

Rules

  • check sources
  • label AI-generated content where required
  • do not send AI content to customers without review
  • do not make decisions about people based only on AI output
  • use source data for reports, not only AI summaries

Evidence to prepare: AI output verification procedure.

12. Control AI in coding and digital products

AI can accelerate coding, but it can also introduce vulnerabilities, unsafe libraries, wrong configurations or hard-to-maintain fragments. AI-generated code should undergo the same or stronger review as human-written code.

Minimum

  • AI does not independently approve production code
  • all AI-generated code undergoes code review
  • secrets and API keys are not pasted into AI tools
  • licenses of libraries and dependencies are checked
  • security tests are run on code
  • AI use in critical components is documented

Evidence to prepare: AI coding rules and code review reports.

13. Log and monitor AI use

Without logs, the company does not know who used AI, for what purpose, on what data and which output entered the process. Logging scope depends on tool and risk, but logging matters for business use cases.

Minimum

  • log users and dates of use
  • log access to tools and integrations
  • monitor unusual use
  • monitor data export
  • retain decisions and output versions in critical processes
  • review logs regularly for high-risk use cases

Evidence to prepare: AI log source list and usage review report.

14. Prepare an AI incident procedure

An AI incident may look different from a classic cyber incident. It may involve data leakage into a tool, wrong decision, harmful generated content, prompt injection, secret disclosure, unauthorized agent action or incorrect data use.

The procedure should cover:

  • who receives the report
  • how to disconnect the tool or integration
  • how to preserve logs
  • how to determine which data was used
  • who assesses legal and business impact
  • who contacts the AI supplier
  • who communicates with the customer
  • how remediation actions are closed

Evidence to prepare: AI incident playbook and scenario exercise report.

15. Train employees practically

An AI policy will not work if employees do not know how to apply it. Training should be short, practical and role-based.

Employees should know:

  • which AI tools are approved
  • which data must not be entered
  • how to label and verify AI output
  • when manager approval is required
  • how to report a new AI tool
  • how to report an AI incident
  • why AI does not remove accountability for work output

Evidence to prepare: training participant list, materials and short decision test.

Board checklist

  • do we know which AI tools are used in the company?
  • do we have an AI governance owner?
  • do we have a list of approved and prohibited tools?
  • do employees know which data must not be entered into AI?
  • do we classify AI use cases by risk?
  • have we checked the EU AI Act, GDPR and sector requirements?
  • does AI used in critical processes have human oversight?
  • have AI suppliers been assessed?
  • do we have an AI incident procedure?
  • does the board receive an AI risk report?

IT and security checklist

  • do AI tools have MFA?
  • is access named and role-based?
  • do we log use and administrative access?
  • do AI integrations have least privilege?
  • are API keys stored securely?
  • do we test prompt injection?
  • does AI with tool access require human approval for high-risk actions?
  • do we monitor unusual use and data export?
  • does AI-generated code undergo review?
  • do we have an AI incident playbook?

Legal, compliance and DPO checklist

  • do we know which AI use cases process personal data?
  • was the AI supplier assessed?
  • does the supplier contract describe data, location, subcontractors and data deletion?
  • may the AI use case be high-risk?
  • does AI output affect decisions about people?
  • is a data protection impact assessment needed?
  • do we have rules for labeling synthetic content?
  • do we have AI literacy training evidence?
  • is the AI policy aligned with customer contracts?
  • do we have an exception and risk acceptance register?

What documents and evidence should be prepared?

Basic documents

  • AI use policy
  • AI tool register
  • approved tool list
  • prohibited use list
  • AI use case risk matrix
  • AI data rules
  • new AI tool reporting procedure
  • AI incident procedure

Technical evidence

  • MFA report for AI tools
  • user and access report
  • AI integration list
  • API key and owner list
  • logging and monitoring report
  • prompt injection test report
  • AI-generated code review report

Supplier evidence

  • AI supplier assessment
  • contract or data processing terms
  • data location information
  • information on training models on customer data
  • subcontractor list
  • data deletion rules after contract end
  • supplier security reports or certificates

Organizational evidence

  • board decision on AI rules
  • AI risk report for the board
  • AI use case owner list
  • risk acceptance register
  • employee training report
  • AI incident and near miss report
  • remediation action list

30, 60 and 90-day action plan

First 30 days

  • assign AI governance owner
  • run a quick review of AI tools used in the company
  • prepare AI tool register
  • define the rule: no confidential data in unapproved tools
  • prepare approved and prohibited tool list
  • enable MFA for AI accounts where supported
  • prepare short employee instruction
  • train high-risk teams

Days 31 to 60

  • classify AI use cases by risk
  • assess AI suppliers used in business processes
  • check contracts, data location and model training rules
  • define human oversight rules
  • prepare procedure for reporting a new AI tool
  • prepare AI incident procedure
  • check AI logging and integrations
  • prepare first board report

Days 61 to 90

  • test prompt injection for medium and high-risk use cases
  • run an AI incident exercise
  • perform AI tool access review
  • review AI use in coding and products
  • complete documentation and evidence
  • close the most important gaps
  • approve 12-month AI governance roadmap
  • define quarterly AI register and risk review

Common organizational mistakes

Mistake 1: banning AI without an alternative

A total ban often leads to Shadow AI. It is better to provide safe tools and clear rules.

Mistake 2: no AI register

The company does not know which tools are used, so it cannot control data, suppliers or risks.

Mistake 3: focusing only on GDPR

Personal data protection matters, but AI also creates security, quality, accountability, intellectual property, supplier and business decision risks.

Mistake 4: no owner for AI output

An employee or team uses AI output, but nobody is accountable for its correctness. This is especially dangerous in reports, offers, code and decisions about people.

Mistake 5: no supplier assessment

The company uses an AI tool without checking what happens to data, where it is stored and whether it may be used for model training.

Mistake 6: AI with excessive access

An AI agent or integration has access to email, files, CRM or APIs, but lacks limits, logs or human approval.

Mistake 7: no AI security testing

The system works in a demo, but nobody tested prompt injection, wrong outputs, data leakage or function misuse.

Mistake 8: no training

Employees use AI, but do not know what they must not paste, when to verify output and how to report a problem.

Business example

A services company starts using AI tools in marketing, sales, HR and customer service. Employees create content, summarize meetings, analyze customer documents and test chatbots. The board sees time savings, but has no information on which tools are used and what data is entered into them.

A short review shows that some employees paste fragments of customer contracts into public tools, marketing uses image generators without license checks, HR tests a CV screening tool, and the technical team uses AI for code without clear rules. The company does not need a complex AI management system immediately. It needs the minimum.

Within 90 days, the company creates an AI register, approved tool list, data rules, supplier assessments, risk classification, MFA, employee training, AI incident procedure and board report. AI continues to support work, but the company now knows where the risk is and who is accountable for decisions.

How can ccyber.io help?

ccyber.io helps companies implement practical AI governance and minimum safeguards without blocking innovation. We combine security, legal, compliance, data, supplier, business process and employee education perspectives.

We can support your organization with:

  • AI governance minimum assessment
  • AI tool and use case register
  • company AI use policy
  • AI use case risk classification
  • AI data rules
  • AI supplier assessment
  • EU AI Act and ISO 42001 readiness checklist
  • prompt injection and AI security testing
  • AI incident procedure
  • AI security training for employees
  • evidence pack for the board, customer audit and compliance
  • 30, 60, 90-day and 12-month AI governance roadmap

The best first step is an AI Governance Minimum Security Workshop. In a short workshop, the company can identify which AI tools are used, which data is exposed, which use cases have the highest risk and which safeguards should be implemented in the first 30 days.

FAQ

Does a small company need AI governance?

Yes, but it does not need to start with a complex programme. The minimum is enough: tool register, data rules, approved tool list, owner, training and incident procedure.

What is the most important AI safeguard?

Data control is the most important. Employees must know what must not be entered into unapproved AI tools.

What is Shadow AI?

Shadow AI is the use of AI tools outside organizational awareness and control. It usually involves public chatbots, content generators, transcription tools, coding tools and document analysis tools.

Is banning AI enough?

Usually not. A ban without a safe alternative may push AI use into informal channels. Clear rules, approved tools and training are better.

Which data must not be entered into AI?

Personal data, customer data, company secrets, passwords, API keys, contracts, sensitive code, financial data and NDA-protected documents must not be entered into unapproved tools.

Can AI make decisions about employees or customers?

These use cases are high-risk and require special care, legal assessment, human oversight, documentation, testing and clear accountability.

What should be done after an AI incident?

Preserve logs, determine data scope, disconnect the integration, inform the process owner, assess legal and business impact, contact the supplier and implement remediation.

Where should we start?

Start with an AI tool register, a ban on confidential data in unapproved tools, an approved tool list, an AI owner and short employee training.

Summary

AI governance in an organization does not need to start as a large compliance programme. The minimum is visibility, accountability and data control. The company should know which AI tools are used, by whom, for what purpose, on what data and with what risk.

The most important safeguards are an AI register, data policy, approved tool list, use case risk assessment, human oversight, access control, supplier assessment, security testing, logs, training and AI incident procedure.

The best rule is: do not block AI without a plan and do not deploy AI without control. Give employees safe tools, clear rules and a simple path for reporting new use cases and incidents.

Sources

Is Voice Cloning Voice Phishing? AI Threats and Risks Explained Simply

Voice cloning and voice phishing are not the same, but they often appear together. Voice cloning is a technique for creating a synthetic voice similar to a real person. Voice phishing is a scam conducted by phone, voice message or messenger to steal money, data, passwords, MFA codes or access. AI can make such an attack sound like a real CEO, employee, customer, supplier or family member.

Prepared by: CCyber Editorial Team

Short answer

Voice cloning is not the same as voice phishing, but it can be a tool used in voice phishing. Voice cloning means creating a synthetic voice similar to a real person. Voice phishing, also known as vishing, means deceiving a person through a phone call, voice message or messenger. The goal may be a payment, MFA code, password reset, bank account change, system access or data disclosure. The most important rule for non-technical users is: if someone calls with an urgent request for money, data, password, access or secrecy, do not judge only by voice. Break the pressure and confirm the request through another known channel.

Last updated

July 2026

Who this article is for

  • boards and business owners
  • finance, accounting and administration employees
  • HR, sales, customer service and support teams
  • IT, security, CISO and vCISO teams
  • executive assistants and office managers
  • SMEs that want to explain new AI risks to employees in simple language
  • companies preparing cybersecurity awareness training
  • organizations that want to reduce deepfake, vishing and CEO fraud risk
  • private individuals who want to understand voice cloning and avoid scams

Key takeaways

  1. Voice cloning is a technique. Voice phishing is a scam. An attacker may use a cloned voice to make voice phishing more convincing.
  2. It is not safe to rely only on “the voice sounds familiar”. Voice, phone number and urgent request are not enough to prove identity.
  3. The biggest risks concern payments, bank account changes, MFA codes, password resets, access granting, customer data and confidential documents.
  4. The best protection is a procedure: stop, confirm through a second channel, use a known number, apply two-person approval and report suspicious contact.
  5. Companies should not train employees to “detect AI by voice”, but to respond safely to pressure and unusual requests.

What is voice cloning?

Voice cloning is the use of AI technology to create a synthetic voice that sounds similar to a real person. Such a voice may imitate tone, speaking pace, accent, emotion and characteristic speech patterns.

To create a voice sample, an attacker may use publicly available material, for example:

  • webinar recording
  • conference speech
  • social media video
  • podcast
  • voice message
  • meeting recording
  • company video
  • event recording

Voice cloning itself may have legitimate uses, for example in digital accessibility, voiceovers, content localization or tools supporting people who have lost their voice. The problem begins when someone uses this technology without consent or for fraud.

What is voice phishing?

Voice phishing, often called vishing, is a scam conducted through voice. It may be a phone call, voice message, messenger call, app call or audio recording. The goal is to persuade a person to take an action they normally would not take.

The attacker may try to steal:

  • money
  • personal data
  • customer data
  • password
  • MFA code
  • account reset
  • system access
  • bank account change
  • document transfer
  • approval of an unusual transaction

Voice phishing can work without AI. A fraudster may simply call and pretend to be a bank, supplier, family member, IT employee or CEO. AI makes the attack more convincing because the voice may sound like someone you know.

Is voice cloning voice phishing?

No. These are two different concepts.

Voice cloning

A technology for creating a synthetic voice similar to a real person.

Voice phishing

A fraud method where the attacker uses a conversation or voice message to manipulate the victim.

How do they connect in practice?

An attacker may use voice cloning to conduct voice phishing. Example: a finance employee receives a call from someone who sounds like the CEO. The voice says that an urgent payment must be made and nobody should be told because the matter is confidential. Technically, this is voice phishing, and voice cloning is the tool that increases attack credibility.

Simply put:

Voice cloning is “how the fraudster sounds”. Voice phishing is “why the fraudster is calling”.

What does such an attack look like step by step?

Step 1: choosing the impersonated person

The attacker chooses a person whose voice may create trust or pressure. This may be a CEO, CFO, manager, customer, supplier, IT employee or family member.

Step 2: collecting a voice sample

The attacker searches for online recordings or obtains a short voice sample from another source. The more public speeches, podcasts and videos exist, the easier it is to prepare convincing material.

Step 3: preparing the story

The fraudster prepares a story. It is usually urgent, stressful and unusual. Example: payment, bank account change, outage, confidential transaction, arrest, customer problem or urgent access reset.

Step 4: contacting the victim

Contact may happen by phone, voice message, messenger or as part of a larger attack that starts with email.

Step 5: pressure for quick action

The attacker uses emotion and authority. They may say: “this is urgent”, “do not tell anyone”, “the customer is waiting”, “the board approved this”, “this is confidential”, “do it now”.

Step 6: action is performed

The victim makes a payment, provides an MFA code, changes supplier data, sends a document, resets a password or grants access.

Step 7: hiding traces

The fraudster may ask for secrecy, move to another channel or request deletion of messages. Sometimes, after the first success, they try to force additional actions.

Common company scenarios

1. Call from the “CEO” asking for payment

A finance employee receives a call from a voice that sounds like the CEO. The request concerns an urgent payment, often to a new recipient or foreign account.

2. “CFO” confirms bank account change

The attacker calls after an earlier email about changing supplier bank details. The voice is supposed to confirm that the change is genuine.

3. “IT” asks for an MFA code

The fraudster pretends to be an IT employee and asks for an MFA code, approval of a push notification or password reset.

4. “Customer” asks for documents

A person sounding like a customer asks to send a contract, report, invoice, project data or documentation to a new email address.

5. “Supplier” requests an urgent data change

The attacker impersonates a supplier and asks to change bank account number, contact email or portal login data.

6. “Manager” asks for access

A manager’s voice asks IT to quickly grant access to an employee, consultant or supplier.

7. Deepfake in a video meeting

The attack may combine voice and image. A meeting participant looks and sounds credible, but asks for an unusual decision, payment or process change.

Common private-life scenarios

1. “Son” or “granddaughter” in an emergency

A person receives a call from the voice of a loved one. The story involves an accident, arrest, hospital, debt or immediate financial need.

2. “Police officer” or “lawyer” confirms the story

After the voice of the loved one, another person joins and increases pressure, saying money must be paid quickly.

3. “Bank” asks to confirm a transaction

The fraudster impersonates a bank and asks for a code, login data, app installation or “security transfer”.

4. “Friend” asks for a loan

A voice message or call sounds like a friend. The request involves a quick loan, payment or gift card purchase.

Why does voice deceive so easily?

Voice builds trust

People naturally trust familiar voices. When you hear the speech pattern of someone you know, your brain quickly fills in the rest of the story.

Emotions reduce caution

Fear, shame, pressure, secrecy and authority reduce logical thinking. The fraudster wants the victim to act before checking facts.

The phone number can also mislead

A familiar number or contact name may appear on the screen. This does not always mean the call is genuine, because a number may be spoofed or communication may come through another account.

AI removes old warning signs

In the past, phishing was often exposed by language mistakes, strange accent or artificiality. Today, a scam may be fluent, correct and context-aware.

The most important rule for non-technical users

Do not trust voice alone.

If the request concerns money, data, password, MFA code, access, documents, bank account change or secrecy, always confirm it through a second channel.

A second channel means:

  • call a previously known number
  • write in the known company messenger
  • contact the manager
  • check CRM or the contract
  • confirm with another person on the team
  • apply two-person approval

Do not use the phone number or link given by the caller in the suspicious conversation. Use a channel you already knew.

Red flags

Time pressure

“You must do this now”, “we do not have time”, “the customer is waiting”, “the payment must go out today”.

Request for secrecy

“Do not tell anyone”, “this is confidential”, “the board does not want confusion”.

Unusual channel

The CEO writes from a private messenger, a customer calls from a new number, a supplier asks to communicate outside the normal path.

Request to bypass procedure

“We will do the paperwork later”, “skip approval this time”, “this is an exception”.

Bank account or recipient change

Every urgent change of payment details should be treated as high risk.

MFA code or password

Nobody should ask for an MFA code by phone. Such a request should not be fulfilled.

New email address or new number

If someone asks to send documents to a new address, it must be independently verified.

Refusal to verify

If the caller insists that you must not call back, ask anyone or check, that is a strong warning sign.

How should a company defend itself?

1. Introduce second-channel verification

Every unusual request for money, data, access, password, MFA code, bank account change or procedure bypass should be confirmed through another channel.

2. Use two-person approval

Large payments, new payment recipients, bank account changes, administrator access and sensitive data transfers should require approval by two people.

3. Use known numbers and contacts

Do not call back the number provided in the conversation. Use a number from the contract, CRM, company directory or previously confirmed channel.

4. Never share MFA codes

An MFA code, push notification and password reset link are security controls. Do not share them by phone, messenger or email.

5. Prepare a safety phrase

For high-risk situations, the company can define a safety phrase. It should not be based on information available on social media.

6. Limit public voice samples

It is not always possible to avoid recordings, but public appearances of high-risk people such as board members, finance, PR and decision makers should be managed consciously.

7. Train employees on scenarios

Training should show real situations: call from the “CEO”, payment request, supplier bank account change, MFA code, fake customer and deepfake in a meeting.

8. Prepare fast reporting

An employee should know where to report a suspicious call, voice message or meeting. Reporting should be simple and non-punitive.

How can private individuals defend themselves?

Pause

If the call creates fear and urgency, that may be exactly what the fraudster wants.

Call back using a known number

Hang up and call the person who supposedly contacted you using the number already saved in your contacts.

Ask someone close

If you cannot reach the person, call another family member or friend.

Do not send money under pressure

The fraudster often asks for quick transfer, cryptocurrency, gift cards or money transfer. That is a major red flag.

Set a family safety phrase

A family can agree on a short emergency phrase. It should not be public information or something easy to guess.

Do not share data or codes

Do not share codes, passwords, bank data, document numbers or login details by phone.

What should a company do in the first 30, 60 and 90 days?

First 30 days

  • assign owner for deepfake audio and voice phishing readiness
  • identify high-risk processes: payments, data, access, passwords, suppliers
  • introduce second-channel verification for unusual requests
  • introduce the rule: never share MFA codes by phone
  • prepare red flag list
  • train finance, IT, HR and executive assistants
  • define suspicious call reporting channel
  • review public recordings of high-risk people

Days 31 to 60

  • introduce two-person approval for payments and bank account changes
  • prepare supplier verification procedure
  • prepare safety phrase for critical situations
  • prepare exercise scenarios for teams
  • update password reset procedure
  • update access granting procedure
  • prepare suspicious call playbook
  • prepare fake video meeting playbook

Days 61 to 90

  • run tabletop exercise with board, finance, IT and HR
  • run an urgent payment request simulation
  • check whether employees know where to report suspicious contacts
  • measure response time to a suspicious request
  • prepare board report
  • add voice cloning topic to onboarding
  • schedule recurring training
  • update procedures based on exercise findings

What documents and evidence should be prepared?

Procedures

  • second-channel verification procedure
  • urgent payment approval procedure
  • bank account change procedure
  • password reset procedure
  • access granting procedure
  • suspicious call handling procedure
  • fake video meeting handling procedure

Training materials

  • employee instruction
  • red flag list
  • call scenarios
  • knowledge quiz
  • materials for finance, IT, HR and sales
  • materials for the board

Organizational evidence

  • training participant list
  • knowledge test results
  • tabletop exercise report
  • remediation action list
  • suspicious call register
  • exception register
  • board report

Technical evidence

  • MFA report
  • administrator list
  • unusual password reset report
  • supplier access report
  • phishing and vishing report logs
  • public recording list for high-risk people

How to measure company readiness?

Training metrics

  • number of trained employees
  • number of trained high-risk people
  • knowledge test result
  • number of teams included in exercise
  • number of employees who know the reporting channel

Process metrics

  • number of high-risk payments approved by two people
  • number of bank account changes confirmed through second channel
  • number of password resets outside procedure
  • number of process exceptions
  • time to confirm unusual request

Incident metrics

  • number of reported suspicious calls
  • number of reported voice messages
  • number of MFA code theft attempts
  • number of fake bank account change attempts
  • response time to report

Risk metrics

  • number of public recordings of high-risk people
  • number of processes without two-person approval
  • number of teams without second-channel procedure
  • number of suppliers without confirmed contact details
  • number of accounts without MFA in critical processes

Common mistakes

Mistake 1: “I will know by the voice”

This is not a good security control. The voice may sound familiar, and emotions may reduce caution.

Mistake 2: confirming in the same channel

If the suspicious request came by phone, continuing the same conversation is not verification.

Mistake 3: no procedure for urgent requests

If the company has no procedure, the employee decides alone, under pressure and often without evidence.

Mistake 4: “do not bother anyone” culture

If employees are afraid to interrupt a call or ask a manager, the fraudster has an easier task.

Mistake 5: safety phrase based on public information

Questions about family, school, city or pets may be available online. A safety phrase should not rely on such information.

Mistake 6: no board training

The board’s voice may be used in an attack. The board should clearly communicate that procedures matter more than apparent urgency.

Mistake 7: no reporting of suspicious contacts

A suspicious call may be the first sign of a larger campaign against the company.

Mistake 8: no exercises

An employee may know the procedure in theory, but under stress will act the way they practiced. That is why exercises matter.

Business example

A finance employee receives a call from someone who sounds like the CFO. The caller says they are in a meeting with an investor and need an immediate transfer to a new supplier. They ask not to involve anyone else because the matter is confidential.

The employee knows the procedure. They do not make the transfer during the call. They end the call, check the CFO’s number in the company directory and contact them through a known channel. It turns out the CFO did not call and did not request the payment.

The company reports the incident to security, blocks the attempted supplier data change, informs the finance team and runs a short exercise for employees. The key outcome: the employee did not need to recognize whether the voice was synthetic. It was enough to follow the procedure.

How can ccyber.io help?

ccyber.io helps companies prepare employees and processes for voice cloning, voice phishing, deepfakes and AI-supported fraud. We do not only teach technology recognition. We help build procedures that work even when the voice sounds credible.

We can support your organization with:

  • voice cloning and voice phishing training
  • AI scams awareness for employees
  • training for finance, IT, HR, sales and board
  • second-channel verification procedure
  • urgent payment procedure
  • bank account change procedure
  • suspicious call playbook
  • fake video meeting playbook
  • tabletop exercise for deepfake audio scenario
  • review of public recordings of high-risk people
  • audit-ready training evidence pack

The best first step is a Voice Phishing and AI Scam Readiness Workshop. In a short workshop, the company can identify the most exposed processes, which procedures must change, who should be trained first and how to prepare simple protection against voice scams.

FAQ

Are voice cloning and voice phishing the same?

No. Voice cloning is a technology for creating a synthetic voice. Voice phishing is a voice-based scam. Voice cloning can be used for voice phishing.

What is vishing?

Vishing is voice phishing. The attacker uses a phone call, voice message or messenger to steal money, data, password, MFA code or access.

Can a cloned voice be recognized by sound?

Sometimes strange elements may be noticed, but this should not be relied on. Second-channel verification is safer.

What should I do if the “CEO” calls with an urgent request?

Do not perform an unusual request during the call. End the contact and confirm through a known channel. If money, data or access are involved, use two-person approval.

Is the phone number on the screen enough evidence?

No. The number may mislead, and contact may come from a compromised account or spoofing. Independent verification matters more.

Does a safety phrase solve the problem?

A safety phrase can help, but it should not replace procedure. It works best with a second channel, two-person approval and exception documentation.

Who should be trained first?

Start with finance, accounting, IT, HR, executive assistants, sales, customer service and people who can approve payments, access or data transfers.

Which actions should be implemented immediately?

Introduce second-channel verification, ban sharing MFA codes, use two-person approval for payments, prepare bank account change procedure and create a simple channel for reporting suspicious calls.

Summary

Voice cloning is a technology, while voice phishing is a scam. The combination is dangerous because the voice may sound like someone you trust, and the conversation may involve urgent money, data, access or password requests.

The best protection is not that an employee recognizes a synthetic voice. The best protection is that they know what to do: stop, do not act under pressure, confirm through a second channel, use two-person approval and report suspicious contact.

In the AI era, voice is no longer sufficient proof of identity. Companies that understand this early will reduce the risk of fake payments, data leaks, account takeover and wrong decisions under pressure.

Sources

Shadow AI: How Employees Use AI Outside Organizational Control

Shadow AI happens when employees use AI tools without the organization’s knowledge, approval or control. They often do it to write emails faster, analyze documents, create presentations, summarize meetings, write code or support customers. The problem is not AI itself, but the lack of rules, tool inventory, data controls, supplier assessment, logs, training and a safe alternative for employees.

Prepared by: CCyber Editorial Team

Short answer

Shadow AI means using AI tools outside organizational control. An employee may use a private ChatGPT, Copilot, Gemini, Claude, Perplexity account, transcription tool, presentation generator, coding assistant or AI browser plug-in without the knowledge of IT, security, legal, compliance or their manager. The biggest risk appears when customer data, contracts, financial documents, HR data, source code, vulnerability information, strategic plans or trade secrets enter such a tool. The answer is not only a ban. The company should understand why employees use AI, prepare approved tools, clear policy, data classification, process for requesting new tools, training, risk-proportionate monitoring and an AI incident response procedure.

Last updated

July 2026

Who this article is for

  • boards
  • business owners
  • CISOs, vCISOs, CTOs and IT directors
  • AI officers, data officers, legal, compliance and DPO teams
  • HR, finance, sales, marketing, customer service and product owners
  • software houses, SaaS companies and digital product manufacturers
  • SMEs seeing employees adopt AI faster than the company defines rules
  • organizations deploying ChatGPT, Copilot, Gemini, Claude, chatbots, RAG or AI agents
  • companies preparing for the AI Act, ISO 42001, ISO 27001, NIS2, SOC 2 or cyber insurance

Key takeaways

  1. Shadow AI is not only an employee problem. It is a signal that the company has not provided safe tools, clear rules or an AI approval process.
  2. The highest risk concerns confidential data, customer data, personal data, source code, secrets, financial documents and vulnerability information.
  3. A complete AI ban often does not work. It may push AI use into private accounts and private devices, even further outside organizational control.
  4. The company should have an AI tool register, AI usage policy, prohibited data list, approved tools, training, exception process and AI incident playbook.
  5. The best approach is controlled adoption: enable employees to use AI where it creates value, but with clear boundaries for data, access, accountability and auditability.

What is Shadow AI?

Shadow AI is the use of artificial intelligence tools without formal approval, knowledge or supervision from the organization. It may be a public tool, private user account, free app, browser plug-in, code editor extension, meeting transcription tool, messaging bot or SaaS application with AI features purchased by a department without IT and security review.

Shadow AI may look harmless. An employee only wants to write an email faster, shorten a report, translate a document, prepare a meeting agenda, improve a proposal or summarize a customer call. The problem appears when data enters a tool that the company did not intend to share with an external provider.

Shadow AI includes, among other things:

  • using a private AI account for work tasks
  • pasting company documents into a public chatbot
  • uploading meeting recordings to unapproved AI transcription
  • using AI browser plug-ins without IT approval
  • using AI coding tools without security rules
  • analyzing customer data in a tool without contract and supplier assessment
  • generating customer replies automatically without human control
  • using AI agents with access to email, files or calendar without organizational approval

Why do employees use AI outside company control?

Most Shadow AI cases do not result from bad intent. Employees use AI because they see immediate value: saving time, easier writing, faster analysis, less routine work and higher productivity.

Most common reasons

  • the company has not provided an approved AI tool
  • tool approval process is too slow
  • the employee does not know the tool is risky
  • AI policy does not exist or is unclear
  • the approved tool is worse than public alternatives
  • the employee wants to avoid long administrative tasks
  • the manager expects faster work but provides no tools
  • a department buys a SaaS tool with AI without consulting IT
  • employees see competitors using AI and do not want to fall behind

This is an important lesson for the board: Shadow AI often reveals a real business need. The company should organize that need, not only punish its existence.

How do employees use AI outside organizational control?

1. Writing emails and documents

Employees paste correspondence, case descriptions, offer drafts, customer documents, complaints, notes and contracts into AI to prepare a reply or summary.

2. Summarizing meetings

AI transcription and note tools may record meetings with customers, candidates, lawyers, suppliers or the board. Risks concern consent, confidentiality, retention and data location.

3. Analyzing documents

AI is used to analyze contracts, reports, specifications, technical documents, CVs, offers, invoices and project documentation. Often without checking whether this data may leave a controlled environment.

4. Translation

Employees translate commercial, legal, HR, technical and financial documents in public AI tools. This may disclose trade secrets or NDA-covered content.

5. Writing code

Developers use AI to generate code, analyze bugs, refactor, write tests and explain repository fragments. Risks concern source code, secrets, vulnerabilities and licenses.

6. Analyzing data

Employees upload spreadsheets, CRM exports, sales data, customer data, financial data and operational data to prepare summaries, forecasts or charts.

7. Customer service

Support and sales teams use AI to draft replies, summarize tickets, translate communication or suggest next actions. Risk increases when output reaches the customer without review.

8. Creating presentations and marketing materials

Marketing uses AI for campaigns, images, product descriptions, posts, slides and market analysis. Risks include content rights, false claims, customer data and brand compliance.

9. Automation with private tools

An employee may connect a private AI tool to mailbox, calendar, files or messenger to automate tasks. This is an especially risky form of Shadow AI.

10. Departmental experiments

A department buys an AI tool for recruitment, sales, analytics, customer service or marketing without legal, security and data protection assessment.

Why is Shadow AI risky?

Risk 1: data leakage

The most obvious risk is sending confidential data to a tool that has not been assessed. This may include customer data, personal data, contracts, code, strategies, prices, proposals and technical information.

Risk 2: no retention control

The company may not know how long the tool stores prompts, outputs, files, transcripts and conversation history. It may also not know whether the user can delete data and whether the company administrator has control.

Risk 3: use of data for training or service improvement

Some tools may use user data to improve the service if proper settings or contracts are not in place. For confidential data, this is a serious problem.

Risk 4: no contract and supplier assessment

An employee’s public account usually gives the company no control over data processing terms, subprocessors, data location, audit, incidents and data deletion.

Risk 5: false or unverified results

AI may generate a response that sounds credible but is wrong. If it reaches a customer, offer, legal analysis or business decision, the problem is not only technical.

Risk 6: breach of GDPR, NDA or customer contract

Personal data, customer data and confidential information may be subject to contractual or legal limitations. Shadow AI may cause the company to violate these limitations without board awareness.

Risk 7: code and secret leakage

Pasting code, logs, API keys, tokens, passwords or vulnerability information into an AI tool may create real risk for the product and infrastructure.

Risk 8: prompt injection and manipulation

If an employee uses AI to analyze external documents, emails or websites, a malicious instruction hidden in the content may manipulate AI output.

Risk 9: no auditability

The company may not know who used the tool, which data was entered, what output was produced and whether the result was used in a decision or customer communication.

Risk 10: decisions outside process control

If AI affects recruitment, employee assessment, commercial offers, complaint handling, financial recommendations or customer communication, the company must have process oversight and accountability.

Why is a simple AI ban often not enough?

A ban may be necessary for high-risk data and unassessed tools, but a ban alone rarely solves the problem. Employees use AI because they have real needs. If the company provides no safe alternative, some usage will move to private accounts, private devices and informal processes.

A better approach combines several elements:

  • clear rules
  • approved tools
  • prohibited data list
  • practical training
  • fast process for requesting new tools
  • risk monitoring
  • consequences for intentional policy violations
  • support for teams that want to use AI legally and safely

Shadow AI should be treated as a governance and work design problem, not only as a disciplinary problem.

How to prepare the company for Shadow AI step by step?

Step 1: create an AI tool register

The company should know which AI tools are already used. This is not about hunting employees, but about understanding the scale and type of risk.

The register should include:

  • tool name
  • team using the tool
  • purpose
  • business owner
  • data type
  • whether the tool is approved
  • whether there is a supplier contract
  • whether a company or private account is used
  • whether the tool has logs
  • risk level

Evidence to prepare: AI tool register, including approved, pilot and informally detected tools.

Step 2: identify the most common use cases

Not every AI use has the same risk. Drafting an internal note without confidential data is different from analyzing a customer contract or source code.

Divide use cases into:

  • low risk
  • medium risk
  • high risk
  • prohibited without additional approval

Evidence to prepare: AI use case list with risk rating.

Step 3: prepare AI usage policy

The AI policy should be short, understandable and practical. After reading it, an employee should know what is allowed, what is prohibited and where to ask for approval.

The policy should include:

  • approved AI tools
  • allowed use cases
  • prohibited use cases
  • customer data rules
  • personal data rules
  • confidential data rules
  • source code rules
  • AI use in customer communication
  • new tool request process
  • AI incident reporting process

Evidence to prepare: AI usage policy and employee acknowledgment.

Step 4: define prohibited data

Employees need concrete examples. A generic “do not paste confidential data” statement is often not enough.

Data that must not be entered into unapproved AI tools

  • customer data
  • personal data
  • HR and payroll data
  • contracts
  • financial data
  • trade secrets
  • source code
  • API keys, tokens, passwords and secrets
  • vulnerability information
  • non-public strategic plans
  • NDA-covered data

Evidence to prepare: prohibited data list and department-specific examples.

Step 5: give employees a safe alternative

If the company bans public tools but provides no approved solution, employees will find a workaround. A safe alternative reduces pressure for Shadow AI.

An approved tool should have:

  • company account
  • SSO
  • MFA
  • administrator control
  • retention settings
  • clear data rules
  • supplier contract
  • ability to revoke access
  • usage logs where needed and lawful

Evidence to prepare: approved AI tool list and security configuration.

Step 6: prepare a fast approval process for new tools

The approval process cannot take months if teams need AI for work. A slow process increases Shadow AI.

The process should answer:

  • who requests the tool?
  • which data will be used?
  • who is the business owner?
  • does the tool have a contract and supplier assessment?
  • is DPO assessment needed?
  • is security assessment needed?
  • can a pilot be run?
  • who approves use?

Evidence to prepare: AI tool request form and approval path.

Step 7: assess AI suppliers

An AI supplier should undergo basic assessment, especially if the tool will be used with company, customer or personal data.

Check:

  • data processing terms
  • data location
  • data retention
  • whether data is used to train models
  • subprocessors
  • encryption
  • SSO and MFA
  • logs
  • incident handling
  • data deletion capability
  • security certifications and documents

Evidence to prepare: AI supplier assessment and risk acceptance decision.

Step 8: deliver practical training

Shadow AI training should be concrete and team-specific. Employees should see examples from their own work, not only a general AI presentation.

Training should cover:

  • what Shadow AI is
  • which data is prohibited
  • how to use approved tools
  • how to verify AI outputs
  • what prompt injection is
  • how to use AI in customer communication
  • how to use AI in code
  • how to request new tools
  • how to report an AI incident or error

Evidence to prepare: training materials, participant list and knowledge test result.

Step 9: monitor risk proportionately

Shadow AI monitoring should be lawful, proportionate and transparent to employees. The goal is not to monitor every conversation, but to detect risky tools, data flows and policy violations.

Possible information sources:

  • surveys and voluntary reporting
  • departmental tool register
  • SaaS expense review
  • proxy or CASB log analysis where used by the company
  • DLP for high-risk data
  • browser plug-in review
  • manager reports
  • incidents and near misses

Evidence to prepare: Shadow AI risk review report without excessive intrusion into employee privacy.

Step 10: prepare an AI incident playbook

The company should know what to do if an employee pasted customer data into an unapproved tool, an AI tool disclosed data, a supplier reported an incident or AI generated harmful customer output.

The playbook should cover:

  • who receives the report
  • how to preserve evidence
  • how to determine which data entered the tool
  • how to contact the supplier
  • how to delete data where possible
  • how to assess personal data and customer impact
  • who decides on communication
  • how to block the tool or integration
  • how to update policy and training after the incident

Evidence to prepare: AI incident response playbook and tabletop exercise report.

Shadow AI across departments

HR

HR may use AI to analyze CVs, write job ads, summarize interviews, create HR documents and communicate with employees. Risks involve personal data, bias, incorrect candidate assessment and confidential employee information.

Finance

Finance may use AI to analyze invoices, reports, forecasts, cash flow, contracts and supplier data. Risks involve financial data, contractor data, payments, wrong analysis and confidential commercial terms.

Sales

Sales may use AI for offers, emails, customer analysis, meeting summaries and inquiry responses. Risks involve customer data, pricing, margins, contract terms and communication inconsistent with the offer.

Marketing

Marketing may use AI for content, graphics, campaigns, market analysis and presentations. Risks include copyright, false claims, customer data, deepfake and brand compliance.

IT and security

IT may use AI for scripts, configuration, log analysis, documentation and troubleshooting. Risks involve disclosure of architecture, production logs, vulnerabilities, secrets and configuration details.

Development

Developers may use AI to write code, tests, refactor and analyze bugs. Risks involve source code, secrets, licensing, code quality and vulnerabilities in generated fragments.

Customer service

Support may use AI for replies, ticket summaries and customer history analysis. Risks involve customer data, wrong answers, disclosure of internal information and automation without human control.

How to detect Shadow AI without creating a culture of fear?

The best companies do not start with accusations. They start with conversation and a safe reporting channel. Employees should be able to say they use an AI tool without immediate fear of punishment.

Good methods

  • anonymous survey on AI use
  • department workshops
  • open tool request process
  • approved tool list
  • safe pilot
  • education instead of fear
  • SaaS expense analysis
  • review of risky plug-ins and apps

What to avoid

  • publicly shaming employees
  • banning without an alternative
  • unclear rules
  • monitoring without transparency
  • treating every experiment as an incident
  • ignoring business needs of teams

The goal is to move AI out of the shadows into a controlled process.

Minimum Shadow AI control checklist

Governance

  • does the company have an AI usage policy?
  • does an AI tool register exist?
  • does every tool have an owner?
  • is there an approval process for new tools?
  • does the board know the top AI risks?

Data

  • is there a prohibited data list?
  • do employees know what must not be pasted into AI?
  • is customer data treated as high risk?
  • are personal data rules clear?
  • are code and secrets covered by separate rules?

Suppliers

  • are AI suppliers assessed before use?
  • is it known whether data is used to train models?
  • is retention understood?
  • are subprocessors known?
  • can data be deleted after use ends?

Access

  • do approved tools have SSO?
  • is MFA enabled?
  • is access removed during offboarding?
  • are administrator roles defined?
  • are private accounts prohibited for company data?

Process

  • are AI outputs verified before sending to customers?
  • can AI take action without a human?
  • are there rules for AI use in code?
  • does an AI incident playbook exist?
  • do employees know how to report risky AI use?

How to prepare a Shadow AI policy?

1. Plain language

The policy should be understandable for employees outside IT. The more legalistic the language, the less likely employees will use it in practice.

2. Approved tool list

The employee should know which tool they can use and for which tasks.

3. Prohibited data list

Give concrete examples: contracts, customer data, code, API keys, HR data, financial documents, vulnerability information.

4. Examples of allowed use

Show that AI is not prohibited everywhere. For example, AI may be used to edit a neutral text if it contains no confidential data.

5. Exception process

If a department wants to use a new tool, it should have a clear request path and fast response.

6. Accountability rules

AI output must be checked by a human. The employee remains responsible for content they send, publish or use in a decision.

7. Incident reporting rules

If someone pasted confidential data into an unapproved tool, they should know where to report it. The company should encourage quick reporting, not hiding mistakes.

30, 60 and 90-day action plan

First 30 days

  • assign Shadow AI owner
  • prepare a short survey on AI use in the company
  • create an initial AI tool register
  • identify teams using AI most often
  • define data prohibited in unapproved tools
  • prepare a short AI policy
  • choose an approved tool or pilot
  • block the riskiest use cases without alternative only where risk is critical

Days 31 to 60

  • assess suppliers of the most commonly used tools
  • configure SSO, MFA, roles and retention in the approved tool
  • launch new AI tool request process
  • train high-risk departments
  • prepare AI rules for code and customer documents
  • define how Shadow AI risk will be monitored
  • prepare AI incident response procedure
  • prepare AI risk dashboard for the board

Days 61 to 90

  • expand approved AI use to additional teams
  • close or replace high-risk unapproved tools
  • run a knowledge test and collect employee questions
  • update policy based on real use cases
  • test a Shadow AI incident scenario
  • prepare board report
  • define quarterly AI tool review
  • prepare 12-month AI governance and AI security roadmap

What documents and evidence should be prepared?

Governance documents

  • AI usage policy
  • AI tool register
  • AI use case register
  • accountability matrix
  • new AI tool approval process
  • exception and risk acceptance register
  • board report

Data documents

  • data classification
  • data prohibited in AI list
  • customer data usage rules
  • personal data usage rules
  • source code usage rules
  • meeting transcription rules

Supplier and tool evidence

  • AI supplier assessment
  • contract or terms of use
  • retention settings
  • model training information
  • administrator list
  • SSO and MFA report
  • usage log report

Training evidence

  • training agenda
  • training materials
  • participant list
  • knowledge test results
  • AI policy acknowledgment
  • employee questions and concerns report

Incident response evidence

  • AI incident response playbook
  • AI incident reporting form
  • log preservation procedure
  • AI supplier contact procedure
  • tabletop scenario
  • exercise report
  • remediation action list

How to measure Shadow AI risk?

Adoption metrics

  • number of AI tools in the register
  • number of approved AI tools
  • number of unapproved AI tools
  • number of active users of approved tools
  • number of teams covered by AI policy

Data metrics

  • number of use cases with customer data
  • number of use cases with personal data
  • number of prohibited data list violations
  • number of reports of confidential data pasted into AI
  • number of tools without clear retention

Governance metrics

  • number of tools without owner
  • new tool approval time
  • number of policy exceptions
  • number of AI supplier assessments
  • number of board decisions related to AI

Training metrics

  • number of trained employees
  • knowledge test result
  • number of questions after training
  • number of new tool requests after training
  • number of reported incidents or near misses

Technical metrics

  • number of approved tools with SSO
  • number of approved tools with MFA
  • number of tools with usage logs
  • number of tools with configured retention
  • number of detected risky plug-ins or applications

Common company mistakes

Mistake 1: pretending employees do not use AI

No reports does not mean no usage. It often means employees do not know where to report tools or fear consequences.

Mistake 2: full ban without an alternative

A ban may reduce visible use, but increase private and uncontrolled use of AI tools.

Mistake 3: policy without examples

Employees need concrete examples: what must not be pasted, which tools are approved and when approval is needed.

Mistake 4: no supplier assessment

An AI tool used with company data should be assessed for retention, model training, data location, subprocessors and incident handling.

Mistake 5: no tool owners

If nobody owns the tool, nobody is accountable for data, access, configuration, costs and risk.

Mistake 6: no team-specific training

HR, finance, sales, IT, development and marketing use AI differently. Training should reflect real scenarios for each team.

Mistake 7: no exception process

If an employee has nowhere to request a new tool, they will likely use it outside the process.

Mistake 8: no AI incident response

When data enters an unapproved tool, the company must know how to assess scope, preserve evidence, contact the supplier and decide on communication.

Business example

A consulting company with 120 employees has no official AI tool. Employees privately use different chatbots for email writing, translation and document summarization. One consultant pastes a customer contract excerpt into a public tool to prepare a summary for the team.

After the case is reported, it turns out there are more similar situations. HR uses AI for document drafting, sales for offers, marketing for presentations and developers for code analysis. The company has no policy, tool list, supplier assessment or data rules.

The board decides not to introduce a blind ban. The company launches a controlled AI programme. It creates a tool register, approves one company solution, enables SSO and MFA, configures retention, prepares a prohibited data list, trains teams and launches a new tool request process.

After 90 days, the company still uses AI, but most use has moved to the approved tool. Employees know what must not be pasted, and the board has an AI risk dashboard and a plan for further AI governance development.

How can ccyber.io help?

ccyber.io helps companies move Shadow AI from uncontrolled usage into a safe, measurable and managed AI programme. We do not start from a ban. We start by understanding how employees really use AI, which data is at risk and which tools should be approved.

We can support your organization with:

  • Shadow AI discovery
  • AI tool register
  • AI usage policy
  • data classification for AI
  • prohibited data list for AI
  • AI supplier assessment
  • new AI tool approval process
  • AI security awareness training
  • Prompt Injection awareness
  • AI incident response playbook
  • AI risk dashboard for the board
  • 30, 60, 90-day and 12-month AI governance and AI security roadmap

The best first step is a Shadow AI Readiness Workshop. In a short workshop, the company can determine which AI tools are used, which teams are most exposed, which data must be protected, which uses can be approved and which must be limited immediately.

FAQ

What is Shadow AI?

Shadow AI is the use of AI tools without organizational knowledge, approval or control. It may include private AI accounts, unapproved apps, plug-ins, transcription tools, content generators and AI agents.

Is Shadow AI always bad?

Not always. AI use often shows a real business need. The problem is lack of control over data, supplier, retention, outputs, accountability and auditability.

Should the company ban AI completely?

Not always. In many cases, providing an approved tool, clear rules, training and a process for new requests is better. A ban without an alternative may increase hidden AI use.

Which data is highest risk?

Customer data, personal data, contracts, HR data, financial data, source code, secrets, vulnerability information, strategies, offers and NDA-covered data.

How can Shadow AI be detected?

Start with surveys, workshops, tool register, SaaS expense review and conversations with teams. Technical monitoring can help, but should be proportionate, transparent and lawful.

What should we do if an employee pasted confidential data into public AI?

Quickly determine what data was shared, which tool was used, whether deletion is possible, what the legal and business impact is, and whether the customer, DPO, supplier or regulator must be contacted.

Is an AI policy enough?

No. A policy is necessary, but it must be combined with approved tools, training, reporting process, supplier assessment, data controls and an AI incident playbook.

Where should we start?

Start with an AI tool register, short policy, prohibited data list, team survey, approved safe alternative and training for high-risk employees.

Summary

Shadow AI will not disappear by itself. Employees use AI because the tools genuinely help them write, analyze, translate, code and support customers. The problem starts when the company does not know which tools are used, which data enters them and who owns the risk.

The best approach is not a blind ban. It is moving AI from the shadows into a controlled process: tool register, AI policy, approved solutions, prohibited data list, supplier assessment, training, risk monitoring and AI incident procedure.

A company that manages Shadow AI well does not block innovation. It gives employees a safe way to use AI while protecting customer data, confidentiality, reputation, compliance and business accountability.

Sources

We write about regulations such as NIS2, DORA, CRA and ISO 27001, cybersecurity for SMEs and critical infrastructure, as well as cyber hygiene, emerging threats and building security awareness within organisations.

Every article delivers practical knowledge - no jargon, just concrete steps you can act on to effectively protect your data, people and business continuity.