Is Your Business Data Safe With a Custom AI App?
What to demand from an AI vendor before handing over your business data — and which vague answers should send you looking elsewhere.
Your best salesperson just pasted a folder of customer contracts into a public chatbot to summarize them faster. Nobody approved it. Nobody logged it. Nobody thought to ask where those files went afterward.
That’s the actual risk with AI and business data — not a sentient model plotting against you, but a reasonable employee solving a real problem the safe way nobody built. A custom AI app is supposed to be that safe way. Whether it actually is comes down to a handful of specific things you can check before you sign anything.
Where does the data actually go?
Every AI app moves your information somewhere: out of your CRM or database, into a model, and back. That path should be drawable on a whiteboard in plain language — this table, to this app, to this model provider, and nowhere else.
If a vendor can’t sketch that path without reaching for words like “proprietary pipeline” or “our secure infrastructure,” they either don’t know or don’t want to say. Both are reasons to keep asking.
Does the model get trained on what you feed it?
Plenty of consumer AI tools use what you type to improve their models by default. That’s fine for drafting a birthday card. It’s not fine for a customer list, a pricing sheet, or anything with a client’s name attached to it.
The commercial API tiers of the major model providers typically don’t train on customer data by default — but “typically” isn’t a guarantee, and defaults change. Get the no-training commitment in writing, tied to the specific product you’re actually using, not a general policy page.
Who inside your own company can see what?
Encryption gets all the attention. Access control is the part that actually fails. A single shared login, no audit trail, and everyone holding the same permissions is a bigger hole than any cipher weakness you’ll ever hit.
- Role-based access, so the app only shows each person what their job requires
- A log of who looked at or changed what, and when
- A way to revoke one person’s access without rebuilding the whole system
If a vendor treats any of those three as a stretch request, that’s the tell.
Should the AI be allowed to act, or only to recommend?
An app that drafts a refund for a manager to approve is a tool. An app that issues the refund on its own is a liability wearing a tool’s clothes. The difference is one click, and that click is what keeps a human accountable for the decision.
Demand that anything irreversible — a refund, a deletion, an email to a customer, a change to a record — stops at a person before it happens. Automate the drafting and the busywork. Leave the authority where it already lives.
Can you actually leave if you need to?
Ask what happens to your data and your workflow the day you want to switch vendors or bring the work in-house. If the honest answer involves a black box you can’t export from, you didn’t buy a tool — you signed a lease.
Your records should live in a database you can query directly, in formats you already recognize, not locked inside someone else’s platform waiting on their goodwill to get them back out.
The guardrails have to hold before the first business ever signs on
This matters more, not less, when an app is brand new. At Command Module, the first business in an industry gets its custom app built free and keeps it, as long as the app is one the whole industry can use — which means the data path, the access controls, and the human-in-the-loop rules all get proven on a real business before anyone else in that industry ever touches the product.
FAQ
Will the AI company use our data to train their models?
Ask directly, in writing, tied to the exact product you’ll use — not a general privacy policy. Most commercial-grade setups can guarantee no training on your data, but you want that guarantee named, not assumed.
Should we let the AI app take actions on its own, or just suggest them?
Start with suggestions. Anything that can’t be undone — sending money, deleting a record, emailing a customer — should require a person to click confirm, at least until the app has earned trust on lower-stakes decisions.
What should be in the contract before we hand over our data?
Data ownership, a written no-training commitment, a plain description of where the data lives and who can access it, and a clear path to export everything if you ever leave.