---
title: "Evaluate an AI KM vendor"
url: "https://ailawframework.com/practice/knowledge-management/evaluate-an-ai-km-vendor"
type: "task"
site: "AI Law Framework"
id: "KM-B12-25"
practice_area: "Knowledge Management"
tier: "green"
lawyer_review: "required"
jurisdictions: ["AU"]
last_reviewed: "2026-10-10"
---

# Evaluate an AI KM vendor

> Assess hosting, training use, permissions and connectors.

Canonical page: https://ailawframework.com/practice/knowledge-management/evaluate-an-ai-km-vendor  
Last reviewed: 2026-10-10

Site index for agents: https://ailawframework.com/llms.txt

## Key facts

| Fact | Value |
| --- | --- |
| Practice area | [Knowledge Management](https://ailawframework.com/practice/knowledge-management.md) |
| Human involvement | Green: AI drafts, lawyer checks |
| How AI is used | Assess hosting, training use, permissions and connectors. |
| What the lawyer must review | Use the law society checklist. |
| Written for / versions | Australia |

## Checking plan

**Lawyer review required**

The responsible lawyer reviews the work against the instructions, sources and intended use.

- What the AI does: Assess hosting, training use, permissions and connectors.
- What the lawyer does: Use the law society checklist.
- Who reviews: Lawyer competent in the matter and the forum
- Basis: Planning guidance checked against the linked public sources on 10 October 2026. Confirm the current instrument before reliance.
- Why: The traffic light follows the consequence of an error and how much of the output the lawyer must check before it is used.
- Written for: AU

## Checks the lawyer makes

1. Open the cited source and confirm it is the current instrument for this forum and this date.
2. Use the law society checklist.
3. Compare the output with the source and the instructions, including material the output left out.
4. The responsible lawyer approves the exact output for its intended use, or sends it back.

## Notes

- Suggested working checks from the linked public sources. Read the source and confirm it applies to this forum and this date. The checks do not approve software or record that the work is done.

## Practical guide

Jurisdiction: Australia

**Deliverable**: Evaluate an AI KM vendor

**Inputs**

- LSNSW guide (2026): confidentiality when entering client or firm documents into AI
- Law Society WA: responsible and ethical use of AI
- The matter instructions and the documents the output will rely on.

**Example**: Stop before the result is filed, sent or relied on. Use the law society checklist.

**Stop and escalate when**

- The cited source is not the instrument that applies to this forum or this date.
- The output states a fact, date, citation, figure or commitment that is not in the instructions or the source.
- The responsible lawyer has not approved the exact output for its intended use.

Checked 2026-10-10.

## Sources

- [LSNSW guide (2026): confidentiality when entering client or firm documents into AI](https://www.lawsociety.com.au/sites/default/files/2026-01/20260109%20LS4816_PSU_GuidetoAI_2026-01-08a%20FINALv2.pdf) (checked 2026-10-10)
- [Law Society WA: responsible and ethical use of AI](https://lawsocietywa.asn.au/Web/Web/Resources/Practical-Guidance/AI-hub/responsible-and-ethical-use-of-ai.aspx) (checked 2026-10-10)

*Practice guidance for planning and review. Confirm current primary sources and the requirements of the actual matter. This is general information, not legal advice.*