How accurate is AI on Turkish law? A citation and current-legislation test (November 2026)

Short answer: On 3 November 2026 we asked two AI models 28 questions on Turkish law and looked up every citation they gave in its source. Without tools, Gemini 4 gave 40 Yargıtay (Court of Cassation) citations and wrote a decision number that does not exist in 32 of them; only 7 were verified. Without tools, Claude mostly declined to give citations. The same Claude, connected to Yargı PRO, got all 40 of its 40 citations right. On 8 questions about provisions amended by the 12th Judicial Package, neither model without tools gave a single correct answer; Claude connected to Yargı PRO answered all eight correctly.

The results at a glance#

A real search: the citation test#

On 20 different topics (such as interest on severance pay, rent determination, the family-home annotation on the land register and aggravated fraud) we asked the models for two Yargıtay decisions each, with chamber, docket (esas) number, decision (karar) number and date. We searched for every citation in Yargı PRO’s decision search by docket and decision number; where nothing came up, we also searched for the docket number alone within that chamber.

Gemini 4: In 32 of the 40 citations, the docket number really exists in that chamber, but the file was decided under a different number and date; the decision the model wrote does not exist. For example, for interest on severance pay the model wrote “9th Civil Chamber, E. 2016/14258, K. 2020/7542, 11.06.2020”. In reality this docket file was decided on 12.05.2016 under K. 2016/11930; there is no decision four years later. In one citation the date was a day out and the decision was not on the topic asked. Of the 7 verified citations, 4 matched the record exactly; 3 are not in the decision archive but are cited with the same details in other Yargıtay decisions.

This also shows why a fabricated citation is so convincing: because the docket number is real, at first glance the record seems to exist. You need to check the decision number and the date as well.

Claude, no tools: In 19 of the 20 questions it declined to give a citation; it said numbers written from memory could turn out to be fabricated, and explained the general rule on the topic instead. The one citation it did give (a decision unifying conflicting case law) was verified. This is honest behaviour, but since it gives the lawyer no citations, it does not move the research forward either.

Claude, connected to Yargı PRO: All 40 citations matched the record exactly, with chamber, docket number, decision number and date. Every decision dealt with the topic asked; in five of them the link to the topic was loose (for example, for a question on reinstatement, decisions on the wage claim after reinstatement).

The current-legislation test: they do not know the 12th Judicial Package#

Law No. 7589 was published on 31 July 2026; the models’ knowledge ends before that. We asked about eight provisions amended by this law “as of November 2026” and scored the answers against the current text of the law.

• When we asked whether an action for an unquantified claim (belirsiz alacak davası) can be brought today, both models without tools said “Yes, it can.” HMK (Code of Civil Procedure) Art. 107 was repealed by this law.
• Both models gave the objection period of the Chief Public Prosecutor of the Court of Cassation as “thirty days”. The new period is three months from the date the file is delivered to that office.
• Claude connected to Yargı PRO cited the amending provision (for example “Law No. 7589, Art. 19”) in every answer.

All the changes, and the results question by question: What changed with Turkey’s 12th Judicial Package (Law No. 7589)?

Method#

• Date: 3 November 2026.
• Models: Claude Opus 5.5 (Claude Code command line) and Gemini 4 (Antigravity command line, plan mode). We ran Claude without loading user settings or memory, with web search turned off and, in the no-tools arm, from a neutral folder whose name does not mention Yargı; in the Yargı PRO arm the only tool enabled was Yargı PRO. We told Gemini in the prompt not to search the web.
• Questions: 20 citation questions and 8 current-legislation questions; the same prompt for each arm, each question in a separate session.
• Verification: Citations were searched in Yargı PRO’s decision search by docket and decision number, and where needed by docket number and chamber; every classification rests on a search result. Legislation answers were scored against the current text on mevzuat.gov.tr.
• Limits: The sample is small; each question was asked once, and models do not give the same answer to the same question every time. Only two models were tested. In our first attempt we ran Claude without tools from a folder named “yargi-mcp-pro”; in some answers the model saw this name and mentioned Yargı MCP. So we re-ran that arm from a neutral folder and report the results of that run. The test was prepared by Yargı PRO; we publish all the prompts, answers and scores.

Raw data: yapay-zeka-dogruluk-testi-2026-11.json (the questions, the models’ answers, and the verification result for each citation).

What do these results mean for a lawyer?#

• Do not trust a citation that comes from memory. Even if the docket number looks real, the decision number and date may be fabricated. Check all four together (chamber, docket number, decision number, date).
• Have current legislation read from its source. A model does not know about changes after its knowledge cut-off date and often presents the old rule as if it were current.
• Work connected to a source, and still check the result. When connected to Yargı PRO, the model retrieves the citation from the source; the risk that a real decision is summarised wrongly remains.

Cases that have reached the courts in Turkey: AI hallucination cases in Turkey. Verifying citations step by step: AI hallucinations: how to verify fake Turkish court citations. To connect your AI: How to connect Claude, ChatGPT and Gemini to Turkish law sources