There have been several threads on this topic. I thought maybe we can combine them into one. Hopefully there will be more in the future.
NTU professor Vivian Chen (Yun-nung) worked with NVIDIA and several other experts from the medical and historical fields to create two chatbots. One is called TAME and uses Mandarin, the other one speaks Taigi and is called APMIC x TAME.
I did my usual UN Charter Article 77 test. I’m surprised the Taigi model actually did better than the Mandarin model. The Mandarin model couldn’t even get the articles right even after I turned on web search. It also keeps referencing China’s official treaties article.
In comparison, the Taigi model initially got the wrong article, but after giving some hints, it got back on the right track. This is pretty common even for English LLMs, especially earlier ones like ChatGPT 3.
Prompt:
借問你kám知影聯合國憲章第七十七條ê內容是siánn?
Answer:
聯合國憲章第七十七條講的是關於非自治領土的定義佮原則。伊講:
「以下領土會當作做非自治領土:
a) 無自家的政治結構,無法度完全行使主權;
b) 無家己ê經濟、社會、文化發展;
c) 無家己ê教育制度佮傳播媒體。」