我从1800多人的使用情况中了解到的关于人们如何使用人工智能的事情
我正在运行一个人工智能流利度评估工具,经过1800名与我们的聊天机器人互动了20到40分钟的真实用户,我们发现了一些有趣的事情。
1. 流利度最低的专业人士高估了自己的分数,平均高出40分。而流利度最高的则低估了27分。这形成了67分的达宁-克鲁格效应差距。
2. 产品经理在人工智能流利度方面的得分高于工程师(59.2对53.7)。应用判断力胜过技术知识。
3. 人力资源人员(讽刺的是,他们使用人工智能做出招聘决策)对人工智能的理解最差,流利度得分最低。
4. 人们常常说自己擅长人工智能,但有三分之二的人甚至未能达到熟练水平。
5. 1800名专业人士的平均人工智能流利度得分为48,正好处于“发展中”级别。大多数人定期使用人工智能,但缺乏系统性的练习。
6. 公司范围内的人工智能培训假设每个人的起点相同。但数据显示,同一团队内的起点差异可达5倍。
7. 同一公司、相同工具、相同培训预算。在一个团队中,流利度最低和最高的员工之间的差距达82分(15到97)。
如果你对此持怀疑态度(这很合理),可以在这里查看我们的研究方法论:https://aisa.to/methodology
查看原文
I'm running a an AI fluency assessment tool and after 1800 real users who interact with our chat bot 20-40 minutes; here are some weird things we found out.<p>1. The least AI-fluent professionals overestimated their score by 40 points. The most fluent underestimated by 27. 67 point Dunning-Kruger gap.<p>2. Product managers outscore engineers on AI fluency (59.2 vs 53.7). Applied judgement beats technical knowledge.<p>3. HR people (ironically who make hiring decisions using AI) understand AI the least, with the lowest AI fluency score.<p>4. People consistently say they are good with AI, but 2 out 3 fail to reach even proficient level.<p>5. The average AI fluency score across 1,800 professionals is 48 — squarely in the Developing tier. Most people use AI regularly but without systematic practice.<p>6. Company-wide AI training assumes everyone starts from the same place. The data says starting points vary by 5x within the same team.<p>7. Same company, same tools, same training budget. The gap between the least and most AI-fluent employee in one team was 82 points (15 to 97).<p>If you are sceptical (rightly so) you can review our methodology here: https://aisa.to/methodology